--- 格式版本: 2 标题: "Hugging Face" 原文链接: "https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro" 发布日期: "2026-07-31" 发布时间校准状态: "found" 发布时间需复核: "否" 发布时间来源: "manual" 发布时间证据: "候选日期来自HuggingFace provider元数据中的publishedAt字段，表示模型页面的发布时间，符合文章发布时间定义，且无其他候选冲突。" 发布时间校准原因: "候选日期来自HuggingFace provider元数据中的publishedAt字段，表示模型页面的发布时间，符合文章发布时间定义，且无其他候选冲突。" 发布时间校准置信度: "manual-confirmed" 发布时间候选数量: 0 发布时间严格候选数量: 0 发布时间原页读取状态: "manual" 发布时间未找到原因: "" 发布时间校准时间: "2026-08-13T10:11:33+08:00" 发布时间仲裁状态: "manual" 发布时间仲裁尝试次数: 0 发布时间仲裁耗时毫秒: 0 发现时间: "2026-08-12T21:42:48+08:00" 入库时间: "2026-08-12T13:52:19.691Z" 来源平台: "固定入口" 搜索渠道: "fixed_url" 搜索词: "https://docs.oracle.com/en-us/iaas/releasenotes" 匹配关键词: - "AI" - "deployment" - "performance" 相关厂家: - "Oracle" - "OpenAI" 相关专家: [] 内容类型: "网页" 抓取工具: "Free Fetch + Defuddle" 清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取" 原始附件: [] AI优质: "否" AI打分: 5 AI分档: "非优质" AI质检状态: "不通过" AI打分理由: "内容为DeepSeek-V4大语言模型的技术报告和下载页面，与超节点、AI Rack、机柜级AI基础设施等硬件架构主题完全无关。" AI质检模型: "ali-deepseek-v4-flash" AI质检时间: "2026-08-12T21:52:26+08:00" AI主题相关性: 0 AI来源权威性: 0 AI新颖性: 0 AI技术细节: 0 AI商业部署信号: 0 AI完整性: 5 采集批次: "2026年8月12日20点58分23秒" 采集批次ID: "20260812-205823-234" 去重键: "https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro" --- ## DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence ![DeepSeek-V4](https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/logo.svg?raw=true) --- [![Homepage](https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/badge.svg?raw=true)](https://www.deepseek.com/)[![Chat](https://img.shields.io/badge/%F0%9F%A4%96%20Chat-DeepSeek%20V4-536af5?color=536af5&logoColor=white)](https://chat.deepseek.com/) [![License](https://img.shields.io/badge/License-MIT-f5de53?&color=f5de53)](https://huggingface.co/deepseek-ai/LICENSE) [**Technical Report** 👁️](https://arxiv.org/abs/2606.19348) ## Introduction We present a preview version of **DeepSeek-V4** series, including two strong Mixture-of-Experts (MoE) language models — **DeepSeek-V4-Pro** with 1.6T parameters (49B activated) and **DeepSeek-V4-Flash** with 284B parameters (13B activated) — both supporting a context length of **one million tokens**. DeepSeek-V4 series incorporate several key upgrades in architecture and optimization: 1. **Hybrid Attention Architecture:** We design a hybrid attention mechanism combining Compressed Sparse Attention (CSA) and Heavily Compressed Attention (HCA) to dramatically improve long-context efficiency. In the 1M-token context setting, DeepSeek-V4-Pro requires only **27% of single-token inference FLOPs** and **10% of KV cache** compared with DeepSeek-V3.2. 2. **Manifold-Constrained Hyper-Connections (mHC):** We incorporate mHC to strengthen conventional residual connections, enhancing stability of signal propagation across layers while preserving model expressivity. 3. **Muon Optimizer:** We employ the Muon optimizer for faster convergence and greater training stability. We pre-train both models on more than **32T** diverse and high-quality tokens, followed by a comprehensive post-training pipeline. The post-training features a two-stage paradigm: independent cultivation of domain-specific experts (through SFT and RL with GRPO), followed by unified model consolidation via on-policy distillation, integrating distinct proficiencies across diverse domains into a single model. **DeepSeek-V4-Pro-Max**, the maximum reasoning effort mode of DeepSeek-V4-Pro, significantly advances the knowledge capabilities of open-source models, firmly establishing itself as the best open-source model available today. It achieves top-tier performance in coding benchmarks and significantly bridges the gap with leading closed-source models on reasoning and agentic tasks. Meanwhile, **DeepSeek-V4-Flash-Max** achieves comparable reasoning performance to the Pro version when given a larger thinking budget, though its smaller parameter scale naturally places it slightly behind on pure knowledge tasks and the most complex agentic workflows. ![](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/resolve/main/assets/dsv4_performance.png) ## Model Downloads | **Model** | **#Total Params** | **#Activated Params** | **Context Length** | **Precision** | **Download** | | --- | --- | --- | --- | --- | --- | | DeepSeek-V4-Flash-Base | 284B | 13B | 1M | FP8 Mixed | [HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-Base) \| [ModelScope](https://modelscope.cn/models/deepseek-ai/DeepSeek-V4-Flash-Base) | | DeepSeek-V4-Flash | 284B | 13B | 1M | FP4 + FP8 Mixed\* | [HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash) \| [ModelScope](https://modelscope.cn/models/deepseek-ai/DeepSeek-V4-Flash) | | DeepSeek-V4-Pro-Base | 1.6T | 49B | 1M | FP8 Mixed | [HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-Base) \| [ModelScope](https://modelscope.cn/models/deepseek-ai/DeepSeek-V4-Pro-Base) | | DeepSeek-V4-Pro | 1.6T | 49B | 1M | FP4 + FP8 Mixed\* | [HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro) \| [ModelScope](https://modelscope.cn/models/deepseek-ai/DeepSeek-V4-Pro) | *\*FP4 + FP8 Mixed: MoE expert parameters use FP4 precision; most other parameters use FP8.* ## Evaluation Results ### Base Model | Benchmark (Metric) | \# Shots | DeepSeek-V3.2-Base | DeepSeek-V4-Flash-Base | DeepSeek-V4-Pro-Base | | --- | --- | --- | --- | --- | | Architecture | \- | MoE | MoE | MoE | | \# Activated Params | \- | 37B | 13B | 49B | | \# Total Params | \- | 671B | 284B | 1.6T | | **World Knowledge** | | | | | | AGIEval (EM) | 0-shot | 80.1 | 82.6 | **83.1** | | MMLU (EM) | 5-shot | 87.8 | 88.7 | **90.1** | | MMLU-Redux (EM) | 5-shot | 87.5 | 89.4 | **90.8** | | MMLU-Pro (EM) | 5-shot | 65.5 | 68.3 | **73.5** | | MMMLU (EM) | 5-shot | 87.9 | 88.8 | **90.3** | | C-Eval (EM) | 5-shot | 90.4 | 92.1 | **93.1** | | CMMLU (EM) | 5-shot | 88.9 | 90.4 | **90.8** | | MultiLoKo (EM) | 5-shot | 38.7 | 42.2 | **51.1** | | Simple-QA verified (EM) | 25-shot | 28.3 | 30.1 | **55.2** | | SuperGPQA (EM) | 5-shot | 45.0 | 46.5 | **53.9** | | FACTS Parametric (EM) | 25-shot | 27.1 | 33.9 | **62.6** | | TriviaQA (EM) | 5-shot | 83.3 | 82.8 | **85.6** | | **Language & Reasoning** | | | | | | BBH (EM) | 3-shot | **87.6** | 86.9 | 87.5 | | DROP (F1) | 1-shot | 88.2 | 88.6 | **88.7** | | HellaSwag (EM) | 0-shot | 86.4 | 85.7 | **88.0** | | WinoGrande (EM) | 0-shot | 78.9 | 79.5 | **81.5** | | CLUEWSC (EM) | 5-shot | 83.5 | 82.2 | **85.2** | | **Code & Math** | | | | | | BigCodeBench (Pass@1) | 3-shot | **63.9** | 56.8 | 59.2 | | HumanEval (Pass@1) | 0-shot | 62.8 | 69.5 | **76.8** | | GSM8K (EM) | 8-shot | 91.1 | 90.8 | **92.6** | | MATH (EM) | 4-shot | 60.5 | 57.4 | **64.5** | | MGSM (EM) | 8-shot | 81.3 | **85.7** | 84.4 | | CMath (EM) | 3-shot | 92.6 | **93.6** | 90.9 | | **Long Context** | | | | | | LongBench-V2 (EM) | 1-shot | 40.2 | 44.7 | **51.5** | ### Instruct Model DeepSeek-V4-Pro and DeepSeek-V4-Flash both support three reasoning effort modes: | Reasoning Mode | Characteristics | Typical Use Cases | Response Format | | --- | --- | --- | --- | | Non-think | Fast, intuitive responses | Routine daily tasks, low-risk decisions | `` summary | | Think High | Conscious logical analysis, slower but more accurate | Complex problem-solving, planning | `` thinking `` summary | | Think Max | Push reasoning to its fullest extent | Exploring the boundary of model reasoning capability | Special system prompt + `` thinking `` summary | #### DeepSeek-V4-Pro-Max vs Frontier Models | Benchmark (Metric) | Opus-4.6 Max | GPT-5.4 xHigh | Gemini-3.1-Pro High | K2.6 Thinking | GLM-5.1 Thinking | DS-V4-Pro Max | | --- | --- | --- | --- | --- | --- | --- | | **Knowledge & Reasoning** | | | | | | | | MMLU-Pro (EM) | 89.1 | 87.5 | **91.0** | 87.1 | 86.0 | 87.5 | | SimpleQA-Verified (Pass@1) | 46.2 | 45.3 | **75.6** | 36.9 | 38.1 | 57.9 | | Chinese-SimpleQA (Pass@1) | 76.4 | 76.8 | **85.9** | 75.9 | 75.0 | 84.4 | | GPQA Diamond (Pass@1) | 91.3 | 93.0 | **94.3** | 90.5 | 86.2 | 90.1 | | HLE (Pass@1) | 40.0 | 39.8 | **44.4** | 36.4 | 34.7 | 37.7 | | LiveCodeBench (Pass@1) | 88.8 | \- | 91.7 | 89.6 | \- | **93.5** | | Codeforces (Rating) | \- | 3168 | 3052 | \- | \- | **3206** | | HMMT 2026 Feb (Pass@1) | 96.2 | **97.7** | 94.7 | 92.7 | 89.4 | 95.2 | | IMOAnswerBench (Pass@1) | 75.3 | **91.4** | 81.0 | 86.0 | 83.8 | 89.8 | | Apex (Pass@1) | 34.5 | 54.1 | **60.9** | 24.0 | 11.5 | 38.3 | | Apex Shortlist (Pass@1) | 85.9 | 78.1 | 89.1 | 75.5 | 72.4 | **90.2** | | **Long Context** | | | | | | | | MRCR 1M (MMR) | **92.9** | \- | 76.3 | \- | \- | 83.5 | | CorpusQA 1M (ACC) | **71.7** | \- | 53.8 | \- | \- | 62.0 | | **Agentic** | | | | | | | | Terminal Bench 2.0 (Acc) | 65.4 | **75.1** | 68.5 | 66.7 | 63.5 | 67.9 | | SWE Verified (Resolved) | **80.8** | \- | 80.6 | 80.2 | \- | 80.6 | | SWE Pro (Resolved) | 57.3 | 57.7 | 54.2 | **58.6** | 58.4 | 55.4 | | SWE Multilingual (Resolved) | **77.5** | \- | \- | 76.7 | 73.3 | 76.2 | | BrowseComp (Pass@1) | 83.7 | 82.7 | **85.9** | 83.2 | 79.3 | 83.4 | | HLE w/ tools (Pass@1) | 53.1 | 52.0 | 51.6 | **54.0** | 50.4 | 48.2 | | GDPval-AA (Elo) | 1619 | **1674** | 1314 | 1482 | 1535 | 1554 | | MCPAtlas Public (Pass@1) | **73.8** | 67.2 | 69.2 | 66.6 | 71.8 | 73.6 | | Toolathlon (Pass@1) | 47.2 | **54.6** | 48.8 | 50.0 | 40.7 | 51.8 | #### Comparison across Modes | Benchmark (Metric) | V4-Flash Non-Think | V4-Flash High | V4-Flash Max | V4-Pro Non-Think | V4-Pro High | V4-Pro Max | | --- | --- | --- | --- | --- | --- | --- | | **Knowledge & Reasoning** | | | | | | | | MMLU-Pro (EM) | 83.0 | 86.4 | 86.2 | 82.9 | 87.1 | **87.5** | | SimpleQA-Verified (Pass@1) | 23.1 | 28.9 | 34.1 | 45.0 | 46.2 | **57.9** | | Chinese-SimpleQA (Pass@1) | 71.5 | 73.2 | 78.9 | 75.8 | 77.7 | **84.4** | | GPQA Diamond (Pass@1) | 71.2 | 87.4 | 88.1 | 72.9 | 89.1 | **90.1** | | HLE (Pass@1) | 8.1 | 29.4 | 34.8 | 7.7 | 34.5 | **37.7** | | LiveCodeBench (Pass@1) | 55.2 | 88.4 | 91.6 | 56.8 | 89.8 | **93.5** | | Codeforces (Rating) | \- | 2816 | 3052 | \- | 2919 | **3206** | | HMMT 2026 Feb (Pass@1) | 40.8 | 91.9 | 94.8 | 31.7 | 94.0 | **95.2** | | IMOAnswerBench (Pass@1) | 41.9 | 85.1 | 88.4 | 35.3 | 88.0 | **89.8** | | Apex (Pass@1) | 1.0 | 19.1 | 33.0 | 0.4 | 27.4 | **38.3** | | Apex Shortlist (Pass@1) | 9.3 | 72.1 | 85.7 | 9.2 | 85.5 | **90.2** | | **Long Context** | | | | | | | | MRCR 1M (MMR) | 37.5 | 76.9 | 78.7 | 44.7 | 83.3 | **83.5** | | CorpusQA 1M (ACC) | 15.5 | 59.3 | 60.5 | 35.6 | 56.5 | **62.0** | | **Agentic** | | | | | | | | Terminal Bench 2.0 (Acc) | 49.1 | 56.6 | 56.9 | 59.1 | 63.3 | **67.9** | | SWE Verified (Resolved) | 73.7 | 78.6 | 79.0 | 73.6 | 79.4 | **80.6** | | SWE Pro (Resolved) | 49.1 | 52.3 | 52.6 | 52.1 | 54.4 | **55.4** | | SWE Multilingual (Resolved) | 69.7 | 70.2 | 73.3 | 69.8 | 74.1 | **76.2** | | BrowseComp (Pass@1) | \- | 53.5 | 73.2 | \- | 80.4 | **83.4** | | HLE w/ tools (Pass@1) | \- | 40.3 | 45.1 | \- | 44.7 | **48.2** | | MCPAtlas (Pass@1) | 64.0 | 67.4 | 69.0 | 69.4 | **74.2** | 73.6 | | GDPval-AA (Elo) | \- | \- | 1395 | \- | \- | **1554** | | Toolathlon (Pass@1) | 40.7 | 43.5 | 47.8 | 46.3 | 49.0 | **51.8** | ## Chat Template This release does not include a Jinja-format chat template. Instead, we provide a dedicated `encoding` folder with Python scripts and test cases demonstrating how to encode messages in OpenAI-compatible format into input strings for the model, and how to parse the model's text output. Please refer to the [`encoding`](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/encoding/README.md) folder for full documentation. A brief example: ```python from encoding_dsv4 import encode_messages, parse_message_from_completion_text messages = [ {"role": "user", "content": "hello"}, {"role": "assistant", "content": "Hello! I am DeepSeek.", "reasoning_content": "thinking..."}, {"role": "user", "content": "1+1=?"} ] # messages -> string prompt = encode_messages(messages, thinking_mode="thinking") # string -> tokens import transformers tokenizer = transformers.AutoTokenizer.from_pretrained("deepseek-ai/DeepSeek-V4-Pro") tokens = tokenizer.encode(prompt) ``` ## How to Run Locally Please refer to the [inference](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/inference/README.md) folder for detailed instructions on running DeepSeek-V4 locally, including model weight conversion and interactive chat demos. For local deployment, we recommend setting the sampling parameters to `temperature = 1.0, top_p = 1.0`. For the Think Max reasoning mode, we recommend setting the context window to at least **384K** tokens. ## License This repository and the model weights are licensed under the [MIT License](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/tree/main/LICENSE). ## Citation ``` @misc{deepseekai2026deepseekv4, title={DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence}, author={DeepSeek-AI}, year={2026}, } ``` ## Contact If you have any questions, please raise an issue or contact us at [service@deepseek.com](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/service@deepseek.com). Downloads last month 1,411,583 Safetensors Model size 1.6T params Tensor type BF16 I64 F32 F8\_E4M3 I8 ## Model tree for deepseek-ai/DeepSeek-V4-Pro ## Spaces using deepseek-ai/DeepSeek-V4-Pro 100 ## Collection including deepseek-ai/DeepSeek-V4-Pro ## Paper for deepseek-ai/DeepSeek-V4-Pro[Paper • 2606.19348 • Published Apr 26 • 30](https://huggingface.co/papers/2606.19348) ## Evaluation results - [openai/gsm8k](https://huggingface.co/datasets/openai/gsm8k) · Gsm8k 92.6 - [SWE-bench/SWE-bench\_Verified](https://huggingface.co/datasets/SWE-bench/SWE-bench_Verified) · Swe Bench Resolved 80.6 - [ScaleAI/SWE-bench\_Pro](https://huggingface.co/datasets/ScaleAI/SWE-bench_Pro) · SWE Bench Pro 55.4 - [IntelligenceLab/Long-Horizon-Terminal-Bench](https://huggingface.co/datasets/IntelligenceLab/Long-Horizon-Terminal-Bench) · Lhtb [source](https://zli12321.github.io/LHTB/leaderboard.html) 30.7 * - [actava/chi-bench](https://huggingface.co/datasets/actava/chi-bench) - Chi Bench [source](https://arxiv.org/abs/2605.16679) 14.2 * - Prior Authorization [source](https://arxiv.org/abs/2605.16679) 10.7 * - +2 more