---
格式版本: 2
标题: "Unlocking Lossless Speedups in LLMs via Discrete Diffusion"
原文链接: "https://arxiv.org/abs/2609.04010"
发布日期: "2026-09-03"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Thu, 3 Sep 2026 15:48:43 UTC (447 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-09-06T21:25:30+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-09-06T21:24:50+08:00"
入库时间: "2026-09-06T13:25:30.881Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=Scale-up&searchtype=all"
匹配关键词:
  - "Scale-up"
  - "throughput"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 8
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "该arXiv论文为LLM离散扩散加速方法研究，属于机器学习算法范畴，与超节点/AI Rack/机柜级AI基础设施、供电散热互连等主题完全无关。"
AI质检模型: "zj-deepseek-v4-flash"
AI质检时间: "2026-09-06T21:25:44+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 3
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 0
AI摘要: "该研究提出扩散增强语言模型Uno，通过轻量扩散权重并行生成多个token，无需独立草稿模型即可实现无损加速，在各类批大小下吞吐量高于主流推测解码方法，相较基础自回归模型最高提速3倍；"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-06T23:44:29.118Z"
采集批次: "2026年9月6日19点27分09秒"
采集批次ID: "20260906-192709-237"
去重键: "https://arxiv.org/abs/2609.04010"
---

## Computer Science > Machine Learning

## Title:Unlocking Lossless Speedups in LLMs via Discrete Diffusion

Authors:[Subham Sekhar Sahoo](https://arxiv.org/search/cs?searchtype=author&query=Sahoo,+S+S), [Lingjie Chen](https://arxiv.org/search/cs?searchtype=author&query=Chen,+L), [Khiem Pham](https://arxiv.org/search/cs?searchtype=author&query=Pham,+K), [Jonathan Geuter](https://arxiv.org/search/cs?searchtype=author&query=Geuter,+J), [Chaitanya Dwivedi](https://arxiv.org/search/cs?searchtype=author&query=Dwivedi,+C), [Varad Pimpalkhute](https://arxiv.org/search/cs?searchtype=author&query=Pimpalkhute,+V), [Yash Akhauri](https://arxiv.org/search/cs?searchtype=author&query=Akhauri,+Y), [Alexander Moreno](https://arxiv.org/search/cs?searchtype=author&query=Moreno,+A), [Mikhail Yurochkin](https://arxiv.org/search/cs?searchtype=author&query=Yurochkin,+M), [Zhenting Wang](https://arxiv.org/search/cs?searchtype=author&query=Wang,+Z), [Mostafa Elhoushi](https://arxiv.org/search/cs?searchtype=author&query=Elhoushi,+M), [Nolan Dey](https://arxiv.org/search/cs?searchtype=author&query=Dey,+N), [Shane Bergsma](https://arxiv.org/search/cs?searchtype=author&query=Bergsma,+S), [Joel Hestness](https://arxiv.org/search/cs?searchtype=author&query=Hestness,+J), [John Thickstun](https://arxiv.org/search/cs?searchtype=author&query=Thickstun,+J), [Eric Xing](https://arxiv.org/search/cs?searchtype=author&query=Xing,+E), [Zhengzhong Liu](https://arxiv.org/search/cs?searchtype=author&query=Liu,+Z)

[View PDF](https://arxiv.org/pdf/2609.04010)

> Abstract:Large Language Models (LLMs) owe much of their success to next-token prediction (NTP), but their autoregressive (AR) structure requires slow, sequential token generation. To overcome this bottleneck, we introduce diffusion-augmented LLMs, a new class of models that defines an AR model distribution while using diffusion to draw multiple tokens in parallel from that distribution. We decouple the parameters of these models into two sets: AR weights, trained using the standard NTP objective, and lightweight diffusion weights, trained to generate multiple tokens simultaneously. The diffusion weights are learned through a simple Diffusion Distillation phase that adds negligible overhead to existing LLM training pipelines. We also introduce $\Psi$ -Spec, a family of samplers that enables lossless acceleration and inference-time scaling at a fixed context length. Unlike speculative decoding, our method requires no separate draft model. Unlike diffusion LLMs (d-LLMs), it accelerates generation without sacrificing the quality of the underlying AR model. The resulting models, called Uno, can be trained from scratch or built by augmenting existing open-weight AR LLMs. Uno achieves higher throughput than leading speculative-decoding methods at every evaluated batch size and delivers up to $3\times$ speedups over the base AR model, including at the largest batch size supported by the device. Notably, our 8B Uno model outperforms the leading open d-LLM, the 26B DiffusionGemma, and the proprietary Mercury 2 across all evaluated benchmarks in agentic tool use, coding, and long-context reasoning. We release code and checkpoints at: [this https URL](https://s-sahoo.github.io/uno/)

| Comments: |  |
| --- | --- |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | [arXiv:2609.04010](https://arxiv.org/abs/2609.04010) \[cs.LG\] |
|  | (or [arXiv:2609.04010v1](https://arxiv.org/abs/2609.04010v1) \[cs.LG\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2609.04010](https://doi.org/10.48550/arXiv.2609.04010) |

## Submission history

From: Subham Sekhar Sahoo \[[view email](https://arxiv.org/show-email/e02443da/2609.04010)\]  
**\[v1\]** Thu, 3 Sep 2026 15:48:43 UTC (447 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2609.04010) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))