---
格式版本: 2
标题: "ReRound: Reconstructive Rounding to Resolve Midpoint Ambiguity in Calibration-Free LLM Quantization"
原文链接: "https://arxiv.org/abs/2608.11045"
发布日期: "2026-08-11"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Tue, 11 Aug 2026 15:18:07 UTC (2,088 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-12T11:28:38+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-12T11:26:18+08:00"
入库时间: "2026-08-12T03:28:39.055Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=AI&searchtype=all"
匹配关键词:
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 15
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "论文主题为LLM量化方法ReRound，与超节点/AI Rack等机柜级AI基础设施完全无关，无相关技术细节或商业信号。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-12T11:28:44+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 5
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 5
采集批次: "2026年8月12日2点04分20秒"
采集批次ID: "20260812-020420-289"
去重键: "https://arxiv.org/abs/2608.11045"
---

## Computer Science > Machine Learning

## Title:ReRound: Reconstructive Rounding to Resolve Midpoint Ambiguity in Calibration-Free LLM Quantization

Authors:[He-Yen Hsieh](https://arxiv.org/search/cs?searchtype=author&query=Hsieh,+H), [H. T. Kung](https://arxiv.org/search/cs?searchtype=author&query=Kung,+H+T)

[View PDF](https://arxiv.org/pdf/2608.11045) [HTML (experimental)](https://arxiv.org/html/2608.11045v1)

> Abstract:ReRound (Reconstructive Rounding) is a post-training quantization method that addresses the midpoint ambiguity inherent in standard round-to-nearest (RTN) schemes when quantizing weights near the centers of quantization intervals.  
> Starting from a pretrained LLM, ReRound trains a conditional diffusion model to produce continuous reconstructions of low-bit weights for the LLM. These reconstructed weights act as a guidance signal to disambiguate the rounding direction of weights located close to interval midpoints.  
> To integrate this reconstruction-guided rounding with conventional RTN, ReRound introduces a tolerance metric measuring how far the quantized weight (not the final quantized integer) is away from the midpoint: quantized weights within a tolerance region around midpoints are quantized using diffusion-based reconstructions, whereas weights closer to quantization boundaries are quantized with RTN. By sweeping the tolerance parameter, ReRound generates multiple candidate quantized integer weight matrices and selects the de-quantized weight matrix candidate whose leading singular values most closely match those of the original full-precision weights. This selected candidate determines the tolerance parameter ReRound uses.  
> ReRound is particularly effective for smaller LLMs. Across a range of such models, it consistently outperforms standard RTN for 3-bit and 4-bit weight quantization. ReRound achieves superior accuracy compared to an extensive set of calibration-free methods, remains competitive with calibration-dependent approaches, and operates entirely offline, introducing no additional overhead during low-bit inference.  
> The ReRound strategy represents a new approach for low-bit quantization. The method applies to AI models beyond LLMs. This paper focuses on its applications to small LLMs.

| Comments: |  |
| --- | --- |
| Subjects: | Machine Learning (cs.LG); Computation and Language (cs.CL) |
| Cite as: | [arXiv:2608.11045](https://arxiv.org/abs/2608.11045) \[cs.LG\] |
|  | (or [arXiv:2608.11045v1](https://arxiv.org/abs/2608.11045v1) \[cs.LG\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.11045](https://doi.org/10.48550/arXiv.2608.11045) |

## Submission history

From: He-Yen Hsieh \[[view email](https://arxiv.org/show-email/060a7cce/2608.11045)\]  
**\[v1\]** Tue, 11 Aug 2026 15:18:07 UTC (2,088 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.11045) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))