---
格式版本: 2
标题: "Truncate Bad, Upweight Good: BoN-Style Distillation via Rank-Based Classification"
原文链接: "https://arxiv.org/abs/2608.19748"
发布日期: "2026-08-20"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Thu, 20 Aug 2026 07:49:21 UTC (382 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-21T16:18:43+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-21T16:17:02+08:00"
入库时间: "2026-08-21T08:18:44.002Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=Oracle&searchtype=all"
匹配关键词:
  - "AI"
相关厂家:
  - "Oracle"
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 8
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "内容为arXiv机器学习论文，与超节点/AI Rack/机柜级AI基础设施无关，仅因搜索词Oracle命中入口页，无相关技术或商业信息。"
AI质检模型: "tx-deepseek-v4-flash"
AI质检时间: "2026-08-21T16:19:12+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 1
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 2
AI摘要: "研究者提出TUP（截断劣项、加权优项）策略，用于Best-of-N风格的推理时生成蒸馏：从候选池中移除低排名完成，仅对保留的高排名尾部按可调锐度重新加权，并通过二元交叉熵完全离线训练策略。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T02:12:06.741Z"
采集批次: "2026年8月21日13点55分53秒"
采集批次ID: "20260821-135553-743"
去重键: "https://arxiv.org/abs/2608.19748"
---

## Computer Science > Machine Learning

## Title:Truncate Bad, Upweight Good: BoN-Style Distillation via Rank-Based Classification

Authors:[Yarin Bar](https://arxiv.org/search/cs?searchtype=author&query=Bar,+Y), [Yaniv Romano](https://arxiv.org/search/cs?searchtype=author&query=Romano,+Y)

[View PDF](https://arxiv.org/pdf/2608.19748) [HTML (experimental)](https://arxiv.org/html/2608.19748v1)

> Abstract:Inference-time selection methods, such as Best-of-N, improve generation by sampling a pool of candidates and selecting the top-ranked completion according to a reward model. Distillation seeks to amortize this procedure into a single policy by replacing raw rewards with in-pool ranks and learning a policy that upweights higher-ranked completions. However, existing rank-based policies typically use smooth full-support reweighting, so low-ranked completions receive less mass but remain in the target support. Although a sharper reweighting reduces lower-tail mass, it also increases reliance on brittle ranking at the top made by a single reward model. We propose TUP: a Truncate-bad, Upweight-good Policy that removes low-ranked completions from the support and reweights only the retained upper tail with a tunable sharpness. TUP admits a closed-form, prompt-independent normalization and can be trained fully offline via binary cross-entropy, using shifted-truncated win-rates as soft labels and distilled-to-reference log-likelihood ratios as logits. Theoretically, under certain assumptions, we show that for any unknown oracle reward, the best monotone rank-reweighting can be matched by a lower-tail truncation rule, providing formal support for removing the lower tail rather than merely downweighting it. Empirically, we show that TUP is competitive with strong offline alignment baselines.

| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL) |
| --- | --- |
| Cite as: | [arXiv:2608.19748](https://arxiv.org/abs/2608.19748) \[cs.LG\] |
|  | (or [arXiv:2608.19748v1](https://arxiv.org/abs/2608.19748v1) \[cs.LG\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.19748](https://doi.org/10.48550/arXiv.2608.19748) |

## Submission history

From: Yarin Bar \[[view email](https://arxiv.org/show-email/8d11719e/2608.19748)\]  
**\[v1\]** Thu, 20 Aug 2026 07:49:21 UTC (382 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.19748) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))