---
格式版本: 2
标题: "A decodability criterion predicts when hidden-state selection beats majority voting in large language models"
原文链接: "https://arxiv.org/abs/2608.17124"
发布日期: "2026-08-17"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Mon, 17 Aug 2026 21:02:10 UTC (1,398 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T14:23:38+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T14:19:37+08:00"
入库时间: "2026-08-20T06:23:38.812Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=Scale-up&searchtype=all"
匹配关键词:
  - "Scale-up"
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 16
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "论文讨论LLM投票与隐藏状态选择，与超节点、AI Rack、机柜级AI基础设施、供电散热互连等主题完全无关，仅命中Scale-up搜索词在标题中无实质关联。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-20T14:25:45+08:00"
AI主题相关性: 0
AI来源权威性: 8
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 8
AI摘要: "CASE 提出一种基于答案 token 隐状态的线性门控选择方法，用“可解码性”指标预先判断隐状态选择是否优于多数投票；在通用和医学大模型上，中等难度问题最高提升 19 分，困难问题提升 16.8 分，预测相关性达 r=0.75。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:24:49.483Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.17124"
---

## Computer Science > Artificial Intelligence

## Title:A decodability criterion predicts when hidden-state selection beats majority voting in large language models

Authors:[Zhixiang wang](https://arxiv.org/search/cs?searchtype=author&query=wang,+Z), [Ziliang Hong](https://arxiv.org/search/cs?searchtype=author&query=Hong,+Z), [Ulas Bagci](https://arxiv.org/search/cs?searchtype=author&query=Bagci,+U)

[View PDF](https://arxiv.org/pdf/2608.17124) [HTML (experimental)](https://arxiv.org/html/2608.17124v1)

> Abstract:Combining the answers a large language model (LLM) samples for a question into one decision is a test-time information fusion problem, usually solved by majority voting. Voting is unreliable on difficult questions, where the sampled answers share correlated errors, so the wrong answer can win and drawing more samples makes the decision worse. Selecting a candidate by reading a correctness signal from the model's hidden states is a promising alternative, but its accuracy varies across models and tasks, and no measure indicates when it can be trusted. In this paper, we propose CASE (Correctness-Axis SElection), a dynamic selection combiner that trains a linear gate on the answer-token hidden state and selects the highest-scoring candidate. Its main contribution is decodability, a leakage-free measure of how well the gate ranks a question's correct candidates above its incorrect ones, which predicts whether hidden-state selection will outperform voting. A conventional probe appears accurate only because of question-identity leakage, which vanishes under question-grouped evaluation. On held-out data, decodability predicts the accuracy gain of selection over voting with a Pearson correlation r=0.75 and a decision threshold near AUC=0.60. Across general and medical LLMs, CASE improves over voting by up to 19 points on medium-difficulty questions and 16.8 points on hard questions. Decodability depends on the aligned knowledge a model must recall, not on its scale, and its prediction transfers to an unseen scientific domain within 3.8 points. It thus provides a practical criterion, measurable in advance for a given model and task, for choosing between learned selection and majority voting.

| Subjects: | Artificial Intelligence (cs.AI) |
| --- | --- |
| Cite as: | [arXiv:2608.17124](https://arxiv.org/abs/2608.17124) \[cs.AI\] |
|  | (or [arXiv:2608.17124v1](https://arxiv.org/abs/2608.17124v1) \[cs.AI\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.17124](https://doi.org/10.48550/arXiv.2608.17124) |

## Submission history

From: Ziliang Hong \[[view email](https://arxiv.org/show-email/beeb4105/2608.17124)\]  
**\[v1\]** Mon, 17 Aug 2026 21:02:10 UTC (1,398 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.17124) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))