---
格式版本: 2
标题: "Conditional Evaluation of Language Models with Cheap Auxiliary Signals"
原文链接: "https://arxiv.org/abs/2608.16210"
发布日期: "2026-08-17"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Mon, 17 Aug 2026 07:44:22 UTC (412 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T14:46:48+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T14:38:42+08:00"
入库时间: "2026-08-20T06:46:48.620Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=Oracle&searchtype=all"
匹配关键词:
  - "deployment"
  - "performance"
相关厂家:
  - "Oracle"
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 5
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "该资料为arXiv机器学习论文，讨论LLM评估方法，与超节点、AI Rack、机柜级AI基础设施、供电散热互连等核心主题完全无关。虽来源权威，但主题不相关，无技术细节和商业信号，判定为无关。"
AI质检模型: "tx-deepseek-v4-flash"
AI质检时间: "2026-08-20T14:50:10+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 5
AI摘要: "研究者提出 LACE，一种基于廉价辅助信号（如 LLM 裁判分数、置信度等）的半监督条件评估估计器，通过局部中心化将辅助信号用于提升效率而不引入偏差；"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:25:21.781Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.16210"
---

## Computer Science > Machine Learning

## Title:Conditional Evaluation of Language Models with Cheap Auxiliary Signals

Authors:[Zhi Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+Z), [Lingfeng Lyu](https://arxiv.org/search/cs?searchtype=author&query=Lyu,+L), [Yue Kang](https://arxiv.org/search/cs?searchtype=author&query=Kang,+Y), [Doudou Zhou](https://arxiv.org/search/cs?searchtype=author&query=Zhou,+D)

[View PDF](https://arxiv.org/pdf/2608.16210) [HTML (experimental)](https://arxiv.org/html/2608.16210v1)

> Abstract:Aggregate accuracy hides where models succeed and fail. Estimating conditional performance profiles from gold labels alone is expensive, while cheap auxiliary signals such as LLM-judge scores, pairwise comparisons, confidence scores, and judge-disagreement features can be collected for every benchmark item but are often biased or miscalibrated. We propose LACE (Local Augmented Control-Variate Evaluation), a semi-supervised estimator for conditional LLM evaluation. The key step is local centering: after subtracting the conditional mean of a cheap signal within the target profile region, any linear augmentation has zero conditional mean and therefore cannot change the estimand. The augmentation coefficient is used only for efficiency, and a local ridge control variate combines a gold-label residual mean from the labeled subset with a cheap-signal mean from the full item pool. We prove calibration-free identification, unbiasedness for grouped profiles, local oracle optimality within centered linear augmentations, and first-order adaptivity to the estimated coefficient. The resulting gain formula is governed by a population local $R^2$, which characterizes how the efficiency attainable from the cheap signals varies across profile values. We also derive corresponding estimators for direct paired model gaps and deployment-weighted scores. We empirically evaluate the primary performance-profile estimator on MATH-500, ScienceQA, MMLU, WinoGrande, HellaSwag, TruthfulQA, GSM8K, and ARC.

| Subjects: | Machine Learning (cs.LG); Machine Learning (stat.ML) |
| --- | --- |
| Cite as: | [arXiv:2608.16210](https://arxiv.org/abs/2608.16210) \[cs.LG\] |
|  | (or [arXiv:2608.16210v1](https://arxiv.org/abs/2608.16210v1) \[cs.LG\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.16210](https://doi.org/10.48550/arXiv.2608.16210) |

## Submission history

From: Zhi Zhang \[[view email](https://arxiv.org/show-email/7b1c587d/2608.16210)\]  
**\[v1\]** Mon, 17 Aug 2026 07:44:22 UTC (412 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.16210) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))