---
格式版本: 2
标题: "Impression Share Prediction: An Offline Evaluation Task for Ranking Systems"
原文链接: "https://arxiv.org/abs/2608.16872"
发布日期: "2026-08-17"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Mon, 17 Aug 2026 17:52:55 UTC (243 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T15:18:08+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T15:12:40+08:00"
入库时间: "2026-08-20T07:18:08.738Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=delivery&searchtype=all"
匹配关键词:
  - "delivery"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 5
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "内容为arXiv信息检索方向论文，主题为搜索排序的离线评估，与超节点/AI Rack/机柜级AI基础设施完全无关，仅因搜索词命中delivery一词进入候选，属于明显无关资料。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-20T15:19:03+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 0
AI摘要: "该文提出“展示份额预测”作为排序模型的离线评估任务，利用结构因果模型和统计学习框架，预测候选模型在各目标桶中的展示分配。实验显示随机森林在训练见过的模型上L1误差较基线降低49%；"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:24:21.442Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.16872"
---

## Computer Science > Information Retrieval

## Title:Impression Share Prediction: An Offline Evaluation Task for Ranking Systems

[View PDF](https://arxiv.org/pdf/2608.16872) [HTML (experimental)](https://arxiv.org/html/2608.16872v1)

> Abstract:Offline evaluation is a major gateway before online evaluation of ranking models in A/B testing. Standard offline metrics measure predictive accuracy, but are only a surrogate for downstream utility: a model can improve them while redistributing impressions across objective buckets in ways that degrade downstream utility. No offline method surfaces these impression share shifts before online evaluation. We propose \\emph{impression share prediction} as an offline evaluation task: given a candidate ranking model, predict the distribution of impressions it would produce across objective buckets - impressions grouped by optimization goal (e.g., click, video view). The task is inherently counterfactual, since the candidate has never served live traffic. We propose a structural causal model of how model predictions and delivery capacity jointly determine impression allocation, and show the counterfactual effect is identified from observational data. Building on this, we develop a statistical learning framework that predicts impression shares from a candidate's early-interaction confidence signals and current system state, trained on historical data. On data from multiple ranking model families, a Random Forest reduces L1 error by 49\\% over a constant baseline for models seen during training. For held-out models, evaluated by time since first appearance, the first hour is the closest analog to true online evaluation and the hardest: the Random Forest falls below the baseline because the capacity state still reflects the prior model. An encoder-conditioned architecture that simulates a 2-hour rollout over recent auction dynamics recovers $+$22\\% L1 in this regime.

| Subjects: | Information Retrieval (cs.IR) |
| --- | --- |
| Cite as: | [arXiv:2608.16872](https://arxiv.org/abs/2608.16872) \[cs.IR\] |
|  | (or [arXiv:2608.16872v1](https://arxiv.org/abs/2608.16872v1) \[cs.IR\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.16872](https://doi.org/10.48550/arXiv.2608.16872) |
| Related DOI: | [https://doi.org/10.1145/3773078.3831809](https://doi.org/10.1145/3773078.3831809) |

## Submission history

From: Mohsen Malmir \[[view email](https://arxiv.org/show-email/27a51271/2608.16872)\]  
**\[v1\]** Mon, 17 Aug 2026 17:52:55 UTC (243 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.16872) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))