---
格式版本: 2
标题: "RATIO: A Benchmark for Retrieval Across Typed Ideation Operations in Scientific Literature"
原文链接: "https://arxiv.org/abs/2608.27394"
发布日期: "2026-08-27"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Thu, 27 Aug 2026 17:24:58 UTC (2,681 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-30T15:12:25+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-30T15:11:38+08:00"
入库时间: "2026-08-30T07:12:25.307Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=Scale-up&searchtype=all"
匹配关键词:
  - "Scale-up"
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 31
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "正文主线是科学文献检索基准RATIO，新增可核验事实包括Address、Broaden、Specify三类检索操作及基于大规模论文构建的方法；arXiv预印本来源可追溯，但当前仅提供摘要页。固定知识库未显示同一论文的历史重复，不过该研究与超节点、AI Rack、机架级互连、供电、液冷或部署无关，也无客户、量产和商业部署信号，命中弱相关强否决，当前页面不具备业务情报库准入价值。"
AI质检模型: "gpt-5.6-sol"
AI质检时间: "2026-08-30T15:12:33+08:00"
AI主题相关性: 0
AI来源权威性: 10
AI新颖性: 12
AI技术细节: 2
AI商业部署信号: 0
AI完整性: 7
AI评分提示词版本: "v17-精简生产版"
AI评分提示词SHA256: "48fb9777f386026761b4873eaff30807694fb11e9b352d7c69bf2dfde750cc7d"
AI评分知识库版本: "knowledge_base_v1-20260819+runtime.55"
AI评分知识库SHA256: "ca56afec1ff616b1fa4394cd1d08b1e2a6af47eccbe70c802c9f1fea6037e803"
AI评分知识库检索词: "[\"Scale-up\",\"RATIO\",\"PDF\",\"arxiv.org/pdf/2608.27394\",\"HTML\",\"arxiv.org/html/2608.27394v1\",\"CS\",\"v1\",\"LLM\",\"arxiv.org/abs/2608.27394\",\"arxiv.org/abs/2608.27394v1\",\"doi.org/10.48550/arXiv.2608.27394\"]"
AI评分知识库命中: "[{\"id\":\"july-correct-0111\",\"title\":\"StrataCL: Fabric-Native Communication Library for Production Supernodes\",\"sourceType\":\"labeled_article\",\"time\":\"2026-07\",\"matchedTerms\":[\"RATIO\",\"PDF\",\"HTML\",\"CS\",\"v1\",\"LLM\"],\"rank\":-22.14219114067865},{\"id\":\"runtime-569639751a0dbe7ef3ffccc5\",\"title\":\"[2608.17503] Predict Before Replay: Joint FEC and Flight Control for Reliable Scale-Up Links\",\"sourceType\":\"ai_excellent_article\",\"time\":\"2026-08-18\",\"matchedTerms\":[\"Scale-up\",\"RATIO\",\"PDF\",\"HTML\",\"CS\",\"v1\"],\"rank\":-21.066154573818892},{\"id\":\"runtime-f189311ea2754e83ede89a96\",\"title\":\"Cerebras's Next Generation CS-4: Fast Just Got Faster\",\"sourceType\":\"ai_excellent_article\",\"time\":\"2026-08-19\",\"matchedTerms\":[\"RATIO\",\"CS\"],\"rank\":-11.42869574575618},{\"id\":\"july-correct-0115\",\"title\":\"锚定 300kW 整机柜演进方向 OAII 社区三项规范联合发布，树立AIDC基础设施建设标准答案\",\"sourceType\":\"labeled_article\",\"time\":\"2026-07\",\"matchedTerms\":[\"HTML\",\"v1\",\"LLM\"],\"rank\":-9.189748117488982},{\"id\":\"runtime-d703a1deb2828387e1259ee9\",\"title\":\"Cerebras Overclocks WSE-3 Waferscale Engine To Boost Inference Oomph In “Nexus” CS-4\",\"sourceType\":\"ai_excellent_article\",\"time\":\"2026-08-19\",\"matchedTerms\":[\"RATIO\",\"CS\"],\"rank\":-8.953929624526843}]"
AI摘要: "研究者提出RATIO基准，用于检索科学文献中三类“构思操作”：Address（获取问题方案）、Broaden（扩展一般化表述）和Specify（寻找具体实现），该基准基于数百万篇计算机科学论文构建，并结合远距离监督标注与人工审核；"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-08-30T18:08:57.777Z"
采集批次: "2026年8月30日14点11分37秒"
采集批次ID: "20260830-141137-130"
去重键: "https://arxiv.org/abs/2608.27394"
---

## Computer Science > Computation and Language

## Title:RATIO: A Benchmark for Retrieval Across Typed Ideation Operations in Scientific Literature

Authors:[Maayan Sharon](https://arxiv.org/search/cs?searchtype=author&query=Sharon,+M), [Tom Hope](https://arxiv.org/search/cs?searchtype=author&query=Hope,+T)

[View PDF](https://arxiv.org/pdf/2608.27394) [HTML (experimental)](https://arxiv.org/html/2608.27394v1)

> Abstract:Retrieved scientific literature can serve as inspiration for both human and AI scientists. Inspiration can take different forms: prior work may directly suggest how to address a problem, or surface directions at different levels of abstraction - zooming out to a more general view or zooming in to a concrete realization. We introduce RATIO (Retrieval Across Typed Ideation Operations), a large-scale benchmark in which relevance is defined by three operations which we name ideation moves: Address retrieves potential approaches for stated problems, Broaden retrieves more general formulations, and Specify retrieves concrete instantiations. RATIO is constructed from millions of full-text scientific papers across CS literature via a general recipe that extends discourse-marker distant supervision - previously used only for classification - to corpus-scale retrieval, combined with extensive LLM and human vetting. Experiments show that operation-specific fine-tuning substantially boosts retrievers but leaves much room for further improvements. RATIO provides a scalable training and evaluation framework for retrieval components that support literature-grounded ideation, opening up new research avenues on scientific inspiration retrieval.

| Subjects: | Computation and Language (cs.CL); Information Retrieval (cs.IR) |
| --- | --- |
| Cite as: | [arXiv:2608.27394](https://arxiv.org/abs/2608.27394) \[cs.CL\] |
|  | (or [arXiv:2608.27394v1](https://arxiv.org/abs/2608.27394v1) \[cs.CL\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.27394](https://doi.org/10.48550/arXiv.2608.27394) |

## Submission history

From: Maayan Sharon \[[view email](https://arxiv.org/show-email/89de680c/2608.27394)\]  
**\[v1\]** Thu, 27 Aug 2026 17:24:58 UTC (2,681 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.27394) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))