---
格式版本: 2
标题: "OenoBench: A Wine-Domain Benchmark for Knowledge-Grounded Evaluation of Large Language Models"
原文链接: "https://arxiv.org/abs/2608.20106"
发布日期: "2026-08-20"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Thu, 20 Aug 2026 14:37:22 UTC (929 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-21T16:17:59+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-21T16:16:59+08:00"
入库时间: "2026-08-21T08:17:59.604Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=Google&searchtype=all"
匹配关键词:
  []
相关厂家:
  - "Google"
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 8
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "内容为葡萄酒领域LLM基准测试论文，与超节点/AI Rack/机柜级AI基础设施、高速互连、供电、液冷、量产部署等主题完全无关，且无相关商业或技术信号。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-21T16:18:12+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 3
AI摘要: "研究者提出OenoBench，一个基于知识评估大语言模型的葡萄酒领域基准，包含3266道多选题；测试16个前沿模型配置后，准确率介于53%至84%，其中o3最高达83.6%。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T02:12:14.433Z"
采集批次: "2026年8月21日13点55分53秒"
采集批次ID: "20260821-135553-743"
去重键: "https://arxiv.org/abs/2608.20106"
---

## Computer Science > Computation and Language

## Title:OenoBench: A Wine-Domain Benchmark for Knowledge-Grounded Evaluation of Large Language Models

Authors:[Nikita Khudov](https://arxiv.org/search/cs?searchtype=author&query=Khudov,+N)

[View PDF](https://arxiv.org/pdf/2608.20106) [HTML (experimental)](https://arxiv.org/html/2608.20106v1)

> Abstract:We introduce OenoBench, a wine-domain knowledge benchmark of 3,266 multiple-choice questions across six pillars (regions, grape varieties, viticulture, winemaking, producers, business) and four difficulty tiers. The corpus is built from 38,104 atomic, source-anchored facts extracted by 35 provenance-verified scrapers from government registries (INAO, TTB, OIV), peer-reviewed journals, and Wikipedia/Wikidata. Our methodological contribution is an LLM-driven pipeline in which language models reformat verified facts and audit the result, but never serve as the source of truth: every claim traces to a URL, every question is generated by one of five strategies across five generator families, and every question is scored by a nine-agent audit calibrated against a human gold sheet via Cohen's $\kappa$. Evaluating sixteen frontier configurations, we find: (i) overall accuracy spans 53%-84%, led by o3 at 83.6%; (ii) reasoning-mode lift concentrates in DeepSeek R1 (+6.8pp) and is absent in Claude Opus and Gemini Pro; (iii) Anthropic shows +9pp self preference on its own questions while Google shows -8pp inverse preference; (iv) frontier open-weight models share the cost-vs-accuracy Pareto frontier with proprietary reasoning models; and (v) every config gains around 33pp on closed-book solvable items, revealing a parametric-recall ceiling that only the contextual slice avoids. We release corpus, audit findings, human-review app, and construction code under CC-BY-SA-4.0.

| Subjects: | Computation and Language (cs.CL) |
| --- | --- |
| Cite as: | [arXiv:2608.20106](https://arxiv.org/abs/2608.20106) \[cs.CL\] |
|  | (or [arXiv:2608.20106v1](https://arxiv.org/abs/2608.20106v1) \[cs.CL\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.20106](https://doi.org/10.48550/arXiv.2608.20106) |

## Submission history

From: Nikita Khudov \[[view email](https://arxiv.org/show-email/91e72dab/2608.20106)\]  
**\[v1\]** Thu, 20 Aug 2026 14:37:22 UTC (929 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.20106) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))