---
格式版本: 2
标题: "Q-based Variational Inverse Reinforcement Learning"
原文链接: "https://arxiv.org/abs/2608.16888"
发布日期: "2026-08-17"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:scrape:strict_html_body"
发布时间证据: "citation_date: 2026/08/17"
发布时间校准原因: "规则确认唯一严格发布时间，来源 scrape:strict_html_body"
发布时间校准置信度: "high"
发布时间候选数量: 6
发布时间严格候选数量: 6
发布时间原页读取状态: ""
发布时间未找到原因: ""
发布时间校准时间: "2026-08-18T19:33:13+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-18T19:33:13+08:00"
入库时间: "2026-08-18T11:33:19.776Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=performance&searchtype=all"
匹配关键词:
  - "performance"
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 25
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "论文主题为逆强化学习，与超节点/AI Rack/机柜级AI基础设施完全无关，无相关技术或商业信息。"
AI质检模型: "tx-deepseek-v4-flash"
AI质检时间: "2026-08-18T19:33:40+08:00"
AI主题相关性: 0
AI来源权威性: 15
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 10
AI摘要: "提出基于 Q 值的变分逆强化学习方法 QVIRL，从专家演示中恢复奖励函数的后验分布，兼顾可扩展性与不确定性量化。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:25:50.841Z"
采集批次: "2026年8月18日15点52分05秒"
采集批次ID: "20260818-155205-090"
去重键: "https://arxiv.org/abs/2608.16888"
---

## Computer Science > Machine Learning

## Title:Q-based Variational Inverse Reinforcement Learning

[View PDF](https://arxiv.org/pdf/2608.16888) [HTML (experimental)](https://arxiv.org/html/2608.16888v1)

> Abstract:The development of safe and beneficial AI requires that systems can learn and act in accordance with human preferences. However, explicitly specifying these preferences by hand is often infeasible. Inverse reinforcement learning (IRL) addresses this challenge by inferring preferences, represented as reward functions, from expert behaviour. We introduce Q-based Variational IRL (QVIRL), a novel Bayesian IRL method that recovers a posterior distribution over rewards from expert demonstrations via primarily learning a variational distribution over optimal Q-values. Unlike previous approaches, QVIRL combines scalability with uncertainty quantification, important for safety-critical applications as well as active learning. We demonstrate QVIRL's strong performance in apprenticeship learning across various tasks, including gridworlds, Lunar Lander, the Highway Environment, and two ATARI games both with static expert data and with active learning. It is the first method for Bayesian IRL that demonstrates training from raw pixel observations.

| Subjects: | Machine Learning (cs.LG) |
| --- | --- |
| Cite as: | [arXiv:2608.16888](https://arxiv.org/abs/2608.16888) \[cs.LG\] |
|  | (or [arXiv:2608.16888v1](https://arxiv.org/abs/2608.16888v1) \[cs.LG\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.16888](https://doi.org/10.48550/arXiv.2608.16888) |

## Submission history

From: Ondrej Bajgar \[[view email](https://arxiv.org/show-email/45f50e30/2608.16888)\]  
**\[v1\]** Mon, 17 Aug 2026 17:59:55 UTC (625 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.16888) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))