---
格式版本: 2
标题: "Redistribution-based Cost Inference Improves Sparse Safe Offline RL"
原文链接: "https://arxiv.org/abs/2608.12306"
发布日期: "2026-08-12"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Wed, 12 Aug 2026 17:53:15 UTC (7,546 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-13T18:28:22+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-13T18:24:32+08:00"
入库时间: "2026-08-13T10:28:22.580Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=AI&searchtype=all"
匹配关键词:
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 0
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "内容为安全离线强化学习研究，与超节点/AI Rack/机柜级AI基础设施完全无关。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-13T18:28:28+08:00"
AI主题相关性: 0
AI来源权威性: 0
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 0
AI摘要: "研究团队提出基于重分配的成本推断框架（RCI），用于解决安全离线强化学习中仅有轨迹级停止反馈、缺乏逐帧成本标注的问题；通过回报分解将稀疏停止反馈转为稠密每步成本，再训练约束离线策略。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:40:06.382Z"
采集批次: "2026年8月13日18点24分27秒"
采集批次ID: "20260813-182427-1564e572"
去重键: "https://arxiv.org/abs/2608.12306"
---

## Computer Science > Machine Learning

## Title:Redistribution-based Cost Inference Improves Sparse Safe Offline RL

Authors:[Ebenezer Gelo](https://arxiv.org/search/cs?searchtype=author&query=Gelo,+E) (1), [Geraud Nangue Tasse](https://arxiv.org/search/cs?searchtype=author&query=Tasse,+G+N) (1), [Steven James](https://arxiv.org/search/cs?searchtype=author&query=James,+S) (1), [Benjamin Rosman](https://arxiv.org/search/cs?searchtype=author&query=Rosman,+B) (1) ((1) University of the Witwatersrand)

[View PDF](https://arxiv.org/pdf/2608.12306) [HTML (experimental)](https://arxiv.org/html/2608.12306v1)

> Abstract:Safe offline RL typically assumes access to dense per-step cost annotations, but in practice supervisors provide only trajectory-level stop-feedback: a binary signal at the first unsafe transition, with no per-step attribution. We frame this as a temporal credit assignment problem and propose the Redistribution-based Cost Inference (RCI) framework, which converts sparse stop-feedback into dense per-step costs via return decomposition, then trains a constrained offline policy on the augmented dataset. We show that return-equivalent redistribution preserves the feasible policy set and the optimal Lagrangian in a CMDP, establishing that the transformation is lossless in theory while yielding better-conditioned cost critic learning in practice. Experiments on highway driving and robotic manipulation demonstrate substantially lower violation rates than sparse and classifier-based baselines, with robustness to heterogeneous dataset compositions and label noise.

| Comments: |  |
| --- | --- |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | [arXiv:2608.12306](https://arxiv.org/abs/2608.12306) \[cs.LG\] |
|  | (or [arXiv:2608.12306v1](https://arxiv.org/abs/2608.12306v1) \[cs.LG\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.12306](https://doi.org/10.48550/arXiv.2608.12306) |

## Submission history

From: Ebenezer Gelo \[[view email](https://arxiv.org/show-email/dff6eeb0/2608.12306)\]  
**\[v1\]** Wed, 12 Aug 2026 17:53:15 UTC (7,546 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.12306) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))