---
格式版本: 2
标题: "rl-triton: High-Performance Triton GPU Kernels for Reinforcement Learning Credit Assignment"
原文链接: "https://arxiv.org/abs/2608.17641"
发布日期: "2026-08-18"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "llm:local:strict_original_body"
发布时间证据: "**[\\[v1\\]]( Tue, 18 Aug 2026 10:58:20 UTC (89 KB)"
发布时间校准原因: "arXiv 页面明确标注 v1 提交时间为 2026-08-18，这是文章的首次发布时间；v2 为后续修订日期，不应作为首发时间。"
发布时间校准置信度: "1"
发布时间候选数量: 23
发布时间严格候选数量: 7
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T14:32:20+08:00"
发布时间仲裁状态: "confirmed"
发布时间仲裁尝试次数: 1
发布时间仲裁耗时毫秒: 9392
发现时间: "2026-08-20T14:28:25+08:00"
入库时间: "2026-08-20T06:32:29.874Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=HBM&searchtype=all"
匹配关键词:
  - "HBM"
  - "GPU"
  - "performance"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 18
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "论文主题为强化学习的Triton GPU内核优化，与超节点/AI Rack/机柜级AI基础设施无关，仅提及HBM作为存储层级，且无架构、量产、部署等有效信号。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-20T14:32:46+08:00"
AI主题相关性: 2
AI来源权威性: 8
AI新颖性: 2
AI技术细节: 2
AI商业部署信号: 0
AI完整性: 4
AI摘要: "Lars Simon Zehnder 发布了开源库 rl-triton，用 Triton 实现高性能 GPU 核，将 GAE、V-Trace、Retrace 等 7 种强化学习信用分配算法统一为一阶线性递推的关联扫描框架。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:21:36.956Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.17641"
---

## Computer Science > Machine Learning

## Title:rl-triton: High-Performance Triton GPU Kernels for Reinforcement Learning Credit Assignment

Authors:[Lars Simon Zehnder](https://arxiv.org/search/cs?searchtype=author&query=Zehnder,+L+S)

[View PDF](https://arxiv.org/pdf/2608.17641) [HTML (experimental)](https://arxiv.org/html/2608.17641v2)

> Abstract:We present rl-triton, an open-source library of high-performance GPU kernels for reinforcement learning credit assignment, implemented in Triton. The core contribution is a unified associative scan framework that recasts seven distinct RL estimation algorithms - Generalized Advantage Estimation (GAE), V-Trace, Retrace($\lambda$), TD($\lambda$) returns, discounted returns, eligibility traces, and episodic prefix sums - as instances of a single first-order linear recurrence solved in $O(\log T)$ parallel steps. All algorithms share the same associative scan operator, with algorithm-specific fused Triton kernels constructing their recurrence coefficients on-chip. We verify the associative operator algebraically and define the treatment of terminated and truncated episodes explicitly. Benchmarks show a 1.6-5.70 $\times$ full-call speedup over a vectorized torch-compile baseline in the massively parallel simulation regime (thousands of environments, short rollouts). The reported range covers all seven algorithms on both GPUs, both with and without per-step truncation handling. For most algorithms, speedups increase at longer sequence lengths, as the baseline requires more scan stages as $\log T$ grows, each adding an intermediate HBM round-trip. The library is available at [this https URL](https://github.com/simonsays1980/rl-triton).

| Comments: |  |
| --- | --- |
| Subjects: | Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF) |
| ACM classes: | I.2.6; D.1.3 |
| Cite as: | [arXiv:2608.17641](https://arxiv.org/abs/2608.17641) \[cs.LG\] |
|  | (or [arXiv:2608.17641v2](https://arxiv.org/abs/2608.17641v2) \[cs.LG\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.17641](https://doi.org/10.48550/arXiv.2608.17641) |

## Submission history

From: Lars Simon Zehnder \[[view email](https://arxiv.org/show-email/1ac3c4fb/2608.17641)\]  
**[\[v1\]](https://arxiv.org/abs/2608.17641v1)** Tue, 18 Aug 2026 10:58:20 UTC (89 KB)  
**\[v2\]** Wed, 19 Aug 2026 11:29:40 UTC (89 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.17641) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))