---
格式版本: 2
标题: "Accelerating Reinforcement Learning via MPC Solver-Gradient Guidance for Weights-varying MPC"
原文链接: "https://arxiv.org/abs/2609.01061"
发布日期: "2026-09-01"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Tue, 1 Sep 2026 10:55:18 UTC (2,508 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-09-02T18:52:47+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-09-02T18:51:39+08:00"
入库时间: "2026-09-02T10:52:47.451Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=Scale-up&searchtype=all"
匹配关键词:
  - "Scale-up"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 29
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "正文主线是面向自动驾驶赛车的MPC权重在线适配与强化学习算法，新增SG-RL及其四种PPO集成方式，并报告样本减少70.6%、回报提升至少54%等实验结果；来源为可追溯的arXiv预印本，但当前页面仅提供摘要，尚非同行评审或生产部署证据。固定知识库未显示该方法的历史重复，但未命中不能证明首次出现。全文不涉及超节点、AI机架、互连、供电、液冷或机架级RAS，也无客户、量产和部署信号，命中弱相关及学术实验/应用算法否决项。"
AI质检模型: "gpt-5.6-sol"
AI质检时间: "2026-09-02T18:54:21+08:00"
AI主题相关性: 0
AI来源权威性: 10
AI新颖性: 8
AI技术细节: 5
AI商业部署信号: 0
AI完整性: 6
AI评分提示词版本: "v17-精简生产版"
AI评分提示词SHA256: "48fb9777f386026761b4873eaff30807694fb11e9b352d7c69bf2dfde750cc7d"
AI评分知识库版本: "knowledge_base_v1-20260819+runtime.81"
AI评分知识库SHA256: "3b93d12e47749b3512f545f51c44c011bdc0931677c2cfe61e4df59a2b1a5a48"
AI评分知识库检索词: "[\"Scale-up\",\"MPC\",\"PDF\",\"arxiv.org/pdf/2609.01061\",\"HTML\",\"arxiv.org/html/2609.01061v1\",\"v1\",\"RL\",\"GB-PL\",\"SG-RL\",\"RL-based\",\"PPO\"]"
AI评分知识库命中: "[{\"id\":\"runtime-569639751a0dbe7ef3ffccc5\",\"title\":\"[2608.17503] Predict Before Replay: Joint FEC and Flight Control for Reliable Scale-Up Links\",\"sourceType\":\"ai_excellent_article\",\"time\":\"2026-08-18\",\"matchedTerms\":[\"Scale-up\",\"PDF\",\"HTML\",\"v1\",\"RL\",\"PPO\"],\"rank\":-13.013405860992304},{\"id\":\"july-correct-0111\",\"title\":\"StrataCL: Fabric-Native Communication Library for Production Supernodes\",\"sourceType\":\"labeled_article\",\"time\":\"2026-07\",\"matchedTerms\":[\"PDF\",\"HTML\",\"v1\",\"RL\"],\"rank\":-11.543771882503226},{\"id\":\"july-correct-0010\",\"title\":\"Schneider Electric and AMD release first Helios platform reference design to accelerate AI Factory deployment\",\"sourceType\":\"labeled_article\",\"time\":\"2026-07\",\"matchedTerms\":[\"PDF\",\"v1\",\"RL\",\"PPO\"],\"rank\":-8.41606444929818},{\"id\":\"july-correct-0094\",\"title\":\"NVIDIA Vera CPU: Olympus Cores Built for Maximum Single-Thread Performance in Agentic AI\",\"sourceType\":\"labeled_article\",\"time\":\"2026-07\",\"matchedTerms\":[\"Scale-up\",\"RL\",\"PPO\"],\"rank\":-7.525794020428524},{\"id\":\"july-correct-0062\",\"title\":\"Why AI Racks Need an Open Signal Conditioning Standard\",\"sourceType\":\"labeled_article\",\"time\":\"2026-07\",\"matchedTerms\":[\"Scale-up\",\"PDF\",\"v1\",\"RL\",\"PPO\"],\"rank\":-7.511302190484807}]"
AI摘要: "提出一种名为SG-RL的方法，利用MPC求解器梯度作为辅助指导，加速强化学习在权重时变MPC中的在线代价权重调整。在自动驾驶平台上，SG-RL达到PPO最优回报所需样本减少70.6%，且闭环回报比GB-PL基线至少提升54%。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-02T17:13:20.843Z"
采集批次: "2026年9月2日18点28分48秒"
采集批次ID: "20260902-182848-894"
去重键: "https://arxiv.org/abs/2609.01061"
---

## Computer Science > Robotics

## Title:Accelerating Reinforcement Learning via MPC Solver-Gradient Guidance for Weights-varying MPC

[View PDF](https://arxiv.org/pdf/2609.01061) [HTML (experimental)](https://arxiv.org/html/2609.01061v1)

> Abstract:In Model Predictive Control (MPC), cost-function weights shape closed-loop behavior, yet changing conditions often make fixed parametrizations suboptimal and motivate context-dependent online adaptation. Learning such policies is difficult because behavior depends implicitly on numerical MPC solutions, producing nonlinear, potentially nonsmooth, long-horizon dependencies on policy parameters. This creates a bias-variance tradeoff: Reinforcement Learning (RL) optimizes realized closed-loop return from environment samples but is sample-inefficient, whereas Gradient-Based Policy Learning (GB-PL) uses low-variance solver gradients from differentiable MPC to optimize surrogate losses on predicted trajectories but can be biased under model mismatch. We propose Solver-Gradient Guided Reinforcement Learning (SG-RL), a solver-sensitivity augmentation for RL-based online MPC cost-weight adaptation. SG-RL keeps sampled closed-loop return as the objective and uses bounded solver-derived gradients as auxiliary guidance to improve stability and sample efficiency. We instantiate SG-RL in Proximal Policy Optimization (PPO) with four modular algorithms that inject solver-gradient guidance into actor-update scaling, policy loss, advantage estimation, and value-function learning. On two full-scale autonomous racing platforms with intentional model mismatch, SG-RL reaches PPO's best closed-loop return with up to 70.6% fewer samples, outperforms GB-PL baselines by at least 54% in closed-loop return, and generalizes zero-shot to unseen environments.

| Comments: |  |
| --- | --- |
| Subjects: | Robotics (cs.RO); Machine Learning (cs.LG); Systems and Control (eess.SY) |
| Cite as: | [arXiv:2609.01061](https://arxiv.org/abs/2609.01061) \[cs.RO\] |
|  | (or [arXiv:2609.01061v1](https://arxiv.org/abs/2609.01061v1) \[cs.RO\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2609.01061](https://doi.org/10.48550/arXiv.2609.01061) |

## Submission history

From: Baha Zarrouki \[[view email](https://arxiv.org/show-email/e0b80afc/2609.01061)\]  
**\[v1\]** Tue, 1 Sep 2026 10:55:18 UTC (2,508 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2609.01061) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))