---
格式版本: 2
标题: "SPADE: Self-Play in Adaptive Synthetic Executable Environments"
原文链接: "https://arxiv.org/abs/2608.19197"
发布日期: "2026-08-19"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Wed, 19 Aug 2026 17:58:56 UTC (2,026 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T15:09:05+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T15:03:44+08:00"
入库时间: "2026-08-20T07:09:05.178Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=OpenAI&searchtype=all"
匹配关键词:
  - "AI"
相关厂家:
  - "OpenAI"
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 15
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "该arXiv论文主题为SPADE自博弈强化学习框架，涉及语言智能体环境生成，与超节点、AI Rack、机柜级AI基础设施、供电散热互连等完全无关。"
AI质检模型: "tx-deepseek-v4-flash"
AI质检时间: "2026-08-20T15:09:42+08:00"
AI主题相关性: 0
AI来源权威性: 10
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 5
AI摘要: "SPADE提出自博弈强化学习框架，让同一LLM交替扮演环境设计者与推理智能体，在可执行代码环境中持续生成适配模型能力边界的新任务。在30B模型上，该方法相比固定环境基线在八项推理基准平均提升5.3分，工具使用场景提升5.7和13.9分。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:18:29.403Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.19197"
---

## Computer Science > Computation and Language

## Title:SPADE: Self-Play in Adaptive Synthetic Executable Environments

Authors:[Bo Liu](https://arxiv.org/search/cs?searchtype=author&query=Liu,+B), [Simon Yu](https://arxiv.org/search/cs?searchtype=author&query=Yu,+S), [Yiding Jiang](https://arxiv.org/search/cs?searchtype=author&query=Jiang,+Y), [Ao Qu](https://arxiv.org/search/cs?searchtype=author&query=Qu,+A), [Andrew Zhao](https://arxiv.org/search/cs?searchtype=author&query=Zhao,+A), [Zichen Liu](https://arxiv.org/search/cs?searchtype=author&query=Liu,+Z), [Junsu Kim](https://arxiv.org/search/cs?searchtype=author&query=Kim,+J), [Zijian Zhou](https://arxiv.org/search/cs?searchtype=author&query=Zhou,+Z), [Seungone Kim](https://arxiv.org/search/cs?searchtype=author&query=Kim,+S), [Tongzheng Ren](https://arxiv.org/search/cs?searchtype=author&query=Ren,+T), [Mickel Liu](https://arxiv.org/search/cs?searchtype=author&query=Liu,+M), [Hanfei Yu](https://arxiv.org/search/cs?searchtype=author&query=Yu,+H), [Zhaorun Chen](https://arxiv.org/search/cs?searchtype=author&query=Chen,+Z), [Weiyan Shi](https://arxiv.org/search/cs?searchtype=author&query=Shi,+W), [Paul Pu Liang](https://arxiv.org/search/cs?searchtype=author&query=Liang,+P+P), [Luke Zettlemoyer](https://arxiv.org/search/cs?searchtype=author&query=Zettlemoyer,+L), [Yejin Choi](https://arxiv.org/search/cs?searchtype=author&query=Choi,+Y), [Natasha Jaques](https://arxiv.org/search/cs?searchtype=author&query=Jaques,+N)

[View PDF](https://arxiv.org/pdf/2608.19197) [HTML (experimental)](https://arxiv.org/html/2608.19197v1)

> Abstract:Continuous self-improvement requires an ever-expanding pool of self-generated, diverse, adaptive goals. For language agents, existing training environment pools (hand-curated, statically synthesized, or frozen-verifier) keep the goal distribution fixed as the learner scales. We introduce SPADE (Self-Play in Adaptive Synthetic Executable Environments), a self-play RL framework in which a single LLM plays two roles: an Environment Designer that writes complete, long-horizon training environments as executable code with an OpenAI Gym-style reset()/step() interface, and a Reasoning Agent that learns to act in them. Each is a stateful, multi-turn environment (state transitions, reward functions, and verification code), so one interface spans reasoning problems and multi-step agentic tool use. The Reasoning Agent's regret is estimated using the gap between its reward with and without privileged hints; in optimizing this regret signal the Environment Designer learns to target environments at the edge of the agent's capabilities while keeping them feasible. Through extensive experimentation, we find several components critical to success: grounding the Environment Designer on documents sampled from a large pretraining corpus, and giving it an accumulated environment memory. Scaling to 30B-parameter models, SPADE improves over the strongest fixed-environment baseline by +5.3 on average across eight held-out math, science, code, and reasoning benchmarks, and lifts the tool-use setting by +5.7 on BFCL-v4 multi-turn and +13.9 on ACEBench-Agent; on the games setting, the margin over the strongest baseline grows with model scale. By making environment design itself a learnable component, SPADE takes a concrete step toward open-ended self-improvement.

| Comments: |  |
| --- | --- |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI) |
| Cite as: | [arXiv:2608.19197](https://arxiv.org/abs/2608.19197) \[cs.CL\] |
|  | (or [arXiv:2608.19197v1](https://arxiv.org/abs/2608.19197v1) \[cs.CL\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.19197](https://doi.org/10.48550/arXiv.2608.19197) |

## Submission history

From: Bo Liu \[[view email](https://arxiv.org/show-email/77646b3c/2608.19197)\]  
**\[v1\]** Wed, 19 Aug 2026 17:58:56 UTC (2,026 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.19197) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))