---
格式版本: 2
标题: "Task Specialization Fine-Tuning for Contextual Reinforcement Learning"
原文链接: "https://arxiv.org/abs/2608.17180"
发布日期: "2026-08-17"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Mon, 17 Aug 2026 22:42:01 UTC (1,100 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T14:43:51+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T14:38:42+08:00"
入库时间: "2026-08-20T06:43:51.156Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=Oracle&searchtype=all"
匹配关键词:
  - "performance"
  - "AI"
相关厂家:
  - "Oracle"
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 8
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "arXiv论文主题为上下文强化学习的任务微调，与超节点/AI Rack/机柜级AI基础设施完全无关，未涉及相关技术、商业或部署内容。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-20T14:47:18+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 3
AI摘要: "该论文提出任务特化微调（TSFT）框架，在上下文强化学习中先预训练单一策略，再用整数线性规划求解预算分配，微调出多个任务特化策略。实验表明，该方法在组合优化、连续控制和LLM微调等任务上显著提升任务覆盖率，接近oracle性能。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:25:48.717Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.17180"
---

## Computer Science > Machine Learning

## Title:Task Specialization Fine-Tuning for Contextual Reinforcement Learning

Authors:[Jianan Zhou](https://arxiv.org/search/cs?searchtype=author&query=Zhou,+J), [Jung-Hoon Cho](https://arxiv.org/search/cs?searchtype=author&query=Cho,+J), [Tianyue Zhou](https://arxiv.org/search/cs?searchtype=author&query=Zhou,+T), [Han Zheng](https://arxiv.org/search/cs?searchtype=author&query=Zheng,+H), [Jie Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+J), [Roy Dong](https://arxiv.org/search/cs?searchtype=author&query=Dong,+R), [Yining Ma](https://arxiv.org/search/cs?searchtype=author&query=Ma,+Y), [Cathy Wu](https://arxiv.org/search/cs?searchtype=author&query=Wu,+C)

[View PDF](https://arxiv.org/pdf/2608.17180) [HTML (experimental)](https://arxiv.org/html/2608.17180v1)

> Abstract:Contextual Reinforcement Learning (CRL) seeks to generalize classical RL by maximizing task coverage across a context space of related tasks. While prior works often train from scratch and rely on either multi-task learning for a single policy or strategically training multiple policies, we advocate for a unified alternative: pretraining a single policy with good initial performance, followed by fine-tuning multiple policies for task specialization. This new paradigm, however, introduces unique challenges, such as heterogeneous marginal returns and sample inefficiency. This raises a critical research question: given a pretrained policy and a constrained budget, how much fine-tuning should each task region receive to enable sample-efficient CRL? To this end, we propose Task Specialization Fine-Tuning (TSFT), an online framework that predicts fine-tuning performance with a simple parametric model and exactly solves the resulting discrete budget allocation problem via integer linear programming. Extensive experiments across diverse decision domains, including combinatorial optimization, continuous control, and LLM fine-tuning, demonstrate that TSFT significantly outperforms baselines in task coverage and approaches oracle performance. Our work charts a new direction for model-based CRL, aligning with the modern pretrain-finetune era.

| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| --- | --- |
| Cite as: | [arXiv:2608.17180](https://arxiv.org/abs/2608.17180) \[cs.LG\] |
|  | (or [arXiv:2608.17180v1](https://arxiv.org/abs/2608.17180v1) \[cs.LG\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.17180](https://doi.org/10.48550/arXiv.2608.17180) |

## Submission history

From: Jianan Zhou \[[view email](https://arxiv.org/show-email/7035e306/2608.17180)\]  
**\[v1\]** Mon, 17 Aug 2026 22:42:01 UTC (1,100 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.17180) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))