---
格式版本: 2
标题: "Adaptive KV Retention for LLM Agents at Human-Approval Timescales"
原文链接: "https://arxiv.org/abs/2608.30830"
发布日期: "2026-08-31"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Mon, 31 Aug 2026 14:05:52 UTC (82 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-09-02T03:47:55+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-09-02T03:46:29+08:00"
入库时间: "2026-09-01T19:47:55.233Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=GPU&searchtype=all"
匹配关键词:
  - "GPU"
  - "performance"
  - "latency"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 23
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "论文主题为LLM KV缓存调度，虽涉及GPU但属于操作系统层面，与超节点/AI Rack/机柜级基础设施无关。"
AI质检模型: "tx-deepseek-v4-flash"
AI质检时间: "2026-09-02T03:48:50+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 5
AI技术细节: 5
AI商业部署信号: 0
AI完整性: 8
AI摘要: "针对LLM智能体在等待人工审批时可能暂停数分钟至数小时的场景，研究提出一种分层KV缓存保留控制器，依据GPU机会成本在保留与重建之间权衡。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-01T23:06:36.045Z"
采集批次: "2026年9月1日23点56分52秒"
采集批次ID: "20260901-235652-761"
去重键: "https://arxiv.org/abs/2608.30830"
---

## Computer Science > Operating Systems

## Title:Adaptive KV Retention for LLM Agents at Human-Approval Timescales

Authors:[Minseo Choi](https://arxiv.org/search/cs?searchtype=author&query=Choi,+M), [Ananya Joshi](https://arxiv.org/search/cs?searchtype=author&query=Joshi,+A)

[View PDF](https://arxiv.org/pdf/2608.30830) [HTML (experimental)](https://arxiv.org/html/2608.30830v1)

> Abstract:Unlike the seconds-scale tool-call pauses targeted by prior agent-serving systems, agentic LLM requests can be suspended for minutes or hours while waiting for human approval. We study how suspension and resumption affect GPU serving performance and develop a retention policy that balances active-serving capacity against future recomputation under uncertain approval waits. The central tension is severe because retaining suspended KV preserves fast resume but can consume enough GPU capacity to reduce active-serving goodput by 41%, while evicting it avoids that residency cost at the expense of nearly $10\times$ higher resume latency when the request returns. We develop a tiered retention controller around GPU opportunity cost, which expresses the serving capacity consumed by preserving or reconstructing a suspended request's KV state in a common GPU-time cost. Within host memory, the controller selects between indefinite retention and load-indexed expiration using calibration wait samples, without requiring per-request wait prediction. On human-scale approval workloads, our controller improves active-request goodput by 23-51% over the vLLM baselines, 22-29% over MORI, and 41-52% over Continuum.

| Subjects: | Operating Systems (cs.OS) |
| --- | --- |
| Cite as: | [arXiv:2608.30830](https://arxiv.org/abs/2608.30830) \[cs.OS\] |
|  | (or [arXiv:2608.30830v1](https://arxiv.org/abs/2608.30830v1) \[cs.OS\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.30830](https://doi.org/10.48550/arXiv.2608.30830) |

## Submission history

From: Minseo Choi \[[view email](https://arxiv.org/show-email/650551b6/2608.30830)\]  
**\[v1\]** Mon, 31 Aug 2026 14:05:52 UTC (82 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.30830) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))