---
格式版本: 2
标题: "HeadWiseKV: Budgeted Per-Head Cache Residency for Hybrid Long-Context Language Models"
原文链接: "https://arxiv.org/abs/2609.02029"
发布日期: "2026-09-02"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Wed, 2 Sep 2026 02:59:11 UTC (199 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-09-04T01:34:54+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-09-04T01:32:14+08:00"
入库时间: "2026-09-03T17:34:54.430Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=GPU&searchtype=all"
匹配关键词:
  - "GPU"
  - "deployment"
  - "throughput"
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 24
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "该论文聚焦长上下文语言模型的KV缓存压缩算法，属于软件推理优化，未涉及超节点/AI Rack/机柜级硬件架构、供电散热互连或量产落地，与项目主题无关。"
AI质检模型: "tx-deepseek-v4-flash"
AI质检时间: "2026-09-04T01:36:26+08:00"
AI主题相关性: 2
AI来源权威性: 8
AI新颖性: 4
AI技术细节: 4
AI商业部署信号: 0
AI完整性: 6
AI摘要: "HeadWiseKV 提出一种免训练框架，在给定 KV 缓存总预算下压缩混合长上下文语言模型的全局注意力层缓存，并按物理注意力头分配静态多级历史窗口。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-04T00:18:02.365Z"
采集批次: "2026年9月3日22点43分34秒"
采集批次ID: "20260903-224334-406"
去重键: "https://arxiv.org/abs/2609.02029"
---

## Computer Science > Artificial Intelligence

## Title:HeadWiseKV: Budgeted Per-Head Cache Residency for Hybrid Long-Context Language Models

Authors:[Renjie Xie](https://arxiv.org/search/cs?searchtype=author&query=Xie,+R), [Juncheng Yang](https://arxiv.org/search/cs?searchtype=author&query=Yang,+J), [Aoting Hu](https://arxiv.org/search/cs?searchtype=author&query=Hu,+A), [Mingxi Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+M), [Liyao Wu](https://arxiv.org/search/cs?searchtype=author&query=Wu,+L), [Zheheng Hong](https://arxiv.org/search/cs?searchtype=author&query=Hong,+Z), [Wei Xu](https://arxiv.org/search/cs?searchtype=author&query=Xu,+W)

[View PDF](https://arxiv.org/pdf/2609.02029) [HTML (experimental)](https://arxiv.org/html/2609.02029v1)

> Abstract:Long-context inference retains a growing key--value (KV) cache during decoding, which consumes substantial GPU memory and can reduce generation throughput. This bottleneck remains in hybrid language models because their residual global-attention layers can dominate context-dependent cache demand. We study how to allocate this state under an aggregate KV-residency budget. We introduce HeadWiseKV, a training-free framework that compresses the residual global KV caches of hybrid language models while preserving their native local, recurrent, and linear paths. It assigns each physical KV head a static, multilevel history window, making cache demand predictable before serving. We formulate this allocation as a restricted operational rate--distortion problem and propose SeqCalib as the core policy-generation algorithm in HeadWiseKV. SeqCalib processes layers in execution order and conditions each decision on the lower-layer policy used at deployment, thereby accounting for interactions across depth. A grouped-cache runtime materializes the selected policy as actual per-head KV residency rather than a mask over a full cache. We evaluate downstream quality across four hybrid long-context models and study physical residency and serving behavior on Qwen3.6-27B. HeadWiseKV retains near-Full-KV RULER and LoCoMo quality across the evaluated models. In the fixed-model systems study, it reduces sampled peak device memory by 8.59\\% at a 112K context length and extends the largest verified successful context from 114K to 161K.

| Comments: |  |
| --- | --- |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | [arXiv:2609.02029](https://arxiv.org/abs/2609.02029) \[cs.AI\] |
|  | (or [arXiv:2609.02029v1](https://arxiv.org/abs/2609.02029v1) \[cs.AI\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2609.02029](https://doi.org/10.48550/arXiv.2609.02029) |

## Submission history

From: Renjie Xie \[[view email](https://arxiv.org/show-email/2bb2de6c/2609.02029)\]  
**\[v1\]** Wed, 2 Sep 2026 02:59:11 UTC (199 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2609.02029) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))