---
格式版本: 2
标题: "VestigeKV: The NoPE-MLA KV Cache Carries Its Own Eviction Signal in a Vestigial Branch"
原文链接: "https://arxiv.org/abs/2609.03949"
发布日期: "2026-09-03"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Thu, 3 Sep 2026 14:53:20 UTC (53 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-09-06T21:23:45+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-09-06T21:21:19+08:00"
入库时间: "2026-09-06T13:23:45.683Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=GPU&searchtype=all"
匹配关键词:
  - "GPU"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 10
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "该资料为arXiv论文，主题是KV Cache压缩与推理优化，不涉及超节点/AI Rack/机柜级AI基础设施、供电、液冷、互连或量产落地等关注领域。仅命中GPU关键词，与项目主题无关。"
AI质检模型: "zj-deepseek-v4-flash"
AI质检时间: "2026-09-06T21:23:56+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 5
AI摘要: "VestigeKV提出一种无需查询注意力的KV缓存压缩方法，利用NoPE MLA模型中64维解耦分支作为显著性信号，仅读取每行11%即可划分缓存并将非重要行移入GPU存档，无需训练或量化。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-06T23:44:56.623Z"
采集批次: "2026年9月6日19点27分09秒"
采集批次ID: "20260906-192709-237"
去重键: "https://arxiv.org/abs/2609.03949"
---

## Computer Science > Machine Learning

## Title:VestigeKV: The NoPE-MLA KV Cache Carries Its Own Eviction Signal in a Vestigial Branch

Authors:[WenJie Fan](https://arxiv.org/search/cs?searchtype=author&query=Fan,+W)

[View PDF](https://arxiv.org/pdf/2609.03949) [HTML (experimental)](https://arxiv.org/html/2609.03949v1)

> Abstract:The problem. A long-lived KV cache must be compressed before the queries that will read it exist; selection by observed attention (H2O, SnapKV) collapses there (0.00-0.33 needle retrieval on a NoPE MLA model), because a token's importance has not yet been observed. The method. On Kimi Linear, VestigeKV evicts by a query-independent signal the cache already carries: the 64-dimensional decoupled branch, a vestige of RoPE that NoPE training repurposes into a salience channel. Reading 11% of each row, it partitions the cache: the top-m rows stay in the attended tier; every other row moves -- exactly, never deleted -- to a GPU-resident archive reachable per step by a certified trigger. No training, no quantization, no weight or kernel change. Cost. Nothing measurable: retrieval holds at 1.00 under 8x and 0.92 under 32x from 8k to 65k context, zero gap to full-row selection. The attended tier is 0.25 KB of Kimi Linear's 8.1 KB per-token cache at 32x; the archive stays bit-exact and GPU-resident, with host offload as the VRAM-reclaiming variant. The recall tier -- the standard configuration -- holds 128x at 1.00. Kimi K3 is reported to use a NoPE Gated-MLA variant; if its cache layout matches, the method plausibly extends there -- we make no claim beyond the measured model. NoPE exclusivity. The identical operator on a RoPE MLA collapses to 0.08 (plain eviction: 0.42); query-independent salience itself exists only without rotation (top-1 targets span 2.3-6.7% of tokens vs. 10.2-46.8%), and query-universal exact merging is provably impossible under RoPE. All thresholds were frozen before data; 20 archived verdicts and 8 closed routes accompany the paper.

| Comments: |  |
| --- | --- |
| Subjects: | Machine Learning (cs.LG); Computation and Language (cs.CL) |
| MSC classes: | 68T50, 68T07 |
| ACM classes: | I.2.7; I.2.6 |
| Cite as: | [arXiv:2609.03949](https://arxiv.org/abs/2609.03949) \[cs.LG\] |
|  | (or [arXiv:2609.03949v1](https://arxiv.org/abs/2609.03949v1) \[cs.LG\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2609.03949](https://doi.org/10.48550/arXiv.2609.03949) |

## Submission history

From: Wen Jie Fan \[[view email](https://arxiv.org/show-email/6b108932/2609.03949)\]  
**\[v1\]** Thu, 3 Sep 2026 14:53:20 UTC (53 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2609.03949) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))