---
格式版本: 2
标题: "MoNe: Modular Neural Memory for Efficient Long Context Inference"
原文链接: "https://arxiv.org/abs/2608.17616"
发布日期: "2026-08-18"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Tue, 18 Aug 2026 10:28:23 UTC (1,441 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T15:57:39+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T15:54:04+08:00"
入库时间: "2026-08-20T07:57:39.739Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=inference%20networking&searchtype=all"
匹配关键词:
  - "GPU"
  - "performance"
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 6
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "该论文讨论长上下文推理的模块化神经记忆机制，属于AI算法模型研究，与超节点/AI Rack机柜级基础设施、高速互连、供电散热、量产落地等主题完全无关，不构成有效资料。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-20T16:03:28+08:00"
AI主题相关性: 0
AI来源权威性: 4
AI新颖性: 2
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 0
AI摘要: "MoNe 提出一种模块化神经记忆机制，可附加到任意冻结的预训练 Transformer 上，通过测试时学习实现无需重训练的长上下文推理。在 128K token 长度下，相比上下文学习，其计算和峰值 GPU 内存均降低约 80%。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:21:08.437Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.17616"
---

## Computer Science > Artificial Intelligence

## Title:MoNe: Modular Neural Memory for Efficient Long Context Inference

[View PDF](https://arxiv.org/pdf/2608.17616) [HTML (experimental)](https://arxiv.org/html/2608.17616v1)

> Abstract:We present MoNe, a lightweight modular neural memory that attaches to any frozen pretrained Transformer to enable long-context inference without retraining. MoNe reads context in fixed-size segments via test-time learning of fast-weight neural memory networks with layer-localized gradient updates; at inference, the memory generates keys and values from the query tokens alone, with no context tokens re-read. This two-phase design decouples inference cost from context length, achieving $O(N)$ preprocessing and $O(1)$ query cost with peak GPU memory that does not grow with $N$. At 128K tokens, MoNe reduces both compute and peak GPU memory by approximately 80% compared to ICL with only 6.4% parameter overhead. MoNe generalizes to context lengths far beyond the backbone's native window, achieving strong performance on needle-in-a-haystack and word extraction benchmarks from RULER, where ICL degrades sharply.

| Subjects: | Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG) |
| --- | --- |
| Cite as: | [arXiv:2608.17616](https://arxiv.org/abs/2608.17616) \[cs.AI\] |
|  | (or [arXiv:2608.17616v1](https://arxiv.org/abs/2608.17616v1) \[cs.AI\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.17616](https://doi.org/10.48550/arXiv.2608.17616) |

## Submission history

From: Wonguk Cho \[[view email](https://arxiv.org/show-email/f311fb6d/2608.17616)\]  
**\[v1\]** Tue, 18 Aug 2026 10:28:23 UTC (1,441 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.17616) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))