---
格式版本: 2
标题: "Kathleen Remembers: Length-Invariant One-Shot Recall Without Attention"
原文链接: "https://arxiv.org/abs/2608.30376"
发布日期: "2026-08-31"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Mon, 31 Aug 2026 07:35:03 UTC (34 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-09-02T03:48:45+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-09-02T03:46:29+08:00"
入库时间: "2026-09-01T19:48:45.843Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=GPU&searchtype=all"
匹配关键词:
  - "GPU"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 18
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "该资料为arXiv上关于NLP注意力机制替代方案的学术论文，仅因搜索词命中GPU，正文与超节点、AI Rack等主题完全无关，属于无关内容。"
AI质检模型: "zj-deepseek-v4-flash"
AI质检时间: "2026-09-02T03:49:13+08:00"
AI主题相关性: 0
AI来源权威性: 10
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 8
AI摘要: "该论文为Kathleen递归无注意力模型增加一个“notebook”第二记忆层，采用固定键HRR关联存储，以25K参数实现长度不变的one-shot精确召回。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-01T23:06:40.152Z"
采集批次: "2026年9月1日23点56分52秒"
采集批次ID: "20260901-235652-761"
去重键: "https://arxiv.org/abs/2608.30376"
---

## Computer Science > Computation and Language

## Title:Kathleen Remembers: Length-Invariant One-Shot Recall Without Attention

Authors:[George Fountzoulas](https://arxiv.org/search/cs?searchtype=author&query=Fountzoulas,+G)

[View PDF](https://arxiv.org/pdf/2608.30376) [HTML (experimental)](https://arxiv.org/html/2608.30376v1)

> Abstract:Recurrent, attention-free sequence models share a structural weakness: a fading state cannot perform exact recall of something seen once, far in the past. We add to the Kathleen trunk a second memory layer -- a "notebook": a fixed-key holographic (HRR) associative store with a learned local write gate, a self-gating raw read, and write-triggered forgetting -- 25K parameters that attach to the logits of any trunk. (1) Mechanism: on a controlled needle-in-haystack task the notebook reaches 80-82% one-shot recall at 4x the training length, where the bare trunk scores ~4% and a parameter-matched attention head scores 100% inside its training length and 0% beyond it. Addressing is length-invariant by construction; the untrained memory alone recalls at 90% accuracy identically at 512, 2048 and 4096 bytes. Because the store is a linear superposition, two capabilities follow from arithmetic alone: selective unlearning (one subtraction erases one fact to chance, retained facts unharmed) and per-token attribution (counterfactual erasure names the source fact of every correct byte, 100% provenance). (2) Real text: on WikiText-2 bytes the notebook improves prediction of repeated rare words by +0.15-0.27 bits/byte, the gain growing with the distance between mentions and holding zero-shot at 4x training length; write-triggered forgetting eliminates memory pollution at 8x length (first-mention cost +0.33 -> -0.004). (3) Scope and scale: a parameter-matched attention head does generalize on natural-text repetition, so the notebook's claim is exact recall at O(L); on a WikiText-103 ladder (8 to 512 MB) the zero-shot repeat gain rises monotonically. All experiments are pre-registered, seeds reported, and reproducible on a single free-tier GPU.

| Comments: |  |
| --- | --- |
| Subjects: | Computation and Language (cs.CL); Machine Learning (cs.LG) |
| Cite as: | [arXiv:2608.30376](https://arxiv.org/abs/2608.30376) \[cs.CL\] |
|  | (or [arXiv:2608.30376v1](https://arxiv.org/abs/2608.30376v1) \[cs.CL\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.30376](https://doi.org/10.48550/arXiv.2608.30376) |

## Submission history

From: George Fountzoulas \[[view email](https://arxiv.org/show-email/8987d7c5/2608.30376)\]  
**\[v1\]** Mon, 31 Aug 2026 07:35:03 UTC (34 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.30376) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))