---
格式版本: 2
标题: "Compress and Forget: bitsandbytes Quantization Amplifies Proactive Interference in LLMs"
原文链接: "https://arxiv.org/abs/2608.18578"
发布日期: "2026-08-19"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Wed, 19 Aug 2026 06:17:13 UTC (347 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T15:24:18+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T15:18:01+08:00"
入库时间: "2026-08-20T07:24:18.839Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=deployment&searchtype=all"
匹配关键词:
  - "deployment"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 10
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "该资料为arXiv量化论文，研究LLM量化干扰，与超节点/AI Rack/机柜级AI基础设施完全无关，命中词为搜索入口，无项目相关技术或商业内容。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-20T15:28:47+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 5
AI摘要: "该研究评估bitsandbytes量化对LLM前摄干扰的影响，发现INT4量化在低精度下显著降低三个指令微调模型高干扰检索准确率，例如Qwen2.5-7B从81.0%降至68.3%，INT8在两个模型中也有较小损失。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:18:25.551Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.18578"
---

## Computer Science > Computation and Language

## Title:Compress and Forget: bitsandbytes Quantization Amplifies Proactive Interference in LLMs

Authors:[Shayan Shahrabi-Farahani](https://arxiv.org/search/cs?searchtype=author&query=Shahrabi-Farahani,+S) (1), [Dara Rahmati](https://arxiv.org/search/cs?searchtype=author&query=Rahmati,+D) (1) ((1) Shahid Beheshti University, Tehran, Iran)

[View PDF](https://arxiv.org/pdf/2608.18578) [HTML (experimental)](https://arxiv.org/html/2608.18578v1)

> Abstract:Proactive interference (PI) is a documented failure mode in large language models in which retrieval of a repeatedly overwritten value degrades as prior overwrites accumulate, mirroring a classical phenomenon in human working memory. Post-training quantization (PTQ) is now the default deployment path for open-weight models, yet its effect on this failure mode has not been tested. We evaluate three precision levels (FP16, INT8, INT4/NF4, via bitsandbytes) across three architecturally distinct instruction-tuned models (Qwen2.5-7B-Instruct, Mistral-7B-Instruct-v0.3, Phi-3.5-mini-instruct), holding the retrieval task fixed. INT4 quantization significantly reduces accuracy under high interference in every model (e.g., from 81.0% to 68.3% for Qwen), confirmed by paired McNemar's tests ($p \le 2.6 \times 10^{-6}$) and a mixed-effects regression spanning all interference levels; INT8, often assumed safe, also carries a smaller but real penalty in two of three models. The effect is specific to semantically similar (word-type) distractors and reverses sign under a numeric control condition, and is mechanistically linked to a rise in same-key intrusion errors under INT4 (from 21.5% to 24.6% of trials, $p = 4.8 \times 10^{-7}$). A follow-up ablation shows the effect originates in the quantized transformer backbone rather than the output projection layer. These results suggest that bitsandbytes 4-bit quantization can impose an additional cost on applications relying on long, updatable, semantically dense contexts, even when aggregate benchmark accuracy appears largely unaffected. We release our code and tokenizer-verified vocabulary construction method at [this https URL](https://github.com/ShayanShahrabi/compress-and-forget)

| Comments: |  |
| --- | --- |
| Subjects: | Computation and Language (cs.CL); Machine Learning (cs.LG) |
| ACM classes: | I.2.7; I.2.6 |
| Cite as: | [arXiv:2608.18578](https://arxiv.org/abs/2608.18578) \[cs.CL\] |
|  | (or [arXiv:2608.18578v1](https://arxiv.org/abs/2608.18578v1) \[cs.CL\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.18578](https://doi.org/10.48550/arXiv.2608.18578) |

## Submission history

From: Shayan Shahrabi-Farahani \[[view email](https://arxiv.org/show-email/90ba4bbc/2608.18578)\]  
**\[v1\]** Wed, 19 Aug 2026 06:17:13 UTC (347 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.18578) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))