---
格式版本: 2
标题: "CHIPSMORE: Compute-in-Interconnect and -Memory Chiplets for Multi-Mode Multi-Request LLM Inference Acceleration"
原文链接: "https://arxiv.org/abs/2608.30509"
发布日期: "2026-08-31"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Mon, 31 Aug 2026 09:43:07 UTC (1,911 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-09-02T03:50:28+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-09-02T03:49:17+08:00"
入库时间: "2026-09-01T19:50:29.042Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=Scale-up&searchtype=all"
匹配关键词:
  - "Scale-up"
  - "SRAM"
  - "performance"
  - "throughput"
相关厂家:
  - "NVIDIA"
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 15
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "论文主题为LLM推理加速器芯片设计，与超节点/AI Rack/机柜级AI基础设施、高速互连、供电散热等无关。"
AI质检模型: "zj-deepseek-v4-flash"
AI质检时间: "2026-09-02T03:50:53+08:00"
AI主题相关性: 0
AI来源权威性: 10
AI新颖性: 5
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 5
AI摘要: "CHIPSMORE提出一种结合计算互连与计算内存的芯片组加速器，用于多模式、多请求的LLM推理，支持基础模式和LoRA适配，并通过可编程互连网络与层次化KV存储提升长上下文和批处理性能。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-01T23:06:22.625Z"
采集批次: "2026年9月1日23点56分52秒"
采集批次ID: "20260901-235652-761"
去重键: "https://arxiv.org/abs/2608.30509"
---

## Computer Science > Hardware Architecture

## Title:CHIPSMORE: Compute-in-Interconnect and -Memory Chiplets for Multi-Mode Multi-Request LLM Inference Acceleration

Authors:[Yue Jiet Chong](https://arxiv.org/search/cs?searchtype=author&query=Chong,+Y+J), [Yimin Wang](https://arxiv.org/search/cs?searchtype=author&query=Wang,+Y), [Zhen Wu](https://arxiv.org/search/cs?searchtype=author&query=Wu,+Z), [Zixuan Wang](https://arxiv.org/search/cs?searchtype=author&query=Wang,+Z), [Wei Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+W), [Xuanyao Fong](https://arxiv.org/search/cs?searchtype=author&query=Fong,+X)

[View PDF](https://arxiv.org/pdf/2608.30509) [HTML (experimental)](https://arxiv.org/html/2608.30509v1)

> Abstract:Large language model (LLM) inference exhibits substantial variability across adaptation modes, context lengths, and request concurrency, creating challenges for maintaining high utilization, memory efficiency, and scalable performance on compute-in-memory (CIM) accelerators. This paper presents CHIPSMORE, a multi-mode and multi-request LLM inference accelerator that integrates compute-in-interconnect and CIM to support both base-mode and low-rank adaptation (LoRA) inference under diverse workloads. CHIPSMORE employs heterogeneous processing elements consisting of resistive RAM analog compute-in-memory (RRAM-ACIM) and static RAM digital compute-in-memory (SRAM-DCIM) interconnected through a programmable Inter-PE computational network (IPCN). A composable hierarchical key-value (KV) memory scheme dynamically allocates router scratchpad, SRAM-DCIM, and embedded DRAM (eDRAM) resources according to workload requirements, enabling scalable support for long-context and batched inference. Furthermore, a non-replicated multi-request execution pipeline exploits request-level parallelism without duplicating pretrained weights, while a state-aware resource reconfiguration mechanism selectively retains runtime states and power-gates inactive resources to improve energy efficiency. Evaluation using cycle-accurate hardware-software co-simulation demonstrates that CHIPSMORE effectively sustains high throughput across varying model sizes, context lengths, and batch sizes while maintaining favorable power scaling. Compared with Nvidia H100, CHIPSMORE achieves up to $2.38\times$ higher throughput and $27\times$ higher energy efficiency on Mistral-7B inference while eliminating weight replication for multi-request serving.

| Subjects: | Hardware Architecture (cs.AR) |
| --- | --- |
| Cite as: | [arXiv:2608.30509](https://arxiv.org/abs/2608.30509) \[cs.AR\] |
|  | (or [arXiv:2608.30509v1](https://arxiv.org/abs/2608.30509v1) \[cs.AR\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.30509](https://doi.org/10.48550/arXiv.2608.30509) |

## Submission history

From: Yue Jiet Chong \[[view email](https://arxiv.org/show-email/475d410c/2608.30509)\]  
**\[v1\]** Mon, 31 Aug 2026 09:43:07 UTC (1,911 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.30509) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))