---
格式版本: 2
标题: "FlashAttention for Scalable Vector Architectures"
原文链接: "https://arxiv.org/abs/2608.18656"
发布日期: "2026-08-19"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Wed, 19 Aug 2026 08:02:17 UTC (212 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T15:41:32+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T15:39:49+08:00"
入库时间: "2026-08-20T07:41:33.006Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=bandwidth&searchtype=all"
匹配关键词:
  - "bandwidth"
  - "performance"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 28
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "论文研究FlashAttention在向量架构上的优化，涉及内存带宽和CPU推理，与超节点/AI Rack/机柜级AI基础设施、供电散热互连或量产落地等主题完全无关。"
AI质检模型: "tx-deepseek-v4-flash"
AI质检时间: "2026-08-20T15:46:52+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 10
AI技术细节: 5
AI商业部署信号: 0
AI完整性: 8
AI摘要: "提出FlashAttention-V，一种面向可扩展向量架构的分块FlashAttention，通过跨注意力头并行与打包提升向量寄存器和内存局部性，并集成到llama.cpp的ggml中。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:18:36.716Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.18656"
---

## Computer Science > Machine Learning

## Title:FlashAttention for Scalable Vector Architectures

[View PDF](https://arxiv.org/pdf/2608.18656) [HTML (experimental)](https://arxiv.org/html/2608.18656v1)

> Abstract:Inference with transformer models on CPUs is increasingly important, especially for Small Language Models (SLMs), where vector architectures are emerging as a promising execution substrate. The attention module is a major bottleneck due to high memory bandwidth requirements; FlashAttention mitigates this by fusing operations to improve data locality and reduce intermediate memory traffic. In this paper, we present FlashAttention-V, a blocked FlashAttention for scalable vector architectures that adapts efficiently from short to very long vectors by exploiting parallelism across attention heads, inter-head packing to enable efficient utilization of vector lengths beyond the head dimension, and improving vector register utilization and memory access locality. We integrate FlashAttention-V into ggml within [this http URL](http://llama.cpp/) and evaluate it on TinyLlama, Llama 3.2, Qwen2.5, and Pythia-410M using gem5 and a Banana Pi BPI-F3. On the Banana Pi BPI-F3, we confirm that loop reordering and loop unrolling across attention heads are effective optimization principles, scaling performance gains with larger models and most pronounced with short contexts and during decoding. Simulation-based analysis shows that FlashAttention-V achieves 22x-42x speedup over scalar FlashAttention at 512-bit VL in prefill, with an additional 2x-2.5x gain scaling to 64 lanes and 4096-bit VL. During decode, FlashAttention-V achieves 8x-11x speedup using 512-bit vector lengths over scalar FlashAttention, with performance showing diminishing sensitivity to vector width and lane count due to single-token, memory-bound execution. We further identify structural bottlenecks in Q8\_0 quantized linear layers that limit arithmetic amortization under long-vector execution, consistent across RVV and Arm SVE, indicating that current quantization formats pose a fundamental challenge to long-vector scalability.

| Subjects: | Machine Learning (cs.LG); Performance (cs.PF) |
| --- | --- |
| Cite as: | [arXiv:2608.18656](https://arxiv.org/abs/2608.18656) \[cs.LG\] |
|  | (or [arXiv:2608.18656v1](https://arxiv.org/abs/2608.18656v1) \[cs.LG\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.18656](https://doi.org/10.48550/arXiv.2608.18656) |

## Submission history

From: Sonia Rani Gupta \[[view email](https://arxiv.org/show-email/da6ca9d9/2608.18656)\]  
**\[v1\]** Wed, 19 Aug 2026 08:02:17 UTC (212 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.18656) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))