---
格式版本: 2
标题: "TileMix: Tile-Centric Mixed-Precision Attention for LLM Inference Acceleration"
原文链接: "https://arxiv.org/abs/2608.17336"
发布日期: "2026-08-18"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Tue, 18 Aug 2026 03:53:02 UTC (490 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T15:46:27+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T15:43:02+08:00"
入库时间: "2026-08-20T07:46:27.423Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=throughput&searchtype=all"
匹配关键词:
  - "throughput"
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 12
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "内容为LLM推理加速的算法论文，仅命中throughput关键词，不涉及超节点、AI Rack、机柜级系统、供电散热互连等任何项目主题，属明显无关。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-20T15:52:17+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 2
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 5
AI摘要: "TileMix 提出了一种以 tile 为中心的混合精度注意力内核，将 LLM 推理中的数值精度作为可执行的空间路由决策，对硬件对齐的分数 tile 分别采用 FP16 或 INT8 计算。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:22:27.706Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.17336"
---

## Computer Science > Artificial Intelligence

## Title:TileMix: Tile-Centric Mixed-Precision Attention for LLM Inference Acceleration

Authors:[Hanzhi Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+H), [Qiao Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+Q), [Qinglei Cao](https://arxiv.org/search/cs?searchtype=author&query=Cao,+Q), [Heng Fan](https://arxiv.org/search/cs?searchtype=author&query=Fan,+H), [Yan Huang](https://arxiv.org/search/cs?searchtype=author&query=Huang,+Y), [Kewei Sha](https://arxiv.org/search/cs?searchtype=author&query=Sha,+K), [Yunhe Feng](https://arxiv.org/search/cs?searchtype=author&query=Feng,+Y)

[View PDF](https://arxiv.org/pdf/2608.17336) [HTML (experimental)](https://arxiv.org/html/2608.17336v1)

> Abstract:Long-context prefill in large language models (LLMs) incurs substantial computation and memory traffic because dense self-attention computes quadratic query-key scores. Existing methods either use a uniform low-precision path or select token interactions, leaving spatial precision routing over hardware-aligned score tiles outside fused dense attention. We introduce TileMix, a tile-centric precision-routing kernel that makes numerical precision an executable spatial decision over score-tile groups within fused dense attention. TileMix partitions the attention matrix into hardware-aligned score tiles, packs routing decisions into compact bitmasks, and dispatches each tile group through FP16 or INT8 score computation while both paths update a shared online-softmax state. Scalable precision grouping lets each routing bit govern multiple adjacent key tiles, preserving hardware-aligned compute tiles and compact metadata at long contexts. By routing all legal tile groups, TileMix preserves dense token connectivity, requires no training, and supports grouped-query attention, variable-length batches, and INT8 key/value caches. Across LongEval, LV-Eval, and A100 prefill benchmarks on LLaMA, Qwen, and Vicuna, TileMix recovers long-context quality lost under uniform INT8 and improves prefill throughput over FP16, yielding a controllable accuracy-efficiency frontier across model families. The implementation is available at [this https URL](https://github.com/HanzhiZhang-Ulrica/TileMix).

| Subjects: | Artificial Intelligence (cs.AI) |
| --- | --- |
| Cite as: | [arXiv:2608.17336](https://arxiv.org/abs/2608.17336) \[cs.AI\] |
|  | (or [arXiv:2608.17336v1](https://arxiv.org/abs/2608.17336v1) \[cs.AI\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.17336](https://doi.org/10.48550/arXiv.2608.17336) |

## Submission history

From: Hanzhi Zhang \[[view email](https://arxiv.org/show-email/fe11cbd8/2608.17336)\]  
**\[v1\]** Tue, 18 Aug 2026 03:53:02 UTC (490 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.17336) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))