---
格式版本: 2
标题: "FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive Execution"
原文链接: "https://arxiv.org/abs/2608.16157"
发布日期: "2026-08-17"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Mon, 17 Aug 2026 06:22:53 UTC (1,344 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T15:45:27+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T15:39:49+08:00"
入库时间: "2026-08-20T07:45:27.405Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=bandwidth&searchtype=all"
匹配关键词:
  - "bandwidth"
  - "GPU"
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 28
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "论文主题为边缘MoE推理服务，与超节点/AI Rack/机柜级AI基础设施、供电散热互连等核心主题完全无关，仅因检索词命中bandwidth，不构成有效相关。"
AI质检模型: "tx-deepseek-v4-flash"
AI质检时间: "2026-08-20T15:50:11+08:00"
AI主题相关性: 0
AI来源权威性: 10
AI新颖性: 5
AI技术细节: 5
AI商业部署信号: 0
AI完整性: 8
AI摘要: "FreeToken 是一个面向个人电脑的边缘原生 MoE 推理服务系统，通过带宽自适应执行将整台机器视为弹性推理平台，并支持 20 余种 MoE 模型。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:25:18.204Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.16157"
---

## Computer Science > Distributed, Parallel, and Cluster Computing

## Title:FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive Execution

[View PDF](https://arxiv.org/pdf/2608.16157) [HTML (experimental)](https://arxiv.org/html/2608.16157v1)

> Abstract:Frontier open-weight models are increasingly available, but serving them still largely assumes datacenter infrastructure. We present FreeToken, an edge-native MoE serving system that treats a personal machine not as a small GPU, but as a unified, elastic inference platform. FreeToken co-designs the full serving stack, including model layout and loading, expert residency, CPU--GPU execution, agentic state reuse, and runtime memory management, around two realities of local AI: agent workloads continuously change their execution pattern, and edge hardware exposes heterogeneous resources whose balance differs from machine to machine. Rather than committing to a fixed offloading strategy, FreeToken continuously maps computation and model state onto the resources actually available. FreeToken supports more than 20 MoE models and real coding and tool-using agents across hardware ranging from an 8GB laptop GPU to a single workstation GPU. More importantly, it changes what these machines can practically serve, from a 35B model on a laptop to a 284B model on a gaming desktop and the 753B GLM-5.2 on a single workstation GPU. FreeToken turns open weights into deployable local software, making the machines users already own a practical platform for frontier-scale intelligence. We release the system at [this http URL](http://flashml.ai/).

| Subjects: | Distributed, Parallel, and Cluster Computing (cs.DC) |
| --- | --- |
| Cite as: | [arXiv:2608.16157](https://arxiv.org/abs/2608.16157) \[cs.DC\] |
|  | (or [arXiv:2608.16157v1](https://arxiv.org/abs/2608.16157v1) \[cs.DC\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.16157](https://doi.org/10.48550/arXiv.2608.16157) |

## Submission history

From: Shuo Yang \[[view email](https://arxiv.org/show-email/138e081d/2608.16157)\]  
**\[v1\]** Mon, 17 Aug 2026 06:22:53 UTC (1,344 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.16157) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))