---
格式版本: 2
标题: "MeanField Surrogate Modeling for Scalable Runtime Scheduling of Concurrent Heterogeneous AI Inference on Shared GPUs"
原文链接: "https://arxiv.org/abs/2609.02109"
发布日期: "2026-09-02"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Wed, 2 Sep 2026 04:52:22 UTC (86 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-09-04T01:34:46+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-09-04T01:32:14+08:00"
入库时间: "2026-09-03T17:34:46.746Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=GPU&searchtype=all"
匹配关键词:
  - "GPU"
  - "performance"
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 21
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "该内容为arXiv学术论文，主题为共享GPU上异构AI推理的运行时调度，属于软件调度优化，未涉及超节点/AI Rack/机柜级硬件架构、互连、供电、液冷或量产落地等核心关注点，仅命中GPU关键词，相关性弱。"
AI质检模型: "zj-deepseek-v4-flash"
AI质检时间: "2026-09-04T01:35:22+08:00"
AI主题相关性: 4
AI来源权威性: 8
AI新颖性: 4
AI技术细节: 4
AI商业部署信号: 0
AI完整性: 1
AI摘要: "针对共享 GPU 上并发异构 AI 推理的运行时调度，作者提出一种 MeanField 代理模型，用局部配置和聚合 GPU 状态预测各模型性能，避免了联合建模的组合爆炸。实验显示预测精度 R²≈0.96，采样需求近似线性增长；"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-04T00:18:06.812Z"
采集批次: "2026年9月3日22点43分34秒"
采集批次ID: "20260903-224334-406"
去重键: "https://arxiv.org/abs/2609.02109"
---

## Computer Science > Distributed, Parallel, and Cluster Computing

## Title:MeanField Surrogate Modeling for Scalable Runtime Scheduling of Concurrent Heterogeneous AI Inference on Shared GPUs

Authors:[Youssef Ennouri](https://arxiv.org/search/cs?searchtype=author&query=Ennouri,+Y), [Soonhoi Ha](https://arxiv.org/search/cs?searchtype=author&query=Ha,+S)

[View PDF](https://arxiv.org/pdf/2609.02109) [HTML (experimental)](https://arxiv.org/html/2609.02109v1)

> Abstract:Deploying heterogeneous AI models concurrently on a shared GPU introduces resource contention that complicates runtime scheduling. While surrogate models avoid costly online benchmarking, their profiling requirements typically grow combinatorially with the number of co-running models, limiting scalability. We propose a MeanField surrogate that predicts per-model performance from local configuration and aggregate GPU state rather than explicitly modeling all joint interactions. Experiments on concurrent LLM and vision workloads across $N \in \{2,3,4,5,6\}$ show high predictive accuracy ($R^2 \approx 0.96$) with an empirical sample budget that grows approximately linearly in $N$, in contrast to the combinatorial cost of fully joint profiling. Integrated into a genetic algorithm scheduler, the surrogate scales to an $N=5$ problem with 78,732 feasible joint configurations, remaining within 0.10% of the exhaustive search with zero SLA violations across eight dynamic workload scenarios, while complete online GA decisions take 26 ms median, about $5\times$ faster than exhaustive surrogate search.

| Comments: |  |
| --- | --- |
| Subjects: | Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI) |
| Cite as: | [arXiv:2609.02109](https://arxiv.org/abs/2609.02109) \[cs.DC\] |
|  | (or [arXiv:2609.02109v1](https://arxiv.org/abs/2609.02109v1) \[cs.DC\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2609.02109](https://doi.org/10.48550/arXiv.2609.02109) |
| Related DOI: | [https://doi.org/10.1109/LES.2026.3724013](https://doi.org/10.1109/LES.2026.3724013) |

## Submission history

From: Youssef Ennouri \[[view email](https://arxiv.org/show-email/4aa277f3/2609.02109)\]  
**\[v1\]** Wed, 2 Sep 2026 04:52:22 UTC (86 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2609.02109) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))