---
格式版本: 2
标题: "GEAR: Generative Expansion and Real Anchoring for Two-Stage Distillation of Tabular Foundation Models"
原文链接: "https://arxiv.org/abs/2608.18849"
发布日期: "2026-08-19"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Wed, 19 Aug 2026 12:21:02 UTC (261 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T14:55:35+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T14:53:31+08:00"
入库时间: "2026-08-20T06:55:35.123Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=SUE&searchtype=all"
匹配关键词:
  - "SUE"
  - "deployment"
  - "performance"
  - "latency"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 2
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "该arXiv论文主题为表格基础模型蒸馏，与超节点、AI Rack、机柜级AI基础设施等完全无关，属于明显无关内容。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-20T14:55:56+08:00"
AI主题相关性: 0
AI来源权威性: 1
AI新颖性: 1
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 0
AI摘要: "GEAR 提出一个两阶段蒸馏框架，将表格基础模型（TFM）蒸馏成可在 CPU 上部署的轻量 MLP 或树模型：第一阶段用生成协变量作为查询点学习软目标，第二阶段用真实标签和包外教师预测将学生模型重新锚定到目标分布。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:19:26.989Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.18849"
---

## Computer Science > Machine Learning

## Title:GEAR: Generative Expansion and Real Anchoring for Two-Stage Distillation of Tabular Foundation Models

Authors:[Qi Qin](https://arxiv.org/search/cs?searchtype=author&query=Qin,+Q), [Jiajie Zhu](https://arxiv.org/search/cs?searchtype=author&query=Zhu,+J), [Dali Chen](https://arxiv.org/search/cs?searchtype=author&query=Chen,+D), [Yuzhao Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+Y), [Jia-Xing Han](https://arxiv.org/search/cs?searchtype=author&query=Han,+J), [Yu Su](https://arxiv.org/search/cs?searchtype=author&query=Su,+Y), [Peng Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+P), [Ying Yan](https://arxiv.org/search/cs?searchtype=author&query=Yan,+Y), [Yifan Sun](https://arxiv.org/search/cs?searchtype=author&query=Sun,+Y)

[View PDF](https://arxiv.org/pdf/2608.18849)

> Abstract:Tabular foundation models (TFMs) achieve strong performance through in-context learning, but context-dependent inference imposes substantial latency and memory costs, hindering large-scale deployment. We propose GEAR (\\emph{Generative Expansion and Real Anchoring}), a modular two-stage framework that distills TFMs into lightweight MLP or tree-based predictors that can be deployed on commodity CPUs. Stage 1 uses synthetic covariates solely as teacher-query locations and trains the student on soft TFM targets, expanding coverage beyond observed rows. Stage 2 re-anchors the student to the target distribution using real labels and out-of-fold teacher predictions, whitch avoids self-labeling leakage. We further derive a risk certificate characterizing the trade-off between generated-query volume and generator fidelity. Experiments on TALENT and TabArena demonstrate the broad applicability of GEAR. Two-stage MLPs outperform supervised MLPs by 1.81--2.00 AUC points on binary tasks and 1.19--1.35 points on multiclass tasks, with additional gains over real-data-only distillation of 1.76--2.19 and 2.09--2.40 points, respectively. On binary tasks, the gains also transfer to LightGBM and XGBoost, and all three student families outperform CatBoost, the strongest non-TFM baseline, in mean AUC. Ablations show gains beyond longer training or alternative warm starts, greater stability from staged than mixed optimization, and generator-dependent diminishing returns as query volume increases. Finally, GEAR reduces median inference time by 57--2866 times and peak prediction memory by 1.9--3.3 times, while retaining higher AUC than matched supervised baselines.

| Comments: |  |
| --- | --- |
| Subjects: | Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML) |
| Cite as: | [arXiv:2608.18849](https://arxiv.org/abs/2608.18849) \[cs.LG\] |
|  | (or [arXiv:2608.18849v1](https://arxiv.org/abs/2608.18849v1) \[cs.LG\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.18849](https://doi.org/10.48550/arXiv.2608.18849) |

## Submission history

From: Qi Qin \[[view email](https://arxiv.org/show-email/1d9db19c/2608.18849)\]  
**\[v1\]** Wed, 19 Aug 2026 12:21:02 UTC (261 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.18849) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))