---
格式版本: 2
标题: "Beyond FLOPs: Energy-Aware Knowledge Distillation for Sustainable LLMs on Code-Related Task"
原文链接: "https://arxiv.org/abs/2608.17515"
发布日期: "2026-08-18"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Tue, 18 Aug 2026 08:41:04 UTC (294 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-20T15:58:25+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-20T15:54:04+08:00"
入库时间: "2026-08-20T07:58:26.002Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=inference%20networking&searchtype=all"
匹配关键词:
  - "GPU"
  - "performance"
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 10
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "论文主题为软件工程中LLM知识蒸馏与能耗，与超节点/AI Rack/机柜级AI基础设施完全无关，无相关技术或商业信息。"
AI质检模型: "ali-deepseek-v4-flash"
AI质检时间: "2026-08-20T16:03:41+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 5
AI摘要: "研究人员提出能量感知知识蒸馏方法，用于软件工程领域的代码相关任务，发现FLOPs并非可靠的能耗指标，改用直接估算CPU和GPU能耗的代理模型指导蒸馏。蒸馏后的学生模型推理能耗最多降低90%、内存占用降低86%，仅伴随轻微精度损失。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:21:43.992Z"
采集批次: "2026年8月20日14点19分32秒"
采集批次ID: "20260820-141932-079"
去重键: "https://arxiv.org/abs/2608.17515"
---

## Computer Science > Software Engineering

## Title:Beyond FLOPs: Energy-Aware Knowledge Distillation for Sustainable LLMs on Code-Related Task

Authors:[Enrique Barba Roque](https://arxiv.org/search/cs?searchtype=author&query=Roque,+E+B), [Luís Cruz](https://arxiv.org/search/cs?searchtype=author&query=Cruz,+L), [Annibale Panichella](https://arxiv.org/search/cs?searchtype=author&query=Panichella,+A)

[View PDF](https://arxiv.org/pdf/2608.17515) [HTML (experimental)](https://arxiv.org/html/2608.17515v1)

> Abstract:Background: Large Language Models (LLMs) are increasingly being applied to Software Engineering (SE) tasks, achieving high accuracy across problems such as clone detection, vulnerability prediction, and code summarization. However, their high computational demands and energy consumption raise sustainability concerns and hinder their use on consumer hardware and resource-constrained platforms. A common way to report the computational cost of an LLM in the literature and industry is to use the number of Floating Point Operations (FLOPs) required to perform a pass over the network. Aims: This paper investigates the implications of energy-aware knowledge distillation for SE, aiming to improve model efficiency while maintaining performance and to determine whether FLOPs is a reliable energy-aware metric. Method: We conduct a controlled experiment using Morph, a Many-Objective Optimization-based distillation methodology, to empirically examine whether FLOPs accurately reflect energy consumption in Clone Detection and Vulnerability Prediction tasks. We extend this methodology to include energy-surrogate models that directly estimate CPU and GPU energy consumption during optimization, and we apply Morph to generative tasks using CodeT5+ for code summarization. Results: Our results show that FLOPs is not always a reliable indicator of energy consumption, and better results can be achieved by using energy-surrogate models. Distilled student models can reduce inference energy consumption by up to 90\\% and memory usage by 86\\%, with only modest accuracy trade-offs. Conclusions: Energy-aware knowledge distillation when guided by direct energy surrogates rather than FLOPs can improve the energy consumption, sustainability, and deployability of LLMs for SE applications, enabling efficient models on consumer hardware.

| Subjects: | Software Engineering (cs.SE); Artificial Intelligence (cs.AI) |
| --- | --- |
| Cite as: | [arXiv:2608.17515](https://arxiv.org/abs/2608.17515) \[cs.SE\] |
|  | (or [arXiv:2608.17515v1](https://arxiv.org/abs/2608.17515v1) \[cs.SE\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.17515](https://doi.org/10.48550/arXiv.2608.17515) |

## Submission history

From: Enrique Barba Roque \[[view email](https://arxiv.org/show-email/581dca4c/2608.17515)\]  
**\[v1\]** Tue, 18 Aug 2026 08:41:04 UTC (294 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.17515) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))