---
格式版本: 2
标题: "Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report"
原文链接: "https://arxiv.org/abs/2608.11965"
发布日期: "2026-08-12"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Wed, 12 Aug 2026 11:53:44 UTC (2,111 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-08-13T18:33:59+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-08-13T18:24:32+08:00"
入库时间: "2026-08-13T10:33:59.817Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=AI&searchtype=all"
匹配关键词:
  - "AI"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI质检状态: "评分失败"
AI评分尝试次数: 1
AI评分错误类型: "service_error"
AI评分错误: "LLM call failed; tried model chain: ali-deepseek-v4-flash -> tx-deepseek-v4-flash | Model ali-deepseek-v4-flash failed 500: {\"error\":{\"code\":\"\",\"message\":\"Database error, please contact the administrator (request id: 202608131034025442366208268d9d6gk7fMSAb)\",\"type\":\"new_api_error\"}} | Model tx-deepseek-v4-flash failed 500: {\"error\":{\"code\":\"\",\"message\":\"Database error, please contact the administrator (request id: 202608131034037669102448268d9d6tSPdSJo8)\",\"type\":\"new_api_error\"}}"
AI评分开始时间: "2026-08-13T10:34:00.157Z"
AI评分结束时间: "2026-08-13T10:34:04.309Z"
AI摘要: "该文通过定量分析开源多智能体框架并定性实现README摘要用例，评估了LLM多智能体系统在软件工程中的落地效果。结果显示框架基础组件覆盖较好，但智能体遥测等高级功能仍缺失，且各框架在ROUGE得分上无显著差异，并据此给出选型经验与挑战。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-07T03:39:53.390Z"
采集批次: "2026年8月13日18点24分27秒"
采集批次ID: "20260813-182427-1564e572"
去重键: "https://arxiv.org/abs/2608.11965"
---

## Computer Science > Software Engineering

## Title:Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report

[View PDF](https://arxiv.org/pdf/2608.11965) [HTML (experimental)](https://arxiv.org/html/2608.11965v1)

> Abstract:The proliferation of Generative Artificial Intelligence (Gen AI) powered by large language models (LLMs) has transformed the software development process, introducing new paradigms for code generation, debugging, testing, and maintenance. While early applications focused on leveraging single, independent LLMs to assist developers with isolated tasks, recent advances have shifted toward multi-agent systems (MAS) that orchestrate multiple LLM-based agents working collaboratively toward common objectives. Despite their promising potential, using MAS encompasses a set of challenges for developers who have to carefully select the right technology, devise proper coordination rules, and design specific roles for the involved agents. In this paper, we provide a comprehensive overview of the existing tools and frameworks for implementing MAS in software engineering. First, we conducted a quantitative analysis of the most relevant open source MAS frameworks by evaluating their documentation, features, and capabilities from the developers' perspective. Second, we performed a qualitative evaluation of a subset of the selected frameworks by implementing a common use case: the summarization of [this http URL](http://readme.md/) files. The findings show that the selected frameworks provide a good coverage of fundamental components of MAS, though advanced features such as telemetry of agents are still missing. In addition, the empirical evaluation shows that there is no significant difference in terms of ROUGE scores considering the summarization task. Finally, we provide a set of lessons learned and challenges that can help researchers and practitioners to select a suitable MAS framework according to their needs.

| Comments: |  |
| --- | --- |
| Subjects: | Software Engineering (cs.SE) |
| Cite as: | [arXiv:2608.11965](https://arxiv.org/abs/2608.11965) \[cs.SE\] |
|  | (or [arXiv:2608.11965v1](https://arxiv.org/abs/2608.11965v1) \[cs.SE\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2608.11965](https://doi.org/10.48550/arXiv.2608.11965) |

## Submission history

From: Phuong Nguyen \[[view email](https://arxiv.org/show-email/940fc5de/2608.11965)\]  
**\[v1\]** Wed, 12 Aug 2026 11:53:44 UTC (2,111 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.11965) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))