选项卡:通过两阶段微调模型生成模板感知的bug报告标题

IF 3.1 2区 计算机科学 Q3 COMPUTER SCIENCE, SOFTWARE ENGINEERING
Xiao Liu, Yinkang Xu, Weifeng Sun, Naiqi Huang, Song Sun, Qiang Li, Dan Yang, Meng Yan
{"title":"选项卡:通过两阶段微调模型生成模板感知的bug报告标题","authors":"Xiao Liu,&nbsp;Yinkang Xu,&nbsp;Weifeng Sun,&nbsp;Naiqi Huang,&nbsp;Song Sun,&nbsp;Qiang Li,&nbsp;Dan Yang,&nbsp;Meng Yan","doi":"10.1007/s10515-025-00505-9","DOIUrl":null,"url":null,"abstract":"<div><p>Bug reports play a critical role in the software development lifecycle by helping developers identify and resolve defects efficiently. However, the quality of bug report titles, particularly in open-source communities, can vary significantly, which complicates the bug triage and resolution processes. Existing approaches, such as iTAPE, treat title generation as a one-sentence summarization task using sequence-to-sequence models. While these methods show promise, they face two major limitations: (1) they do not consider the distinct components of bug reports, treating the entire report as a homogeneous input, and (2) they struggle to handle the variability between template-based and non-template-based reports, often resulting in suboptimal titles. To address these limitations, we propose <span>TAB</span>, a hybrid framework that combines a <i>Document Component Analyzer</i> based on a pre-trained BERT model and a <i>Title Generation Model</i> based on CodeT5. <span>TAB</span> addresses the first limitation by segmenting bug reports into four components-<i>Description</i>, <i>Reproduction</i>, <i>Expected Behavior</i>, and <i>Others</i>-to ensure better alignment between input and output. For the second limitation, <span>TAB</span> uses a divergent approach: for template-based reports, titles are generated directly, while for non-template reports, DCA extracts key components to improve title relevance and clarity. We evaluate <span>TAB</span> on both template-based and non-template-based bug reports, demonstrating that it significantly outperforms existing methods. Specifically, <span>TAB</span> achieves average improvements of 170.4–389.5% in METEOR, 67.8–190.0% in ROUGE-L, and 65.7–124.5% in chrF(AF) compared to baseline approaches on template-based reports. Additionally, on non-template-based reports, <span>TAB</span> shows an average improvement of 64% in METEOR, 3.6% in ROUGE-L, and 14.8% in chrF(AF) over the state-of-the-art. These results confirm the robustness of <span>TAB</span> in generating high-quality titles across diverse bug report formats.</p></div>","PeriodicalId":55414,"journal":{"name":"Automated Software Engineering","volume":"32 2","pages":""},"PeriodicalIF":3.1000,"publicationDate":"2025-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Tab: template-aware bug report title generation via two-phase fine-tuned models\",\"authors\":\"Xiao Liu,&nbsp;Yinkang Xu,&nbsp;Weifeng Sun,&nbsp;Naiqi Huang,&nbsp;Song Sun,&nbsp;Qiang Li,&nbsp;Dan Yang,&nbsp;Meng Yan\",\"doi\":\"10.1007/s10515-025-00505-9\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Bug reports play a critical role in the software development lifecycle by helping developers identify and resolve defects efficiently. However, the quality of bug report titles, particularly in open-source communities, can vary significantly, which complicates the bug triage and resolution processes. Existing approaches, such as iTAPE, treat title generation as a one-sentence summarization task using sequence-to-sequence models. While these methods show promise, they face two major limitations: (1) they do not consider the distinct components of bug reports, treating the entire report as a homogeneous input, and (2) they struggle to handle the variability between template-based and non-template-based reports, often resulting in suboptimal titles. To address these limitations, we propose <span>TAB</span>, a hybrid framework that combines a <i>Document Component Analyzer</i> based on a pre-trained BERT model and a <i>Title Generation Model</i> based on CodeT5. <span>TAB</span> addresses the first limitation by segmenting bug reports into four components-<i>Description</i>, <i>Reproduction</i>, <i>Expected Behavior</i>, and <i>Others</i>-to ensure better alignment between input and output. For the second limitation, <span>TAB</span> uses a divergent approach: for template-based reports, titles are generated directly, while for non-template reports, DCA extracts key components to improve title relevance and clarity. We evaluate <span>TAB</span> on both template-based and non-template-based bug reports, demonstrating that it significantly outperforms existing methods. Specifically, <span>TAB</span> achieves average improvements of 170.4–389.5% in METEOR, 67.8–190.0% in ROUGE-L, and 65.7–124.5% in chrF(AF) compared to baseline approaches on template-based reports. Additionally, on non-template-based reports, <span>TAB</span> shows an average improvement of 64% in METEOR, 3.6% in ROUGE-L, and 14.8% in chrF(AF) over the state-of-the-art. These results confirm the robustness of <span>TAB</span> in generating high-quality titles across diverse bug report formats.</p></div>\",\"PeriodicalId\":55414,\"journal\":{\"name\":\"Automated Software Engineering\",\"volume\":\"32 2\",\"pages\":\"\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2025-03-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Automated Software Engineering\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s10515-025-00505-9\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, SOFTWARE ENGINEERING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Automated Software Engineering","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s10515-025-00505-9","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
引用次数: 0

摘要

Bug报告通过帮助开发人员有效地识别和解决缺陷,在软件开发生命周期中扮演着至关重要的角色。然而,bug报告标题的质量,特别是在开源社区中,可能会有很大的差异,这使得bug分类和解决过程变得复杂。现有的方法,如iTAPE,将标题生成视为使用序列到序列模型的一句话摘要任务。虽然这些方法显示出希望,但它们面临两个主要的限制:(1)它们不考虑bug报告的不同组成部分,将整个报告视为同质输入,(2)它们难以处理基于模板和非基于模板的报告之间的可变性,经常导致次优标题。为了解决这些限制,我们提出了TAB,这是一个混合框架,它结合了基于预训练BERT模型的文档组件分析器和基于CodeT5的标题生成模型。TAB通过将bug报告划分为四个组件(描述、再现、预期行为和其他)来解决第一个限制,以确保输入和输出之间更好的一致性。对于第二个限制,TAB使用了一种不同的方法:对于基于模板的报告,直接生成标题,而对于非模板报告,DCA提取关键组件以提高标题的相关性和清晰度。我们在基于模板和非基于模板的bug报告上对TAB进行了评估,证明它明显优于现有的方法。具体来说,与基于模板的报告的基线方法相比,TAB在METEOR中实现了170.4-389.5%的平均改进,在ROUGE-L中实现了67.8-190.0%,在chrF(AF)中实现了65.7-124.5%。此外,在非基于模板的报告中,TAB显示METEOR的平均改进为64%,ROUGE-L的平均改进为3.6%,chrF(AF)的平均改进为14.8%。这些结果证实了TAB在跨各种错误报告格式生成高质量标题方面的稳健性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Tab: template-aware bug report title generation via two-phase fine-tuned models

Bug reports play a critical role in the software development lifecycle by helping developers identify and resolve defects efficiently. However, the quality of bug report titles, particularly in open-source communities, can vary significantly, which complicates the bug triage and resolution processes. Existing approaches, such as iTAPE, treat title generation as a one-sentence summarization task using sequence-to-sequence models. While these methods show promise, they face two major limitations: (1) they do not consider the distinct components of bug reports, treating the entire report as a homogeneous input, and (2) they struggle to handle the variability between template-based and non-template-based reports, often resulting in suboptimal titles. To address these limitations, we propose TAB, a hybrid framework that combines a Document Component Analyzer based on a pre-trained BERT model and a Title Generation Model based on CodeT5. TAB addresses the first limitation by segmenting bug reports into four components-Description, Reproduction, Expected Behavior, and Others-to ensure better alignment between input and output. For the second limitation, TAB uses a divergent approach: for template-based reports, titles are generated directly, while for non-template reports, DCA extracts key components to improve title relevance and clarity. We evaluate TAB on both template-based and non-template-based bug reports, demonstrating that it significantly outperforms existing methods. Specifically, TAB achieves average improvements of 170.4–389.5% in METEOR, 67.8–190.0% in ROUGE-L, and 65.7–124.5% in chrF(AF) compared to baseline approaches on template-based reports. Additionally, on non-template-based reports, TAB shows an average improvement of 64% in METEOR, 3.6% in ROUGE-L, and 14.8% in chrF(AF) over the state-of-the-art. These results confirm the robustness of TAB in generating high-quality titles across diverse bug report formats.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Automated Software Engineering
Automated Software Engineering 工程技术-计算机:软件工程
CiteScore
4.80
自引率
11.80%
发文量
51
审稿时长
>12 weeks
期刊介绍: This journal details research, tutorial papers, survey and accounts of significant industrial experience in the foundations, techniques, tools and applications of automated software engineering technology. This includes the study of techniques for constructing, understanding, adapting, and modeling software artifacts and processes. Coverage in Automated Software Engineering examines both automatic systems and collaborative systems as well as computational models of human software engineering activities. In addition, it presents knowledge representations and artificial intelligence techniques applicable to automated software engineering, and formal techniques that support or provide theoretical foundations. The journal also includes reviews of books, software, conferences and workshops.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信