Teng Huang, Hui-Qun Yu, Gui-Sheng Fan, Zi-Jie Huang, Chen-Yu Wu
{"title":"采用多输入语义融合的面向代码更改的及时缺陷预测方法","authors":"Teng Huang, Hui-Qun Yu, Gui-Sheng Fan, Zi-Jie Huang, Chen-Yu Wu","doi":"10.1111/exsy.13702","DOIUrl":null,"url":null,"abstract":"<p>Recent research found that fine-tuning pre-trained models is superior to training models from scratch in just-in-time (JIT) defect prediction. However, existing approaches using pre-trained models have their limitations. First, the input length is constrained by the pre-trained models.Secondly, the inputs are change-agnostic.To address these limitations, we propose JIT-Block, a JIT defect prediction method that combines multiple input semantics using changed block as the fundamental unit. We restructure the JIT-Defects4J dataset used in previous research. We then conducted a comprehensive comparison using eleven performance metrics, including both effort-aware and effort-agnostic measures, against six state-of-the-art baseline models. The results demonstrate that on the JIT defect prediction task, our approach outperforms the baseline models in all six metrics, showing improvements ranging from 1.5% to 800% in effort-agnostic metrics and 0.3% to 57% in effort-aware metrics. For the JIT defect code line localization task, our approach outperforms the baseline models in three out of five metrics, showing improvements of 11% to 140%.</p>","PeriodicalId":51053,"journal":{"name":"Expert Systems","volume":"41 12","pages":""},"PeriodicalIF":3.0000,"publicationDate":"2024-08-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A code change-oriented approach to just-in-time defect prediction with multiple input semantic fusion\",\"authors\":\"Teng Huang, Hui-Qun Yu, Gui-Sheng Fan, Zi-Jie Huang, Chen-Yu Wu\",\"doi\":\"10.1111/exsy.13702\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Recent research found that fine-tuning pre-trained models is superior to training models from scratch in just-in-time (JIT) defect prediction. However, existing approaches using pre-trained models have their limitations. First, the input length is constrained by the pre-trained models.Secondly, the inputs are change-agnostic.To address these limitations, we propose JIT-Block, a JIT defect prediction method that combines multiple input semantics using changed block as the fundamental unit. We restructure the JIT-Defects4J dataset used in previous research. We then conducted a comprehensive comparison using eleven performance metrics, including both effort-aware and effort-agnostic measures, against six state-of-the-art baseline models. The results demonstrate that on the JIT defect prediction task, our approach outperforms the baseline models in all six metrics, showing improvements ranging from 1.5% to 800% in effort-agnostic metrics and 0.3% to 57% in effort-aware metrics. For the JIT defect code line localization task, our approach outperforms the baseline models in three out of five metrics, showing improvements of 11% to 140%.</p>\",\"PeriodicalId\":51053,\"journal\":{\"name\":\"Expert Systems\",\"volume\":\"41 12\",\"pages\":\"\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2024-08-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Expert Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/exsy.13702\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/exsy.13702","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
A code change-oriented approach to just-in-time defect prediction with multiple input semantic fusion
Recent research found that fine-tuning pre-trained models is superior to training models from scratch in just-in-time (JIT) defect prediction. However, existing approaches using pre-trained models have their limitations. First, the input length is constrained by the pre-trained models.Secondly, the inputs are change-agnostic.To address these limitations, we propose JIT-Block, a JIT defect prediction method that combines multiple input semantics using changed block as the fundamental unit. We restructure the JIT-Defects4J dataset used in previous research. We then conducted a comprehensive comparison using eleven performance metrics, including both effort-aware and effort-agnostic measures, against six state-of-the-art baseline models. The results demonstrate that on the JIT defect prediction task, our approach outperforms the baseline models in all six metrics, showing improvements ranging from 1.5% to 800% in effort-agnostic metrics and 0.3% to 57% in effort-aware metrics. For the JIT defect code line localization task, our approach outperforms the baseline models in three out of five metrics, showing improvements of 11% to 140%.
期刊介绍:
Expert Systems: The Journal of Knowledge Engineering publishes papers dealing with all aspects of knowledge engineering, including individual methods and techniques in knowledge acquisition and representation, and their application in the construction of systems – including expert systems – based thereon. Detailed scientific evaluation is an essential part of any paper.
As well as traditional application areas, such as Software and Requirements Engineering, Human-Computer Interaction, and Artificial Intelligence, we are aiming at the new and growing markets for these technologies, such as Business, Economy, Market Research, and Medical and Health Care. The shift towards this new focus will be marked by a series of special issues covering hot and emergent topics.