二次研究中的研究工件：软件工程中的系统映射

IF 3.8 2区计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS

Information and Software Technology Pub Date : 2025-07-07 DOI:10.1016/j.infsof.2025.107830

Aleksi Huotala , Miikka Kuutila , Mika Mäntylä

{"title":"二次研究中的研究工件：软件工程中的系统映射","authors":"Aleksi Huotala , Miikka Kuutila , Mika Mäntylä","doi":"10.1016/j.infsof.2025.107830","DOIUrl":null,"url":null,"abstract":"<div><h3>Context:</h3><div>Systematic reviews (SRs) summarize state-of-the-art evidence in science, including software engineering (SE).</div></div><div><h3>Objective:</h3><div>Our objective is to evaluate how SRs report research artifacts and to provide a comprehensive list of these artifacts.</div></div><div><h3>Method:</h3><div>We examined 537 secondary studies published between 2013 and 2023 to analyze the availability and reporting of research artifacts.</div></div><div><h3>Results:</h3><div>Our findings indicate that only 31.5% of the reviewed studies include research artifacts. Encouragingly, the situation is gradually improving, as our regression analysis shows a significant increase in the availability of research artifacts over time. However, in 2023, just 62.0% of secondary studies provide a research artifact while an even lower percentage, 30.4% use a permanent repository with a digital object identifier (DOI) for storage.</div></div><div><h3>Conclusion:</h3><div>To enhance transparency and reproducibility in SE research, we advocate for the mandatory publication of research artifacts in secondary studies.</div></div>","PeriodicalId":54983,"journal":{"name":"Information and Software Technology","volume":"187 ","pages":"Article 107830"},"PeriodicalIF":3.8000,"publicationDate":"2025-07-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Research artifacts in secondary studies: A systematic mapping in software engineering\",\"authors\":\"Aleksi Huotala , Miikka Kuutila , Mika Mäntylä\",\"doi\":\"10.1016/j.infsof.2025.107830\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Context:</h3><div>Systematic reviews (SRs) summarize state-of-the-art evidence in science, including software engineering (SE).</div></div><div><h3>Objective:</h3><div>Our objective is to evaluate how SRs report research artifacts and to provide a comprehensive list of these artifacts.</div></div><div><h3>Method:</h3><div>We examined 537 secondary studies published between 2013 and 2023 to analyze the availability and reporting of research artifacts.</div></div><div><h3>Results:</h3><div>Our findings indicate that only 31.5% of the reviewed studies include research artifacts. Encouragingly, the situation is gradually improving, as our regression analysis shows a significant increase in the availability of research artifacts over time. However, in 2023, just 62.0% of secondary studies provide a research artifact while an even lower percentage, 30.4% use a permanent repository with a digital object identifier (DOI) for storage.</div></div><div><h3>Conclusion:</h3><div>To enhance transparency and reproducibility in SE research, we advocate for the mandatory publication of research artifacts in secondary studies.</div></div>\",\"PeriodicalId\":54983,\"journal\":{\"name\":\"Information and Software Technology\",\"volume\":\"187 \",\"pages\":\"Article 107830\"},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2025-07-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information and Software Technology\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0950584925001697\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information and Software Technology","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950584925001697","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}

引用次数: 0

摘要

背景：系统评论（SRs）总结了科学中最先进的证据，包括软件工程（SE）。目标：我们的目标是评估SRs如何报告研究工件，并提供这些工件的综合列表。方法：我们检查了2013年至2023年间发表的537项次要研究，以分析研究工件的可用性和报告。结果：我们的研究结果表明，只有31.5%的综述研究包含研究伪影。令人鼓舞的是，情况正在逐渐改善，因为我们的回归分析显示，随着时间的推移，研究工件的可用性显著增加。然而，在2023年，只有62.0%的二次研究提供了研究工件，而使用带有数字对象标识符（DOI）的永久存储库的比例更低，为30.4%。结论：为了提高SE研究的透明度和可重复性，我们提倡在二级研究中强制发表研究成果。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Research artifacts in secondary studies: A systematic mapping in software engineering

Context:

Systematic reviews (SRs) summarize state-of-the-art evidence in science, including software engineering (SE).

Objective:

Our objective is to evaluate how SRs report research artifacts and to provide a comprehensive list of these artifacts.

Method:

We examined 537 secondary studies published between 2013 and 2023 to analyze the availability and reporting of research artifacts.

Results:

Our findings indicate that only 31.5% of the reviewed studies include research artifacts. Encouragingly, the situation is gradually improving, as our regression analysis shows a significant increase in the availability of research artifacts over time. However, in 2023, just 62.0% of secondary studies provide a research artifact while an even lower percentage, 30.4% use a permanent repository with a digital object identifier (DOI) for storage.

Conclusion:

To enhance transparency and reproducibility in SE research, we advocate for the mandatory publication of research artifacts in secondary studies.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Information and Software Technology 工程技术-计算机：软件工程

CiteScore

9.10

自引率

7.70%

发文量

164

审稿时长

9.6 weeks

期刊介绍： Information and Software Technology is the international archival journal focusing on research and experience that contributes to the improvement of software development practices. The journal''s scope includes methods and techniques to better engineer software and manage its development. Articles submitted for review should have a clear component of software engineering or address ways to improve the engineering and management of software development. Areas covered by the journal include: • Software management, quality and metrics, • Software processes, • Software architecture, modelling, specification, design and programming • Functional and non-functional software requirements • Software testing and verification & validation • Empirical studies of all aspects of engineering and managing software development Short Communications is a new section dedicated to short papers addressing new ideas, controversial opinions, "Negative" results and much more. Read the Guide for authors for more information. The journal encourages and welcomes submissions of systematic literature studies (reviews and maps) within the scope of the journal. Information and Software Technology is the premiere outlet for systematic literature studies in software engineering.