{"title":"On the road to interactive LLM-based systematic mapping studies","authors":"Kai Petersen , Jan M. Gerken","doi":"10.1016/j.infsof.2024.107611","DOIUrl":null,"url":null,"abstract":"<div><h3>Context:</h3><div>The research volume is continuously increasing. Manual analysis of large topic scopes and continuously updating literature studies with the newest research results is effort intensive and, therefore, difficult to achieve.</div></div><div><h3>Objective:</h3><div>To discuss possibilities and next steps for using LLMs (e.g., GPT-4) in the mapping study process.</div></div><div><h3>Method:</h3><div>The research can be classified as a solution proposal. The solution was iteratively designed and discussed among the authors based on their experience with LLMs and literature reviews.</div></div><div><h3>Results:</h3><div>We propose strategies for the mapping process, outlining the use of agents and prompting strategies for each step.</div></div><div><h3>Conclusion:</h3><div>Given the potential of LLMs in literature studies, we should work on a holistic solutions for LLM-supported mapping studies.</div></div>","PeriodicalId":54983,"journal":{"name":"Information and Software Technology","volume":"178 ","pages":"Article 107611"},"PeriodicalIF":3.8000,"publicationDate":"2024-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information and Software Technology","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950584924002167","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Context:
The research volume is continuously increasing. Manual analysis of large topic scopes and continuously updating literature studies with the newest research results is effort intensive and, therefore, difficult to achieve.
Objective:
To discuss possibilities and next steps for using LLMs (e.g., GPT-4) in the mapping study process.
Method:
The research can be classified as a solution proposal. The solution was iteratively designed and discussed among the authors based on their experience with LLMs and literature reviews.
Results:
We propose strategies for the mapping process, outlining the use of agents and prompting strategies for each step.
Conclusion:
Given the potential of LLMs in literature studies, we should work on a holistic solutions for LLM-supported mapping studies.
期刊介绍:
Information and Software Technology is the international archival journal focusing on research and experience that contributes to the improvement of software development practices. The journal''s scope includes methods and techniques to better engineer software and manage its development. Articles submitted for review should have a clear component of software engineering or address ways to improve the engineering and management of software development. Areas covered by the journal include:
• Software management, quality and metrics,
• Software processes,
• Software architecture, modelling, specification, design and programming
• Functional and non-functional software requirements
• Software testing and verification & validation
• Empirical studies of all aspects of engineering and managing software development
Short Communications is a new section dedicated to short papers addressing new ideas, controversial opinions, "Negative" results and much more. Read the Guide for authors for more information.
The journal encourages and welcomes submissions of systematic literature studies (reviews and maps) within the scope of the journal. Information and Software Technology is the premiere outlet for systematic literature studies in software engineering.