{"title":"UnrealMentor GPT: A System for Teaching Programming Based on a Large Language Model","authors":"Hongli Zhu, Jian Xiang, Zhichuang Yang","doi":"10.1002/cae.70023","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>This paper introduces UnrealMentor GPT, a multiagent debugging framework that combines advanced large language model (LLM) capabilities with a dynamically updated knowledge base. Systems incorporating this framework are used in programming courses for university computer-related majors. This teaching system based on Generative Pre-training (GPT) technology guides students through a hierarchical learning process using multiple specialized agents (syntax checking, algorithm analysis, optimization) and retrieval-augmented generation (RAG). Experimental results based on the effectiveness of undergraduate courses show that students spend less time debugging code in the course, the accuracy of solutions is improved, and the overall learning efficiency is significantly enhanced. Subsequent surveys on teaching effectiveness also showed that students were satisfied with the learning process. Feedback from surveys of relevant teaching staff indicated that the system can simplify the error correction process and deepen students' understanding of concepts. However, there are some limitations to the current research, including the small sample size and short intervention time, which limits the application scenarios of the system. Future research will focus on expanding the participating groups, exploring cross-language applicability, and conducting longitudinal experiments to verify the effectiveness of UnrealMentor GPT in various educational environments.</p>\n </div>","PeriodicalId":50643,"journal":{"name":"Computer Applications in Engineering Education","volume":"33 3","pages":""},"PeriodicalIF":2.0000,"publicationDate":"2025-03-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Applications in Engineering Education","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cae.70023","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
This paper introduces UnrealMentor GPT, a multiagent debugging framework that combines advanced large language model (LLM) capabilities with a dynamically updated knowledge base. Systems incorporating this framework are used in programming courses for university computer-related majors. This teaching system based on Generative Pre-training (GPT) technology guides students through a hierarchical learning process using multiple specialized agents (syntax checking, algorithm analysis, optimization) and retrieval-augmented generation (RAG). Experimental results based on the effectiveness of undergraduate courses show that students spend less time debugging code in the course, the accuracy of solutions is improved, and the overall learning efficiency is significantly enhanced. Subsequent surveys on teaching effectiveness also showed that students were satisfied with the learning process. Feedback from surveys of relevant teaching staff indicated that the system can simplify the error correction process and deepen students' understanding of concepts. However, there are some limitations to the current research, including the small sample size and short intervention time, which limits the application scenarios of the system. Future research will focus on expanding the participating groups, exploring cross-language applicability, and conducting longitudinal experiments to verify the effectiveness of UnrealMentor GPT in various educational environments.
期刊介绍:
Computer Applications in Engineering Education provides a forum for publishing peer-reviewed timely information on the innovative uses of computers, Internet, and software tools in engineering education. Besides new courses and software tools, the CAE journal covers areas that support the integration of technology-based modules in the engineering curriculum and promotes discussion of the assessment and dissemination issues associated with these new implementation methods.