Journal of Computer Assisted Learning最新文献

筛选
英文 中文
Does Teacher Enthusiasm Facilitate Students' Chemistry Learning in Video Lectures Regardless of Students' Prior Chemistry Knowledge Levels? 无论学生的化学知识水平如何,教师的热情是否有助于学生在视频讲座中学习化学?
IF 5.1 2区 教育学
Journal of Computer Assisted Learning Pub Date : 2025-01-07 DOI: 10.1111/jcal.13116
Qian Huangfu, Qianmei He, Sisi Luo, Weilin Huang, Yahua Yang
{"title":"Does Teacher Enthusiasm Facilitate Students' Chemistry Learning in Video Lectures Regardless of Students' Prior Chemistry Knowledge Levels?","authors":"Qian Huangfu,&nbsp;Qianmei He,&nbsp;Sisi Luo,&nbsp;Weilin Huang,&nbsp;Yahua Yang","doi":"10.1111/jcal.13116","DOIUrl":"https://doi.org/10.1111/jcal.13116","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Video lectures which include the teachers' presence have become increasingly common. As teacher enthusiasm is a nonverbal cue in video lectures, more and more studies are focusing on this topic. However, little research has been carried out on the interactions between teacher enthusiasm and prior knowledge when learning from video lectures.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>We tested whether prior chemistry knowledge moderated the impact of teacher enthusiasm on students' chemistry learning during video lectures.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>One hundred and forty-two Grade 7 (low-prior chemistry knowledge) and Grade 9 (high-prior chemistry knowledge) Chinese students engaged with this research. Each group of students was randomised into viewing a video lecture with either a low or high degree of teacher enthusiasm. Outcomes were assessed by attention allocation, learning performance, cognitive load, learning satisfaction and student engagement.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusions</h3>\u0000 \u0000 <p>Our findings revealed significant benefits of teacher enthusiasm and also showed that prior chemistry knowledge could moderate the impact of teacher enthusiasm on students' attention and cognitive outcomes (cognitive load and transfer). Visual attention mediates the effects on transfer. For students with low prior knowledge, there is more focus on the learning content, lower extraneous cognitive load, and higher transfer scores when watching videos with high levels of teacher enthusiasm; however, students with high prior knowledge do not show these differences. In addition, high prior chemistry knowledge had a significant beneficial impact on the motivational outcomes of the students (satisfaction and engagement).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Implications</h3>\u0000 \u0000 <p>The results suggest that teacher enthusiasm in a video lecture may affect students' chemistry learning, and students' prior chemistry knowledge should be considered when choosing whether to display teacher enthusiasm.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2025-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143112776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
You're (Not) My Type- Can LLMs Generate Feedback of Specific Types for Introductory Programming Tasks? 你是(不是)我的类型-法学硕士可以生成特定类型的反馈入门编程任务?
IF 5.1 2区 教育学
Journal of Computer Assisted Learning Pub Date : 2025-01-06 DOI: 10.1111/jcal.13107
Dominic Lohr, Hieke Keuning, Natalie Kiesler
{"title":"You're (Not) My Type- Can LLMs Generate Feedback of Specific Types for Introductory Programming Tasks?","authors":"Dominic Lohr,&nbsp;Hieke Keuning,&nbsp;Natalie Kiesler","doi":"10.1111/jcal.13107","DOIUrl":"https://doi.org/10.1111/jcal.13107","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Feedback as one of the most influential factors for learning has been subject to a great body of research. It plays a key role in the development of educational technology systems and is traditionally rooted in deterministic feedback defined by experts and their experience. However, with the rise of generative AI and especially large language models (LLMs), we expect feedback as part of learning systems to transform, especially for the context of programming. In the past, it was challenging to automate feedback for learners of programming. LLMs may create new possibilities to provide richer, and more individual feedback than ever before.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>This article aims to generate specific types of feedback for introductory programming tasks using LLMs. We revisit existing feedback taxonomies to capture the specifics of the generated feedback, such as randomness, uncertainty and degrees of variation.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We iteratively designed prompts for the generation of specific feedback types (as part of existing feedback taxonomies) in response to authentic student programs. We then evaluated the generated output and determined to what extent it reflected certain feedback types.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusion</h3>\u0000 \u0000 <p>This study provides a better understanding of different feedback dimensions and characteristics. The results have implications for future feedback research with regard to, for example, feedback effects and learners' informational needs. It further provides a basis for the development of new tools and learning systems for novice programmers including feedback generated by AI.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jcal.13107","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143112621","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A comparative study of AI-generated and human-crafted learning objectives in computing education 计算机教育中人工智能生成和人工设计学习目标的比较研究
IF 5.1 2区 教育学
Journal of Computer Assisted Learning Pub Date : 2025-01-05 DOI: 10.1111/jcal.13092
Aidan Doyle, Pragnya Sridhar, Arav Agarwal, Jaromir Savelka, Majd Sakr
{"title":"A comparative study of AI-generated and human-crafted learning objectives in computing education","authors":"Aidan Doyle,&nbsp;Pragnya Sridhar,&nbsp;Arav Agarwal,&nbsp;Jaromir Savelka,&nbsp;Majd Sakr","doi":"10.1111/jcal.13092","DOIUrl":"https://doi.org/10.1111/jcal.13092","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>In computing education, educators are constantly faced with the challenge of developing new curricula, including learning objectives (LOs), while ensuring that existing courses remain relevant. Large language models (LLMs) were shown to successfully generate a wide spectrum of natural language artefacts in computing education.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>The objective of this study is to evaluate if it is feasible for a state-of-the-art LLM to support curricular design by proposing lists of high-quality LOs.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>We propose a simple LLM-powered framework for the automatic generation of LOs. Two human evaluators compare the automatically generated LOs to the human-crafted ones in terms of their alignment with course goals, meeting the SMART criteria, mutual overlap, and appropriateness of ordering.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results</h3>\u0000 \u0000 <p>We found that automatically generated LOs are comparable to LOs authored by instructors in many respects, including being measurable and relevant while exhibiting some limitations (e.g., sometimes not being specific or achievable). LOs were also comparable in their alignment with the high-level course goals. Finally, auto-generated LOs were often deemed to be better organised (order, non-overlap) than the human-authored ones.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Conclusions</h3>\u0000 \u0000 <p>Our findings suggest that LLM could support educators in designing their courses by providing reasonable suggestions for LOs.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2025-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jcal.13092","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143112353","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Technological Competence in Formal Education Collaborative Maker Projects: An Epistemic Network Analysis 正规教育协同创客项目的技术能力:一个认知网络分析
IF 5.1 2区 教育学
Journal of Computer Assisted Learning Pub Date : 2025-01-03 DOI: 10.1111/jcal.13114
Niina Niinimäki, Kati Sormunen, Pirita Seitamaa-Hakkarainen, Sini Davies, Kaiju Kangas
{"title":"Technological Competence in Formal Education Collaborative Maker Projects: An Epistemic Network Analysis","authors":"Niina Niinimäki,&nbsp;Kati Sormunen,&nbsp;Pirita Seitamaa-Hakkarainen,&nbsp;Sini Davies,&nbsp;Kaiju Kangas","doi":"10.1111/jcal.13114","DOIUrl":"https://doi.org/10.1111/jcal.13114","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Implementing maker education in schools is on the rise, fuelled by its potential to move formal education towards a creative, technology-driven 21st century learning culture. In maker education, collaborative learning takes place through and around various digital and traditional technologies, which provide the means for students' creative activities. However, research is scarce on how maker education promotes students' technological competence and how students develop different features of that competence.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>This study investigates the learning of technological competence in formal education collaborative maker projects focusing on designing and making electronic textiles (e-textiles).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>The data consisted of student teams' discourse from classroom video data, in which five 7th-grade student teams (3–6 students/team, 13- to 14-year-olds) were engaged in designing and making e-textiles. Their discourse was categorised into five technology dimensions—crafting, designing, engineering, programming, and documenting—and epistemic network analysis was used to model the co-occurrences of the dimensions.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusions</h3>\u0000 \u0000 <p>All five technology dimensions were present in four of the five teams, but the learning outcomes—that is, the emphasis and connections of the dimensions—varied between the teams. Learning was promoted when technology was used as means for joint construction of knowledge objects but hindered when viewed only as tool for task execution. The results indicate that collaborative maker projects enable the learning of comprehensive technological competence including knowledge and skills related to both digital and traditional technologies. However, implementing a maker project in schools is insufficient to guarantee that all technology dimensions will be addressed.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143111206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Integrating Social–Emotional Learning Into Gamified Flipped Classrooms: Impacts on Emotion Regulation, Achievement and Communication Tendency 社交情绪学习融入游戏化翻转课堂:对情绪调节、成就与沟通倾向的影响
IF 5.1 2区 教育学
Journal of Computer Assisted Learning Pub Date : 2025-01-03 DOI: 10.1111/jcal.13109
Vu Thanh Tam Nguyen, Hsiu-Ling Chen, Van Tran Kieu Nguyen
{"title":"Integrating Social–Emotional Learning Into Gamified Flipped Classrooms: Impacts on Emotion Regulation, Achievement and Communication Tendency","authors":"Vu Thanh Tam Nguyen,&nbsp;Hsiu-Ling Chen,&nbsp;Van Tran Kieu Nguyen","doi":"10.1111/jcal.13109","DOIUrl":"https://doi.org/10.1111/jcal.13109","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Social–emotional practices are crucial in today's educational landscape, fostering students' emotional intelligence, resilience and interpersonal skills. Integrating these practices into the gamified flipped classroom approach creates an enriched learning environment. However, there exists a notable research gap regarding the specific implementation and empirical evaluation of social–emotional learning (SEL) strategies within the gamified flipped classroom model specifically tailored for higher education settings.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>This study examined the effects of integrating SEL practices into a gamified flipped-classroom approach (GFLA) on students' emotional regulation, learning achievement, communication, and collaboration tendencies.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>A mixed-methods quasi-experimental design was employed, involving 36 students enrolled in a study skills course at a university in Vietnam. Participants were assigned to either the SEL-enhanced GFLA (SEL-GFLA) group or the GFLA group. The SEL-GFLA group experienced SEL practices such as meditation breathing, compliment before feedback and optimistic closure.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusions</h3>\u0000 \u0000 <p>The findings, analysed using independent <i>t</i>-tests, ANCOVA and thematic analysis, revealed that integrating SEL practices into the gamified flipped classroom approach positively influenced students' emotion regulation, learning achievement, communication tendency, learning competence support and emotional appraisal support. These results have implications for educators and policy makers, highlighting the benefits of incorporating SEL practices into instructional approaches to enhance students' socio-emotional and academic outcomes.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143111205","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring the Role of the Metaverse in English Speaking Proficiency Tests 探讨虚拟世界在英语口语水平测试中的作用
IF 5.1 2区 教育学
Journal of Computer Assisted Learning Pub Date : 2024-12-27 DOI: 10.1111/jcal.13108
Dongkwang Shin, Suh Keong Kwon, Wonjun Izac Noh, Yohan Hwang
{"title":"Exploring the Role of the Metaverse in English Speaking Proficiency Tests","authors":"Dongkwang Shin,&nbsp;Suh Keong Kwon,&nbsp;Wonjun Izac Noh,&nbsp;Yohan Hwang","doi":"10.1111/jcal.13108","DOIUrl":"https://doi.org/10.1111/jcal.13108","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>This study examines the evolution of English speaking proficiency test methods, which have traditionally relied on face-to-face interactions to assess communicative language competence. Recently, computer-based language tests have also been used on a larger scale, albeit with concerns about their impact on measurement.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>This paper investigates the potential of the metaverse in the context of Oral Proficiency Interviews (OPI) for evaluating the speaking proficiency of English learners. Specifically, the research centres on the utilisation of one of the recently emerging metaverse platforms (Zepeto) to conduct OPI tests based on the comparison of the results obtained from the traditional face-to-face tests and an online video conferencing platform (Zoom).</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>A total of 60 EFL young pupils participated in three different speaking tasks via the three modes given in a counter-balanced order. The test scores of the three modes were rated and analysed to examine the degree to which different test modes had an effect on them. A questionnaire with 10 items (plus one sub-question) was used to investigate participants' experiences and perceptions of three speaking assessment modes.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusions</h3>\u0000 \u0000 <p>The results show that test-takers performed significantly better in the metaverse test mode than in the other two modes, while no significant difference was found between the face-to-face and online video conferencing modes. The sub-scores of speaking test criteria such as task completion, pronunciation, language use and fluency were also analysed for comparison, and similar results were found except for the sub-scores of the language use criteria. Responses to the questionnaire also showed that the metaverse platform was the most helpful and preferred mode.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Implications for Practice</h3>\u0000 \u0000 <p>Based on the findings, this study suggests that the new testing modes incorporated with virtual environments have great potential to be alternatives to traditional testing modes.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143119774","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Systematic Literature Review of Technology-Assisted Vocabulary Learning 技术辅助词汇学习的系统文献综述
IF 5.1 2区 教育学
Journal of Computer Assisted Learning Pub Date : 2024-12-26 DOI: 10.1111/jcal.13096
Enzo Simonnet, Mathieu Loiseau, Élise Lavoué
{"title":"A Systematic Literature Review of Technology-Assisted Vocabulary Learning","authors":"Enzo Simonnet,&nbsp;Mathieu Loiseau,&nbsp;Élise Lavoué","doi":"10.1111/jcal.13096","DOIUrl":"https://doi.org/10.1111/jcal.13096","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Vocabulary learning is an essential dimension of foreign language learning. The learners have a huge responsibility in this task. Among other factors, time constraints and an overall lack of maintained motivation on the part of students makes it especially challenging. Consequently, improving vocabulary learning requires strategies to motivate learners and encourage autonomous learning. Technology-Assisted Vocabulary Learning (<span>tavl</span>) aims to provide solutions to this set of problems.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>We aim to provide an overview of the different types of TAVL tools developed and studied since 2015 with regard to (1) tool features, (2) observed variables and research methods used in the studies and (3) impact on learners' vocabulary acquisition, motivation and engagement.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Method</h3>\u0000 \u0000 <p>We conducted a systematic review of the literature between 2015 and 2023 on TAVL. After delineating our field of study and research query, we followed a rigorous methodology to extract relevant papers to answer our research questions. A total of 44 papers of different languages and academic levels were selected for this review.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusions</h3>\u0000 \u0000 <p>We report a wide variety of features provided by TAVL tools in various contexts. We observe an overall positive influence of TAVL tools on learners' vocabulary learning, motivation, flow and engagement. We also discuss potential biases in the studies, which do not allow generalisation of the results. We conclude with recommendations for developers and researchers, including the use of more standardised experimental protocols with comparable measures, the integration of collaborative and social features, and a more central role for teachers and academic learning contexts.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jcal.13096","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143119147","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automating Autograding: Large Language Models as Test Suite Generators for Introductory Programming 自动化自动分级:大型语言模型作为入门编程的测试套件生成器
IF 5.1 2区 教育学
Journal of Computer Assisted Learning Pub Date : 2024-12-25 DOI: 10.1111/jcal.13100
Umar Alkafaween, Ibrahim Albluwi, Paul Denny
{"title":"Automating Autograding: Large Language Models as Test Suite Generators for Introductory Programming","authors":"Umar Alkafaween,&nbsp;Ibrahim Albluwi,&nbsp;Paul Denny","doi":"10.1111/jcal.13100","DOIUrl":"https://doi.org/10.1111/jcal.13100","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background</h3>\u0000 \u0000 <p>Automatically graded programming assignments provide instant feedback to students and significantly reduce manual grading time for instructors. However, creating comprehensive suites of test cases for programming problems within automatic graders can be time-consuming and complex. The effort needed to define test suites may deter some instructors from creating additional problems or lead to inadequate test coverage, potentially resulting in misleading feedback on student solutions. Such limitations may reduce student access to the well-documented benefits of timely feedback when learning programming.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>We evaluate the effectiveness of using Large Language Models (LLMs), as part of a larger workflow, to automatically generate test suites for CS1-level programming problems.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Methods</h3>\u0000 \u0000 <p>Each problem's statement and reference solution are provided to GPT-4 to produce a test suite that can be used by an autograder. We evaluate our proposed approach using a sample of 26 problems, and more than 25,000 attempted solutions to those problems, submitted by students in an introductory programming course. We compare the performance of the LLM-generated test suites against the instructor-created test suites for each problem.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusions</h3>\u0000 \u0000 <p>Our findings reveal that LLM-generated test suites can correctly identify most valid solutions, and for most problems are at least as comprehensive as the instructor test suites. Additionally, the LLM-generated test suites exposed ambiguities in some problem statements, underscoring their potential to improve both autograding and instructional design.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143119006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Correction to ‘Enhancing Experiential Science Learning With Virtual Labs: A Narrative Account of Merits, Challenges and Implementation Strategies’ 对“利用虚拟实验室加强体验式科学学习:优点、挑战和实施策略的叙述”的修正
IF 5.1 2区 教育学
Journal of Computer Assisted Learning Pub Date : 2024-12-25 DOI: 10.1111/jcal.13113
{"title":"Correction to ‘Enhancing Experiential Science Learning With Virtual Labs: A Narrative Account of Merits, Challenges and Implementation Strategies’","authors":"","doi":"10.1111/jcal.13113","DOIUrl":"https://doi.org/10.1111/jcal.13113","url":null,"abstract":"<p>\u0000 <span>Reyes, R. L.</span>, <span>Isleta, K. P.</span>, <span>Regala, J. D.</span>, &amp; <span>Bialba, D. M. R.</span> (<span>2024</span>). <span>Enhancing Experiential Science Learning With Virtual Labs: A Narrative Account of Merits, Challenges, and Implementation Strategies</span>. <i>Journal of Computer Assisted Learning</i>, <span>40</span>(<span>6</span>), <span>3167</span>–<span>3186</span>.\u0000 </p><p>Upon review, it was determined that the project was entirely funded by the National University (NU), Philippines, and their policy mandates listing only NU as the affiliation for research conducted under their funding. Therefore, the affiliation for Dr. Ronald L. Reyes should be corrected to:</p><p>Science and Mathematics, College of Education, Arts and Sciences, National University, Sampaloc, City of Manila, Philippines.</p><p>This correction pertains solely to the administrative detail of author affiliation and does not affect the findings, interpretations or scientific content of the study, which remain unchanged. No changes are necessary for the affiliations of the co-authors.</p><p>We apologise for this error.</p>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jcal.13113","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143119053","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AI-Assisted Assessment of Inquiry Skills in Socioscientific Issue Contexts 社会科学问题背景下探究技能的人工智能辅助评估
IF 5.1 2区 教育学
Journal of Computer Assisted Learning Pub Date : 2024-12-25 DOI: 10.1111/jcal.13102
Wen Xin Zhang, John J. H. Lin, Ying-Shao Hsu
{"title":"AI-Assisted Assessment of Inquiry Skills in Socioscientific Issue Contexts","authors":"Wen Xin Zhang,&nbsp;John J. H. Lin,&nbsp;Ying-Shao Hsu","doi":"10.1111/jcal.13102","DOIUrl":"https://doi.org/10.1111/jcal.13102","url":null,"abstract":"<div>\u0000 \u0000 \u0000 <section>\u0000 \u0000 <h3> Background Study</h3>\u0000 \u0000 <p>Assessing learners' inquiry-based skills is challenging as social, political, and technological dimensions must be considered. The advanced development of artificial intelligence (AI) makes it possible to address these challenges and shape the next generation of science education.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Objectives</h3>\u0000 \u0000 <p>The present study evaluated the SSI inquiry skills of students in an AI-enabled scoring environment. An AI model for socioscientific issues that can assess students' inquiry skills was developed. Responses to a learning module were collected from 1250 participants, and the open-ended responses were rated by humans in accordance with a designed rubric. The collected data were then preprocessed and used to train an AI rater that can process natural language. The effects of two hyperparameters, the dropout rate and complexity of the AI neural network, were evaluated.</p>\u0000 </section>\u0000 \u0000 <section>\u0000 \u0000 <h3> Results and Conclusion</h3>\u0000 \u0000 <p>The results suggested neither of the two hyperparameters was found to strongly affect the accuracy of the AI rater. In general, the human and AI raters exhibited certain levels of agreement; however, agreement varied among rubric categories. Discrepancies were identified and are discussed both quantitatively and qualitatively.</p>\u0000 </section>\u0000 </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1,"publicationDate":"2024-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143119054","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信