Effectiveness of Feedback Based on Log File Analysis in Introductory Programming Courses

IF 4 2区教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Journal of Educational Computing Research Pub Date : 2022-10-25 DOI:10.1177/07356331221132651

Heidi Meier, M. Lepp

{"title":"Effectiveness of Feedback Based on Log File Analysis in Introductory Programming Courses","authors":"Heidi Meier, M. Lepp","doi":"10.1177/07356331221132651","DOIUrl":null,"url":null,"abstract":"Especially in large courses, feedback is often given only on the final results; less attention is paid to the programming process. Today, however, some programming environments, e.g., Thonny, log activities during programming and have the functionality of replaying the programming process. This information can be used to provide feedback, and this knowledge can be integrated into practical sessions in the classroom. This study aimed to analyse how feedback based on logs affects exam results, task completion time, the number of runs, error messages, and pastes (of the whole group and beginners and non-beginners separately). An experiment was conducted in 2020 and 2021 in the course “Introduction to Programming”. Some groups received additional feedback on homework throughout the course based on log information; the remaining groups worked as usual. Based on the information received from the logs, general recommendations were also offered in the practical sessions. Our study showed that feedback based on logs improved mainly exam test results and programming task solving time among beginners. Therefore, it would be a good method to use, especially in beginner groups.","PeriodicalId":47865,"journal":{"name":"Journal of Educational Computing Research","volume":"39 1","pages":"696 - 719"},"PeriodicalIF":4.0000,"publicationDate":"2022-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Educational Computing Research","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1177/07356331221132651","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}

引用次数: 0

Abstract

Especially in large courses, feedback is often given only on the final results; less attention is paid to the programming process. Today, however, some programming environments, e.g., Thonny, log activities during programming and have the functionality of replaying the programming process. This information can be used to provide feedback, and this knowledge can be integrated into practical sessions in the classroom. This study aimed to analyse how feedback based on logs affects exam results, task completion time, the number of runs, error messages, and pastes (of the whole group and beginners and non-beginners separately). An experiment was conducted in 2020 and 2021 in the course “Introduction to Programming”. Some groups received additional feedback on homework throughout the course based on log information; the remaining groups worked as usual. Based on the information received from the logs, general recommendations were also offered in the practical sessions. Our study showed that feedback based on logs improved mainly exam test results and programming task solving time among beginners. Therefore, it would be a good method to use, especially in beginner groups.

查看原文本刊更多论文

基于日志文件分析的反馈在程序设计入门课程中的有效性

特别是在大型课程中，反馈通常只针对最终结果;对编程过程的关注较少。然而，今天，一些编程环境，例如，anthony，在编程过程中记录活动，并具有重放编程过程的功能。这些信息可以用来提供反馈，这些知识可以整合到课堂上的实践课程中。本研究旨在分析基于日志的反馈如何影响考试成绩、任务完成时间、运行次数、错误信息和粘贴(整个组、初学者和非初学者分别)。在“编程入门”课程中，在2020年和2021年进行了实验。一些小组在整个课程中根据日志信息收到了关于作业的额外反馈;其余的小组照常工作。根据从日志收到的资料，实务会议也提出了一般性建议。我们的研究表明，基于日志的反馈主要提高了初学者的考试成绩和编程任务解决时间。因此，这将是一个很好的方法，特别是在初学者群体中。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Educational Computing Research EDUCATION & EDUCATIONAL RESEARCH-

CiteScore

11.90

自引率

6.20%

发文量

期刊介绍： The goal of this Journal is to provide an international scholarly publication forum for peer-reviewed interdisciplinary research into the applications, effects, and implications of computer-based education. The Journal features articles useful for practitioners and theorists alike. The terms "education" and "computing" are viewed broadly. “Education” refers to the use of computer-based technologies at all levels of the formal education system, business and industry, home-schooling, lifelong learning, and unintentional learning environments. “Computing” refers to all forms of computer applications and innovations - both hardware and software. For example, this could range from mobile and ubiquitous computing to immersive 3D simulations and games to computing-enhanced virtual learning environments.