Improving student outcomes using automated feedback in a first-year economics class

IF 16.4 1区化学 Q1 CHEMISTRY, MULTIDISCIPLINARY

Accounts of Chemical Research Pub Date : 2024-09-26 DOI:10.1016/j.iree.2024.100303

Sinead Huskisson , Tom O'Mahony , Seán Lacey

{"title":"Improving student outcomes using automated feedback in a first-year economics class","authors":"Sinead Huskisson , Tom O'Mahony , Seán Lacey","doi":"10.1016/j.iree.2024.100303","DOIUrl":null,"url":null,"abstract":"<div><div>The assessment literature advocates utilising formative assessment strategies to support and enhance student learning. This study uses online practice tests with inbuilt feedback, that students could repeatedly use, as a formative feedback strategy in a first-year introductory microeconomics module. The key question explored is whether repeated engagement with online practice tests had a statistically significant impact on students’ subsequent performance on a summative assessment. Quantitative engagement and performance data (N = 223) were collected from a cohort of first-year students. An analysis of this data reveals that engaging with the online practice test multiple times has a statistically significant impact on final performance. Controlling for the mid-term grade, on average, each cycle of ‘seeking and acting’ increases grades in the final exam by 1.3 % (p = 0.003). Hence, the data suggests that incorporating multiple opportunities to take an online practice test, which includes feedback, is an important feature of the strategy. A smaller sample of qualitative survey data (N = 131) reveals that these economics students hold traditional views of feedback with little awareness of their own role in seeking and acting on feedback. We argue that formative practice tests have the potential to support the development of student feedback literacy.</div></div>","PeriodicalId":1,"journal":{"name":"Accounts of Chemical Research","volume":null,"pages":null},"PeriodicalIF":16.4000,"publicationDate":"2024-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accounts of Chemical Research","FirstCategoryId":"96","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1477388024000215","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}

引用次数: 0

Abstract

The assessment literature advocates utilising formative assessment strategies to support and enhance student learning. This study uses online practice tests with inbuilt feedback, that students could repeatedly use, as a formative feedback strategy in a first-year introductory microeconomics module. The key question explored is whether repeated engagement with online practice tests had a statistically significant impact on students’ subsequent performance on a summative assessment. Quantitative engagement and performance data (N = 223) were collected from a cohort of first-year students. An analysis of this data reveals that engaging with the online practice test multiple times has a statistically significant impact on final performance. Controlling for the mid-term grade, on average, each cycle of ‘seeking and acting’ increases grades in the final exam by 1.3 % (p = 0.003). Hence, the data suggests that incorporating multiple opportunities to take an online practice test, which includes feedback, is an important feature of the strategy. A smaller sample of qualitative survey data (N = 131) reveals that these economics students hold traditional views of feedback with little awareness of their own role in seeking and acting on feedback. We argue that formative practice tests have the potential to support the development of student feedback literacy.

查看原文本刊更多论文

在一年级经济学课堂上利用自动反馈提高学生成绩

评估文献提倡利用形成性评估策略来支持和促进学生的学习。本研究在一年级微观经济学入门模块中使用了带有内置反馈的在线练习测试作为形成性反馈策略，学生可以反复使用。探讨的关键问题是，反复参与在线练习测试是否会对学生随后在终结性评估中的表现产生统计学意义上的显著影响。我们收集了一批一年级学生的参与和成绩数据（N = 223）。对这些数据的分析表明，多次参与在线练习测试对期末成绩有显著影响。在不考虑期中成绩的情况下，平均而言，每个 "寻求和行动 "周期都会使期末考试成绩提高 1.3%（p = 0.003）。因此，数据表明，包含反馈在内的多次在线模拟考试机会是该策略的一个重要特点。较小样本的定性调查数据（N = 131）显示，这些经济学学生对反馈持有传统观念，很少意识到自己在寻求反馈和根据反馈采取行动方面的作用。我们认为，形成性练习测试具有支持学生反馈素养发展的潜力。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Accounts of Chemical Research 化学-化学综合

CiteScore

31.40

自引率

1.10%

发文量

312

审稿时长

2 months

期刊介绍： Accounts of Chemical Research presents short, concise and critical articles offering easy-to-read overviews of basic research and applications in all areas of chemistry and biochemistry. These short reviews focus on research from the author’s own laboratory and are designed to teach the reader about a research project. In addition, Accounts of Chemical Research publishes commentaries that give an informed opinion on a current research problem. Special Issues online are devoted to a single topic of unusual activity and significance. Accounts of Chemical Research replaces the traditional article abstract with an article "Conspectus." These entries synopsize the research affording the reader a closer look at the content and significance of an article. Through this provision of a more detailed description of the article contents, the Conspectus enhances the article's discoverability by search engines and the exposure for the research.