Optimizing testing feedback in introductory chemistry: a multi-treatment study exploring varying levels of assessment feedback and subsequent performance†

IF 2.6 2区 教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH
Kristen L. Murphy, David G. Schreurs, Melonie A. Teichert, Cynthia J. Luxford, Jaclyn M. Trate, Jordan T. Harshmann and Jamie L. Schneider
{"title":"Optimizing testing feedback in introductory chemistry: a multi-treatment study exploring varying levels of assessment feedback and subsequent performance†","authors":"Kristen L. Murphy, David G. Schreurs, Melonie A. Teichert, Cynthia J. Luxford, Jaclyn M. Trate, Jordan T. Harshmann and Jamie L. Schneider","doi":"10.1039/D4RP00077C","DOIUrl":null,"url":null,"abstract":"<p >Providing students with feedback on their performance is a critical part of enhancing student learning in chemistry and is often integrated into homework assignments, quizzes, and exams. However, not all feedback is created equal, and the type of feedback the student receives can dramatically alter the utility of the feedback to reinforce correct processes and assist in correcting incorrect processes. This work seeks to establish a ranking of how eleven different types of testing feedback affected student retention or growth in performance on multiple-choice general chemistry questions. These feedback methods ranged from simple noncorrective feedback to more complex and engaging elaborative feedback. A test-retest model was used with a one-week gap between the initial test and following test in general chemistry I. Data collection took place at multiple institutions over multiple years. Data analysis used four distinct grading schemes to estimate student performance. These grading schemes included dichotomous scoring, two polytomous scoring techniques, and the use of item response theory to estimate students’ true score. Data were modeled using hierarchical linear modeling which was set up to control for any differences in initial abilities and to determine the growth in performance associated with each treatment. Results indicated that when delayed elaborative feedback was paired with students being asked to recall/rework the problem, the largest student growth was observed. To dive deeper into student growth, both the differences in specific content-area improvement and the ability levels of students who improved the most were analyzed.</p>","PeriodicalId":69,"journal":{"name":"Chemistry Education Research and Practice","volume":" 4","pages":" 1018-1029"},"PeriodicalIF":2.6000,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chemistry Education Research and Practice","FirstCategoryId":"95","ListUrlMain":"https://pubs.rsc.org/en/content/articlelanding/2024/rp/d4rp00077c","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0

Abstract

Providing students with feedback on their performance is a critical part of enhancing student learning in chemistry and is often integrated into homework assignments, quizzes, and exams. However, not all feedback is created equal, and the type of feedback the student receives can dramatically alter the utility of the feedback to reinforce correct processes and assist in correcting incorrect processes. This work seeks to establish a ranking of how eleven different types of testing feedback affected student retention or growth in performance on multiple-choice general chemistry questions. These feedback methods ranged from simple noncorrective feedback to more complex and engaging elaborative feedback. A test-retest model was used with a one-week gap between the initial test and following test in general chemistry I. Data collection took place at multiple institutions over multiple years. Data analysis used four distinct grading schemes to estimate student performance. These grading schemes included dichotomous scoring, two polytomous scoring techniques, and the use of item response theory to estimate students’ true score. Data were modeled using hierarchical linear modeling which was set up to control for any differences in initial abilities and to determine the growth in performance associated with each treatment. Results indicated that when delayed elaborative feedback was paired with students being asked to recall/rework the problem, the largest student growth was observed. To dive deeper into student growth, both the differences in specific content-area improvement and the ability levels of students who improved the most were analyzed.

优化化学入门测试反馈:探索不同评估反馈水平和后续成绩的多重处理研究
向学生提供有关其表现的反馈是提高学生化学学习效果的关键部分,通常会将其纳 入家庭作业、小测验和考试中。然而,并非所有的反馈都是一样的,学生收到的反馈类型会极大地改变反馈在强化正确过程和帮助纠正错误过程方面的效用。本研究试图对 11 种不同类型的测试反馈如何影响学生在普通化学选择题上的成绩保持或增长进行排序。这些反馈方法既有简单的非纠正性反馈,也有更复杂、更吸引人的详细反馈。在普通化学(一)的初始测试和后续测试之间有一周的间隔,采用了重测模型。数据分析采用了四种不同的评分标准来估算学生的成绩。这些评分方案包括二分法评分、两种多分法评分技术,以及使用项目反应理论来估计学生的真实得分。采用分层线性建模法对数据进行建模,以控制初始能力的差异,并确定与每种处理方法相关的成绩增长情况。结果表明,当延迟详细反馈与要求学生回忆/重做问题相结合时,观察到的学生增长幅度最大。为了更深入地了解学生的成长情况,我们对具体内容领域的进步差异和进步最大的学生的能力水平进行了分析。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
4.80
自引率
26.70%
发文量
64
审稿时长
6-12 weeks
期刊介绍: The journal for teachers, researchers and other practitioners in chemistry education.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信