网络情境判断测验中形成性与总结性反馈的整合:反馈设计对医学生动机与认知学习因素的影响

IF 4.4 2区 医学 Q1 EDUCATION & EDUCATIONAL RESEARCH
Medical Education Online Pub Date : 2026-12-31 Epub Date: 2026-03-02 DOI:10.1080/10872981.2026.2639198
Sabine Reiser, Kristina Schick, Sylvia Irene Donata Pittroff, Laura Janssen, Pascal O Berberat, Martin Gartmeier, Johannes Bauer
{"title":"网络情境判断测验中形成性与总结性反馈的整合:反馈设计对医学生动机与认知学习因素的影响","authors":"Sabine Reiser, Kristina Schick, Sylvia Irene Donata Pittroff, Laura Janssen, Pascal O Berberat, Martin Gartmeier, Johannes Bauer","doi":"10.1080/10872981.2026.2639198","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Assessment plays an important role in teaching and learning medical communication. Formative assessment is increasingly recognised as a crucial tool for improving learning outcomes and supporting competence development. In this study, we developed and evaluated different versions of automated formative and summative feedback in an online situational judgement test of basic medical communication competence.</p><p><strong>Methods: </strong>We developed four versions of task-based (formative) feedback, differing in their enrichment strategies (i.e. reflection prompts or expert explanations) and the timing of the feedback (i.e. immediate feedback or post-test feedback), and one performance-based (summative) version featuring a test-score profile. In a randomised controlled trial with <i>N</i> = 269 medical students, we evaluated the effects of feedback design on participants' (i) motivation and (ii) cognitive factors (i.e. cognitive load), as well as on their (iii) feedback perception (e.g. fairness and usefulness of the feedback) and (iv) perceived benefits of the feedback, all of which influence learning. We tested the hypotheses that task-based feedback would be more effective than performance-based feedback (<i>H</i><sub>1</sub>) and that task-based versions would have differential effects on the outcome variables (<i>H</i><sub>2</sub>).</p><p><strong>Results: </strong>Planned contrast analysis revealed that task-based feedback was not consistently more effective than performance-based feedback across all outcomes (<i>H</i><sub>1</sub>). In line with <i>H</i><sub>2</sub>, analyses of variance revealed differential effects of feedback enrichment and timing: expert explanations enhanced cognitive understanding and perceived feedback benefits, whereas post-test feedback improved motivational outcomes such as perceived competence and fairness.</p><p><strong>Conclusions: </strong>The results highlight the complexity of determining an optimal feedback approach, as different implementations can have differential effects on the motivational and cognitive factors that further shape learning processes. The findings suggest that an optimal feedback approach depends on specific learning outcomes and student characteristics, highlighting the importance of careful selection of feedback strategies tailored to specific educational goals and contexts.</p>","PeriodicalId":47656,"journal":{"name":"Medical Education Online","volume":"31 1","pages":"2639198"},"PeriodicalIF":4.4000,"publicationDate":"2026-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12973788/pdf/","citationCount":"0","resultStr":"{\"title\":\"Integrating formative and summative feedback in online situational judgement tests: effects of feedback design on medical students' motivational and cognitive learning factors.\",\"authors\":\"Sabine Reiser, Kristina Schick, Sylvia Irene Donata Pittroff, Laura Janssen, Pascal O Berberat, Martin Gartmeier, Johannes Bauer\",\"doi\":\"10.1080/10872981.2026.2639198\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Assessment plays an important role in teaching and learning medical communication. Formative assessment is increasingly recognised as a crucial tool for improving learning outcomes and supporting competence development. In this study, we developed and evaluated different versions of automated formative and summative feedback in an online situational judgement test of basic medical communication competence.</p><p><strong>Methods: </strong>We developed four versions of task-based (formative) feedback, differing in their enrichment strategies (i.e. reflection prompts or expert explanations) and the timing of the feedback (i.e. immediate feedback or post-test feedback), and one performance-based (summative) version featuring a test-score profile. In a randomised controlled trial with <i>N</i> = 269 medical students, we evaluated the effects of feedback design on participants' (i) motivation and (ii) cognitive factors (i.e. cognitive load), as well as on their (iii) feedback perception (e.g. fairness and usefulness of the feedback) and (iv) perceived benefits of the feedback, all of which influence learning. We tested the hypotheses that task-based feedback would be more effective than performance-based feedback (<i>H</i><sub>1</sub>) and that task-based versions would have differential effects on the outcome variables (<i>H</i><sub>2</sub>).</p><p><strong>Results: </strong>Planned contrast analysis revealed that task-based feedback was not consistently more effective than performance-based feedback across all outcomes (<i>H</i><sub>1</sub>). In line with <i>H</i><sub>2</sub>, analyses of variance revealed differential effects of feedback enrichment and timing: expert explanations enhanced cognitive understanding and perceived feedback benefits, whereas post-test feedback improved motivational outcomes such as perceived competence and fairness.</p><p><strong>Conclusions: </strong>The results highlight the complexity of determining an optimal feedback approach, as different implementations can have differential effects on the motivational and cognitive factors that further shape learning processes. The findings suggest that an optimal feedback approach depends on specific learning outcomes and student characteristics, highlighting the importance of careful selection of feedback strategies tailored to specific educational goals and contexts.</p>\",\"PeriodicalId\":47656,\"journal\":{\"name\":\"Medical Education Online\",\"volume\":\"31 1\",\"pages\":\"2639198\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2026-12-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12973788/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Medical Education Online\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1080/10872981.2026.2639198\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2026/3/2 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical Education Online","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1080/10872981.2026.2639198","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/3/2 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0

摘要

背景:评价在医学交际教学中起着重要的作用。形成性评估越来越被认为是改善学习成果和支持能力发展的重要工具。在本研究中,我们开发并评估了不同版本的自动形成性和总结性反馈在一个在线情境判断测试的基本医疗沟通能力。方法:我们开发了四个版本的基于任务的(形成性)反馈,不同于它们的丰富策略(即反思提示或专家解释)和反馈的时间(即即时反馈或测试后反馈),一个基于表现的(总结性)版本以测试分数为特征。在一项有N = 269名医学生的随机对照试验中,我们评估了反馈设计对参与者(i)动机和(ii)认知因素(即认知负荷)的影响,以及对他们(iii)反馈感知(例如反馈的公平性和有用性)和(iv)反馈感知收益的影响,所有这些都影响学习。我们测试了基于任务的反馈比基于绩效的反馈(H1)更有效的假设,以及基于任务的版本会对结果变量产生不同的影响(H2)。结果:计划对比分析显示,在所有结果中,基于任务的反馈并不总是比基于绩效的反馈更有效(H1)。与H2一致,方差分析揭示了反馈丰富度和时间的差异效应:专家解释增强了认知理解和感知反馈利益,而测试后反馈提高了感知能力和公平等动机结果。结论:研究结果强调了确定最佳反馈方法的复杂性,因为不同的实施方式会对进一步塑造学习过程的动机和认知因素产生不同的影响。研究结果表明,最佳的反馈方法取决于具体的学习成果和学生的特点,强调了根据具体的教育目标和环境精心选择反馈策略的重要性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Integrating formative and summative feedback in online situational judgement tests: effects of feedback design on medical students' motivational and cognitive learning factors.

Background: Assessment plays an important role in teaching and learning medical communication. Formative assessment is increasingly recognised as a crucial tool for improving learning outcomes and supporting competence development. In this study, we developed and evaluated different versions of automated formative and summative feedback in an online situational judgement test of basic medical communication competence.

Methods: We developed four versions of task-based (formative) feedback, differing in their enrichment strategies (i.e. reflection prompts or expert explanations) and the timing of the feedback (i.e. immediate feedback or post-test feedback), and one performance-based (summative) version featuring a test-score profile. In a randomised controlled trial with N = 269 medical students, we evaluated the effects of feedback design on participants' (i) motivation and (ii) cognitive factors (i.e. cognitive load), as well as on their (iii) feedback perception (e.g. fairness and usefulness of the feedback) and (iv) perceived benefits of the feedback, all of which influence learning. We tested the hypotheses that task-based feedback would be more effective than performance-based feedback (H1) and that task-based versions would have differential effects on the outcome variables (H2).

Results: Planned contrast analysis revealed that task-based feedback was not consistently more effective than performance-based feedback across all outcomes (H1). In line with H2, analyses of variance revealed differential effects of feedback enrichment and timing: expert explanations enhanced cognitive understanding and perceived feedback benefits, whereas post-test feedback improved motivational outcomes such as perceived competence and fairness.

Conclusions: The results highlight the complexity of determining an optimal feedback approach, as different implementations can have differential effects on the motivational and cognitive factors that further shape learning processes. The findings suggest that an optimal feedback approach depends on specific learning outcomes and student characteristics, highlighting the importance of careful selection of feedback strategies tailored to specific educational goals and contexts.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Medical Education Online
Medical Education Online EDUCATION & EDUCATIONAL RESEARCH-
CiteScore
6.00
自引率
2.20%
发文量
97
审稿时长
8 weeks
期刊介绍: Medical Education Online is an open access journal of health care education, publishing peer-reviewed research, perspectives, reviews, and early documentation of new ideas and trends. Medical Education Online aims to disseminate information on the education and training of physicians and other health care professionals. Manuscripts may address any aspect of health care education and training, including, but not limited to: -Basic science education -Clinical science education -Residency education -Learning theory -Problem-based learning (PBL) -Curriculum development -Research design and statistics -Measurement and evaluation -Faculty development -Informatics/web
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书