Sabine Reiser, Kristina Schick, Sylvia Irene Donata Pittroff, Laura Janssen, Pascal O Berberat, Martin Gartmeier, Johannes Bauer
{"title":"网络情境判断测验中形成性与总结性反馈的整合:反馈设计对医学生动机与认知学习因素的影响","authors":"Sabine Reiser, Kristina Schick, Sylvia Irene Donata Pittroff, Laura Janssen, Pascal O Berberat, Martin Gartmeier, Johannes Bauer","doi":"10.1080/10872981.2026.2639198","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Assessment plays an important role in teaching and learning medical communication. Formative assessment is increasingly recognised as a crucial tool for improving learning outcomes and supporting competence development. In this study, we developed and evaluated different versions of automated formative and summative feedback in an online situational judgement test of basic medical communication competence.</p><p><strong>Methods: </strong>We developed four versions of task-based (formative) feedback, differing in their enrichment strategies (i.e. reflection prompts or expert explanations) and the timing of the feedback (i.e. immediate feedback or post-test feedback), and one performance-based (summative) version featuring a test-score profile. In a randomised controlled trial with <i>N</i> = 269 medical students, we evaluated the effects of feedback design on participants' (i) motivation and (ii) cognitive factors (i.e. cognitive load), as well as on their (iii) feedback perception (e.g. fairness and usefulness of the feedback) and (iv) perceived benefits of the feedback, all of which influence learning. We tested the hypotheses that task-based feedback would be more effective than performance-based feedback (<i>H</i><sub>1</sub>) and that task-based versions would have differential effects on the outcome variables (<i>H</i><sub>2</sub>).</p><p><strong>Results: </strong>Planned contrast analysis revealed that task-based feedback was not consistently more effective than performance-based feedback across all outcomes (<i>H</i><sub>1</sub>). In line with <i>H</i><sub>2</sub>, analyses of variance revealed differential effects of feedback enrichment and timing: expert explanations enhanced cognitive understanding and perceived feedback benefits, whereas post-test feedback improved motivational outcomes such as perceived competence and fairness.</p><p><strong>Conclusions: </strong>The results highlight the complexity of determining an optimal feedback approach, as different implementations can have differential effects on the motivational and cognitive factors that further shape learning processes. The findings suggest that an optimal feedback approach depends on specific learning outcomes and student characteristics, highlighting the importance of careful selection of feedback strategies tailored to specific educational goals and contexts.</p>","PeriodicalId":47656,"journal":{"name":"Medical Education Online","volume":"31 1","pages":"2639198"},"PeriodicalIF":4.4000,"publicationDate":"2026-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12973788/pdf/","citationCount":"0","resultStr":"{\"title\":\"Integrating formative and summative feedback in online situational judgement tests: effects of feedback design on medical students' motivational and cognitive learning factors.\",\"authors\":\"Sabine Reiser, Kristina Schick, Sylvia Irene Donata Pittroff, Laura Janssen, Pascal O Berberat, Martin Gartmeier, Johannes Bauer\",\"doi\":\"10.1080/10872981.2026.2639198\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Assessment plays an important role in teaching and learning medical communication. Formative assessment is increasingly recognised as a crucial tool for improving learning outcomes and supporting competence development. In this study, we developed and evaluated different versions of automated formative and summative feedback in an online situational judgement test of basic medical communication competence.</p><p><strong>Methods: </strong>We developed four versions of task-based (formative) feedback, differing in their enrichment strategies (i.e. reflection prompts or expert explanations) and the timing of the feedback (i.e. immediate feedback or post-test feedback), and one performance-based (summative) version featuring a test-score profile. In a randomised controlled trial with <i>N</i> = 269 medical students, we evaluated the effects of feedback design on participants' (i) motivation and (ii) cognitive factors (i.e. cognitive load), as well as on their (iii) feedback perception (e.g. fairness and usefulness of the feedback) and (iv) perceived benefits of the feedback, all of which influence learning. We tested the hypotheses that task-based feedback would be more effective than performance-based feedback (<i>H</i><sub>1</sub>) and that task-based versions would have differential effects on the outcome variables (<i>H</i><sub>2</sub>).</p><p><strong>Results: </strong>Planned contrast analysis revealed that task-based feedback was not consistently more effective than performance-based feedback across all outcomes (<i>H</i><sub>1</sub>). In line with <i>H</i><sub>2</sub>, analyses of variance revealed differential effects of feedback enrichment and timing: expert explanations enhanced cognitive understanding and perceived feedback benefits, whereas post-test feedback improved motivational outcomes such as perceived competence and fairness.</p><p><strong>Conclusions: </strong>The results highlight the complexity of determining an optimal feedback approach, as different implementations can have differential effects on the motivational and cognitive factors that further shape learning processes. The findings suggest that an optimal feedback approach depends on specific learning outcomes and student characteristics, highlighting the importance of careful selection of feedback strategies tailored to specific educational goals and contexts.</p>\",\"PeriodicalId\":47656,\"journal\":{\"name\":\"Medical Education Online\",\"volume\":\"31 1\",\"pages\":\"2639198\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2026-12-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12973788/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Medical Education Online\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1080/10872981.2026.2639198\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2026/3/2 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical Education Online","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1080/10872981.2026.2639198","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/3/2 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
Integrating formative and summative feedback in online situational judgement tests: effects of feedback design on medical students' motivational and cognitive learning factors.
Background: Assessment plays an important role in teaching and learning medical communication. Formative assessment is increasingly recognised as a crucial tool for improving learning outcomes and supporting competence development. In this study, we developed and evaluated different versions of automated formative and summative feedback in an online situational judgement test of basic medical communication competence.
Methods: We developed four versions of task-based (formative) feedback, differing in their enrichment strategies (i.e. reflection prompts or expert explanations) and the timing of the feedback (i.e. immediate feedback or post-test feedback), and one performance-based (summative) version featuring a test-score profile. In a randomised controlled trial with N = 269 medical students, we evaluated the effects of feedback design on participants' (i) motivation and (ii) cognitive factors (i.e. cognitive load), as well as on their (iii) feedback perception (e.g. fairness and usefulness of the feedback) and (iv) perceived benefits of the feedback, all of which influence learning. We tested the hypotheses that task-based feedback would be more effective than performance-based feedback (H1) and that task-based versions would have differential effects on the outcome variables (H2).
Results: Planned contrast analysis revealed that task-based feedback was not consistently more effective than performance-based feedback across all outcomes (H1). In line with H2, analyses of variance revealed differential effects of feedback enrichment and timing: expert explanations enhanced cognitive understanding and perceived feedback benefits, whereas post-test feedback improved motivational outcomes such as perceived competence and fairness.
Conclusions: The results highlight the complexity of determining an optimal feedback approach, as different implementations can have differential effects on the motivational and cognitive factors that further shape learning processes. The findings suggest that an optimal feedback approach depends on specific learning outcomes and student characteristics, highlighting the importance of careful selection of feedback strategies tailored to specific educational goals and contexts.
期刊介绍:
Medical Education Online is an open access journal of health care education, publishing peer-reviewed research, perspectives, reviews, and early documentation of new ideas and trends.
Medical Education Online aims to disseminate information on the education and training of physicians and other health care professionals. Manuscripts may address any aspect of health care education and training, including, but not limited to:
-Basic science education
-Clinical science education
-Residency education
-Learning theory
-Problem-based learning (PBL)
-Curriculum development
-Research design and statistics
-Measurement and evaluation
-Faculty development
-Informatics/web