Using artificial intelligence to provide a 'flipped assessment' approach to medical education learning opportunities.

IF 3.3 2区 教育学 Q1 EDUCATION, SCIENTIFIC DISCIPLINES
Samuel Birks, James Gray, Claire Darling-Pomranz
{"title":"Using artificial intelligence to provide a 'flipped assessment' approach to medical education learning opportunities.","authors":"Samuel Birks, James Gray, Claire Darling-Pomranz","doi":"10.1080/0142159X.2024.2434101","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose of the article: </strong>Generative AI can potentially streamline the creation of practice exam questions. This study sought to evaluate medical students' confidence using generative AI for this purpose, and overall attitudes towards its use.</p><p><strong>Materials and methods: </strong>The study used a mixed-methods approach with a pre-post intervention design. 68 medical and physician associate students were recruited to attend a workshop where they were shown how to use Google Bard (now Gemini) to write exam questions before being encouraged to do this themselves with guidance. A survey was completed before and after. Seven students also participated in a follow-up focus group.</p><p><strong>Results: </strong>The results showed an increase in participants' confidence in using AI to write practice exam questions (<i>p</i> < 0.001) after the workshop. Qualitative feedback highlighted pros and cons of using generative AI to write exam questions, alongside some concerns about its implementation. Students noted other positive uses in the curriculum and expressed a desire for institutional clarity on appropriate AI use.</p><p><strong>Conclusions: </strong>While increased confidence is positive, rigorous evaluation of AI-generated question quality is needed to confirm accuracy. Teaching students to use generative AI to create and critique practice questions represents a means of encouraging appropriate AI use.</p>","PeriodicalId":18643,"journal":{"name":"Medical Teacher","volume":" ","pages":"1-8"},"PeriodicalIF":3.3000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical Teacher","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1080/0142159X.2024.2434101","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose of the article: Generative AI can potentially streamline the creation of practice exam questions. This study sought to evaluate medical students' confidence using generative AI for this purpose, and overall attitudes towards its use.

Materials and methods: The study used a mixed-methods approach with a pre-post intervention design. 68 medical and physician associate students were recruited to attend a workshop where they were shown how to use Google Bard (now Gemini) to write exam questions before being encouraged to do this themselves with guidance. A survey was completed before and after. Seven students also participated in a follow-up focus group.

Results: The results showed an increase in participants' confidence in using AI to write practice exam questions (p < 0.001) after the workshop. Qualitative feedback highlighted pros and cons of using generative AI to write exam questions, alongside some concerns about its implementation. Students noted other positive uses in the curriculum and expressed a desire for institutional clarity on appropriate AI use.

Conclusions: While increased confidence is positive, rigorous evaluation of AI-generated question quality is needed to confirm accuracy. Teaching students to use generative AI to create and critique practice questions represents a means of encouraging appropriate AI use.

利用人工智能为医学教育学习机会提供“翻转评估”方法。
本文目的:生成式人工智能可以潜在地简化练习题的创建。本研究旨在评估医学生为此目的使用生成式人工智能的信心,以及对其使用的总体态度。材料和方法:本研究采用干预前后设计的混合方法。68名医学和医师助理学生被招募参加一个研讨会,在那里他们被展示如何使用b谷歌巴德(现在的双子座)来写考试问题,然后被鼓励在指导下自己做。前后都完成了一项调查。七名学生还参加了一个后续焦点小组。结果:结果显示参与者使用人工智能编写练习考试问题的信心增加(p结论:虽然信心增加是积极的,但需要对人工智能生成的问题质量进行严格评估以确认准确性。教学生使用生成式人工智能来创建和评论实践问题是鼓励适当使用人工智能的一种手段。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Medical Teacher
Medical Teacher 医学-卫生保健
CiteScore
7.80
自引率
8.50%
发文量
396
审稿时长
3-6 weeks
期刊介绍: Medical Teacher provides accounts of new teaching methods, guidance on structuring courses and assessing achievement, and serves as a forum for communication between medical teachers and those involved in general education. In particular, the journal recognizes the problems teachers have in keeping up-to-date with the developments in educational methods that lead to more effective teaching and learning at a time when the content of the curriculum—from medical procedures to policy changes in health care provision—is also changing. The journal features reports of innovation and research in medical education, case studies, survey articles, practical guidelines, reviews of current literature and book reviews. All articles are peer reviewed.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信