微软必应（Copilot）设计的多选题的有效性证据

Q2 Social Sciences

Educacion Medica Pub Date : 2024-06-22 DOI:10.1016/j.edumed.2024.100950

Javier A. Flores-Cohaila , Ramón Ruesta-Bermejo , Carlos Gutierrez-Rios , Carlos Ramos-Godoy , Brayan Miranda-Chávez , Cesar Copaja-Corzo

{"title":"微软必应（Copilot）设计的多选题的有效性证据","authors":"Javier A. Flores-Cohaila , Ramón Ruesta-Bermejo , Carlos Gutierrez-Rios , Carlos Ramos-Godoy , Brayan Miranda-Chávez , Cesar Copaja-Corzo","doi":"10.1016/j.edumed.2024.100950","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><p>To design multiple-choice questions (MCQs) using Microsoft Bing (Copilot) and evaluate their quality and psychometric indices in medical education.</p></div><div><h3>Materials and methods</h3><p>A 180-question exam was designed using Microsoft Bing. It was evaluated by medical educators in terms of relevance and distractor quality. After administering the exam to students, difficulty and discrimination indices were calculated.</p></div><div><h3>Results</h3><p>Most questions were highly relevant, and the distractors were of high quality. The discrimination and difficulty indices were acceptable for the majority of the questions.</p></div><div><h3>Conclusion</h3><p>Microsoft Bing (Copilot) could be used as a substitute for ChatGPT in designing MCQs, given the evidence of validity collected in the study.</p></div>","PeriodicalId":35317,"journal":{"name":"Educacion Medica","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1575181324000652/pdfft?md5=191fa1f10f04cd585b5ef4207da533b6&pid=1-s2.0-S1575181324000652-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Evidencias de validez de las preguntas de opción múltiple diseñadas por Microsoft Bing (Copilot)\",\"authors\":\"Javier A. Flores-Cohaila , Ramón Ruesta-Bermejo , Carlos Gutierrez-Rios , Carlos Ramos-Godoy , Brayan Miranda-Chávez , Cesar Copaja-Corzo\",\"doi\":\"10.1016/j.edumed.2024.100950\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Introduction</h3><p>To design multiple-choice questions (MCQs) using Microsoft Bing (Copilot) and evaluate their quality and psychometric indices in medical education.</p></div><div><h3>Materials and methods</h3><p>A 180-question exam was designed using Microsoft Bing. It was evaluated by medical educators in terms of relevance and distractor quality. After administering the exam to students, difficulty and discrimination indices were calculated.</p></div><div><h3>Results</h3><p>Most questions were highly relevant, and the distractors were of high quality. The discrimination and difficulty indices were acceptable for the majority of the questions.</p></div><div><h3>Conclusion</h3><p>Microsoft Bing (Copilot) could be used as a substitute for ChatGPT in designing MCQs, given the evidence of validity collected in the study.</p></div>\",\"PeriodicalId\":35317,\"journal\":{\"name\":\"Educacion Medica\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S1575181324000652/pdfft?md5=191fa1f10f04cd585b5ef4207da533b6&pid=1-s2.0-S1575181324000652-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Educacion Medica\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1575181324000652\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"Social Sciences\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Educacion Medica","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1575181324000652","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Social Sciences","Score":null,"Total":0}

引用次数: 0

摘要

材料和方法使用微软必应（Copilot）设计了 180 道选择题（MCQ），并对其质量和医学教育中的心理测量指标进行了评估。医学教育工作者对其相关性和干扰项质量进行了评估。在对学生进行考试后，计算了难度和区分度指数。结论鉴于本研究收集到的有效性证据，微软必应（Copilot）可在设计 MCQ 时替代 ChatGPT。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Evidencias de validez de las preguntas de opción múltiple diseñadas por Microsoft Bing (Copilot)

Introduction

To design multiple-choice questions (MCQs) using Microsoft Bing (Copilot) and evaluate their quality and psychometric indices in medical education.

Materials and methods

A 180-question exam was designed using Microsoft Bing. It was evaluated by medical educators in terms of relevance and distractor quality. After administering the exam to students, difficulty and discrimination indices were calculated.

Results

Most questions were highly relevant, and the distractors were of high quality. The discrimination and difficulty indices were acceptable for the majority of the questions.

Conclusion

Microsoft Bing (Copilot) could be used as a substitute for ChatGPT in designing MCQs, given the evidence of validity collected in the study.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Educacion Medica Social Sciences-Education

CiteScore

2.60

自引率

0.00%

发文量

审稿时长

63 days

期刊介绍： Educación Médica, revista trimestral que se viene publicando desde 1998 es editada desde enero de 2003 por la Fundación Educación Médica. Pretende contribuir a la difusión de los estudios y trabajos que en este campo se están llevando a cabo en todo el mundo, pero de una manera especial en nuestro entorno. Los artículos de Educación Médica tratarán tanto sobre aspectos prácticos de la docencia en su día a día como sobre cuestiones más teóricas de la educación médica. Así mismo, la revista intentará proporcionar análisis y opiniones de expertos de reconocido prestigio internacional.