四选项选择题中功能性和非功能性干扰因素的评价及其与难度和辨别指标的关系

A. Shakurnia, M. Ghafourian, A. Khodadadi, A. Ghadiri, A. Amari, Moosa Shariffat
{"title":"四选项选择题中功能性和非功能性干扰因素的评价及其与难度和辨别指标的关系","authors":"A. Shakurnia, M. Ghafourian, A. Khodadadi, A. Ghadiri, A. Amari, Moosa Shariffat","doi":"10.21315/eimj2022.14.4.5","DOIUrl":null,"url":null,"abstract":"Multiple-choice questions-one best answer (MCQ-OBA) is the most frequently accepted assessment tool in Iran’s medical universities. Writing functional distractors (FDs) is an important aspect of framing MCQ-OBA. This study aimed to assess FDs and non-functional distractors (NFDs) in MCQ-OBA and the association of distractor efficiency with difficulty and discrimination indices. This cross-sectional study was conducted at the Department of Immunology, the Ahvaz Jundishapur University of Medical Sciences. A total of 734 MCQ-OBA were reviewed, including 2,936 options (2,202 distractors and 734 correct responses). NFDs were defined as options chosen by <5% of examinees. Of the 734 MCQ-OBAs, 265 (36.1%) had 0 NFDs, 231 (31.5%) had 1 NFD, 146 (19.9%) had 2 NFDs, and 92 (12.5%) had 3 NFDs. The Pearson’s correlation showed a significant relationship between the difficulty index and the number of NFDs (r = 0.453; P < 0.0001). However, the correlation between the discrimination index and the number of NFDs was insignificant (r = 0.055; P = 0.135). The findings revealed that NFDs inversely affected the test quality of items. Items with more NFDs were easier and had poorer discriminatory power. The distractor function analysis and revision of NFDs serve as an important method to improve the quality of MCQ-OBA.","PeriodicalId":130340,"journal":{"name":"Education in Medicine Journal","volume":"87 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Evaluating Functional and Non-Functional Distractors and Their Relationship with Difficulty and Discrimination Indices in Four-Option Multiple-Choice Questions\",\"authors\":\"A. Shakurnia, M. Ghafourian, A. Khodadadi, A. Ghadiri, A. Amari, Moosa Shariffat\",\"doi\":\"10.21315/eimj2022.14.4.5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Multiple-choice questions-one best answer (MCQ-OBA) is the most frequently accepted assessment tool in Iran’s medical universities. Writing functional distractors (FDs) is an important aspect of framing MCQ-OBA. This study aimed to assess FDs and non-functional distractors (NFDs) in MCQ-OBA and the association of distractor efficiency with difficulty and discrimination indices. This cross-sectional study was conducted at the Department of Immunology, the Ahvaz Jundishapur University of Medical Sciences. A total of 734 MCQ-OBA were reviewed, including 2,936 options (2,202 distractors and 734 correct responses). NFDs were defined as options chosen by <5% of examinees. Of the 734 MCQ-OBAs, 265 (36.1%) had 0 NFDs, 231 (31.5%) had 1 NFD, 146 (19.9%) had 2 NFDs, and 92 (12.5%) had 3 NFDs. The Pearson’s correlation showed a significant relationship between the difficulty index and the number of NFDs (r = 0.453; P < 0.0001). However, the correlation between the discrimination index and the number of NFDs was insignificant (r = 0.055; P = 0.135). The findings revealed that NFDs inversely affected the test quality of items. Items with more NFDs were easier and had poorer discriminatory power. The distractor function analysis and revision of NFDs serve as an important method to improve the quality of MCQ-OBA.\",\"PeriodicalId\":130340,\"journal\":{\"name\":\"Education in Medicine Journal\",\"volume\":\"87 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Education in Medicine Journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.21315/eimj2022.14.4.5\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Education in Medicine Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.21315/eimj2022.14.4.5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

多项选择题——一个最佳答案(MCQ-OBA)是伊朗医科大学最常接受的评估工具。写作功能干扰是构建MCQ-OBA的一个重要方面。本研究旨在评估MCQ-OBA中的FDs和非功能性分心物(NFDs),以及分心物效率与困难指数和辨别指数的关系。这项横断面研究是在Ahvaz Jundishapur医学科学大学免疫学系进行的。总共审查了734个MCQ-OBA,包括2936个选项(2202个干扰和734个正确回答)。NFDs被定义为少于5%的考生选择的选项。在734例mcq - oba中,265例(36.1%)为0例NFD, 231例(31.5%)为1例NFD, 146例(19.9%)为2例NFD, 92例(12.5%)为3例NFD。Pearson相关分析显示,难度指数与nfd数量之间存在显著相关(r = 0.453;P < 0.0001)。然而,辨别指数与NFDs数量之间的相关性不显著(r = 0.055;P = 0.135)。结果表明,NFDs对项目的测试质量有负相关影响。NFDs较多的项目比较容易,歧视性也较弱。NFDs的牵碍功能分析与修正是提高MCQ-OBA质量的重要手段。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Evaluating Functional and Non-Functional Distractors and Their Relationship with Difficulty and Discrimination Indices in Four-Option Multiple-Choice Questions
Multiple-choice questions-one best answer (MCQ-OBA) is the most frequently accepted assessment tool in Iran’s medical universities. Writing functional distractors (FDs) is an important aspect of framing MCQ-OBA. This study aimed to assess FDs and non-functional distractors (NFDs) in MCQ-OBA and the association of distractor efficiency with difficulty and discrimination indices. This cross-sectional study was conducted at the Department of Immunology, the Ahvaz Jundishapur University of Medical Sciences. A total of 734 MCQ-OBA were reviewed, including 2,936 options (2,202 distractors and 734 correct responses). NFDs were defined as options chosen by <5% of examinees. Of the 734 MCQ-OBAs, 265 (36.1%) had 0 NFDs, 231 (31.5%) had 1 NFD, 146 (19.9%) had 2 NFDs, and 92 (12.5%) had 3 NFDs. The Pearson’s correlation showed a significant relationship between the difficulty index and the number of NFDs (r = 0.453; P < 0.0001). However, the correlation between the discrimination index and the number of NFDs was insignificant (r = 0.055; P = 0.135). The findings revealed that NFDs inversely affected the test quality of items. Items with more NFDs were easier and had poorer discriminatory power. The distractor function analysis and revision of NFDs serve as an important method to improve the quality of MCQ-OBA.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信