A. Shakurnia, M. Ghafourian, A. Khodadadi, A. Ghadiri, A. Amari, Moosa Shariffat
{"title":"四选项选择题中功能性和非功能性干扰因素的评价及其与难度和辨别指标的关系","authors":"A. Shakurnia, M. Ghafourian, A. Khodadadi, A. Ghadiri, A. Amari, Moosa Shariffat","doi":"10.21315/eimj2022.14.4.5","DOIUrl":null,"url":null,"abstract":"Multiple-choice questions-one best answer (MCQ-OBA) is the most frequently accepted assessment tool in Iran’s medical universities. Writing functional distractors (FDs) is an important aspect of framing MCQ-OBA. This study aimed to assess FDs and non-functional distractors (NFDs) in MCQ-OBA and the association of distractor efficiency with difficulty and discrimination indices. This cross-sectional study was conducted at the Department of Immunology, the Ahvaz Jundishapur University of Medical Sciences. A total of 734 MCQ-OBA were reviewed, including 2,936 options (2,202 distractors and 734 correct responses). NFDs were defined as options chosen by <5% of examinees. Of the 734 MCQ-OBAs, 265 (36.1%) had 0 NFDs, 231 (31.5%) had 1 NFD, 146 (19.9%) had 2 NFDs, and 92 (12.5%) had 3 NFDs. The Pearson’s correlation showed a significant relationship between the difficulty index and the number of NFDs (r = 0.453; P < 0.0001). However, the correlation between the discrimination index and the number of NFDs was insignificant (r = 0.055; P = 0.135). The findings revealed that NFDs inversely affected the test quality of items. Items with more NFDs were easier and had poorer discriminatory power. The distractor function analysis and revision of NFDs serve as an important method to improve the quality of MCQ-OBA.","PeriodicalId":130340,"journal":{"name":"Education in Medicine Journal","volume":"87 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Evaluating Functional and Non-Functional Distractors and Their Relationship with Difficulty and Discrimination Indices in Four-Option Multiple-Choice Questions\",\"authors\":\"A. Shakurnia, M. Ghafourian, A. Khodadadi, A. Ghadiri, A. Amari, Moosa Shariffat\",\"doi\":\"10.21315/eimj2022.14.4.5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Multiple-choice questions-one best answer (MCQ-OBA) is the most frequently accepted assessment tool in Iran’s medical universities. Writing functional distractors (FDs) is an important aspect of framing MCQ-OBA. This study aimed to assess FDs and non-functional distractors (NFDs) in MCQ-OBA and the association of distractor efficiency with difficulty and discrimination indices. This cross-sectional study was conducted at the Department of Immunology, the Ahvaz Jundishapur University of Medical Sciences. A total of 734 MCQ-OBA were reviewed, including 2,936 options (2,202 distractors and 734 correct responses). NFDs were defined as options chosen by <5% of examinees. Of the 734 MCQ-OBAs, 265 (36.1%) had 0 NFDs, 231 (31.5%) had 1 NFD, 146 (19.9%) had 2 NFDs, and 92 (12.5%) had 3 NFDs. The Pearson’s correlation showed a significant relationship between the difficulty index and the number of NFDs (r = 0.453; P < 0.0001). However, the correlation between the discrimination index and the number of NFDs was insignificant (r = 0.055; P = 0.135). The findings revealed that NFDs inversely affected the test quality of items. Items with more NFDs were easier and had poorer discriminatory power. The distractor function analysis and revision of NFDs serve as an important method to improve the quality of MCQ-OBA.\",\"PeriodicalId\":130340,\"journal\":{\"name\":\"Education in Medicine Journal\",\"volume\":\"87 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Education in Medicine Journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.21315/eimj2022.14.4.5\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Education in Medicine Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.21315/eimj2022.14.4.5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Evaluating Functional and Non-Functional Distractors and Their Relationship with Difficulty and Discrimination Indices in Four-Option Multiple-Choice Questions
Multiple-choice questions-one best answer (MCQ-OBA) is the most frequently accepted assessment tool in Iran’s medical universities. Writing functional distractors (FDs) is an important aspect of framing MCQ-OBA. This study aimed to assess FDs and non-functional distractors (NFDs) in MCQ-OBA and the association of distractor efficiency with difficulty and discrimination indices. This cross-sectional study was conducted at the Department of Immunology, the Ahvaz Jundishapur University of Medical Sciences. A total of 734 MCQ-OBA were reviewed, including 2,936 options (2,202 distractors and 734 correct responses). NFDs were defined as options chosen by <5% of examinees. Of the 734 MCQ-OBAs, 265 (36.1%) had 0 NFDs, 231 (31.5%) had 1 NFD, 146 (19.9%) had 2 NFDs, and 92 (12.5%) had 3 NFDs. The Pearson’s correlation showed a significant relationship between the difficulty index and the number of NFDs (r = 0.453; P < 0.0001). However, the correlation between the discrimination index and the number of NFDs was insignificant (r = 0.055; P = 0.135). The findings revealed that NFDs inversely affected the test quality of items. Items with more NFDs were easier and had poorer discriminatory power. The distractor function analysis and revision of NFDs serve as an important method to improve the quality of MCQ-OBA.