{"title":"似是而非的选项的特征:基于同义词的词汇测试中的干扰因素似是而非","authors":"Ulrich Ludewig, Jakob Schwerter, Nele McElvany","doi":"10.1177/07342829231167892","DOIUrl":null,"url":null,"abstract":"A better understanding of how distractor features influence the plausibility of distractors is essential for an efficient multiple-choice (MC) item construction in educational assessment. The plausibility of distractors has a major influence on the psychometric characteristics of MC items. Our analysis utilizes the nominal categories model to investigate German fourth graders' (N = 924) selection of response options in a German MC Vocabulary test. We used principles from cognitive psychology to identify relevant option features capturing the option’s potential to distract students from the correct answer. The results show that only a few option characteristics explain option choice behavior to a large extent. Options with distracting features (i.e., semantic relatedness and orthographic similarity) increase the item difficulty and discrimination, whereas distractors that are less synonym than the attractor decrease item discrimination. Implications for test score interpretations and item construction guidelines are highlighted.","PeriodicalId":51446,"journal":{"name":"Journal of Psychoeducational Assessment","volume":null,"pages":null},"PeriodicalIF":1.5000,"publicationDate":"2023-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"The Features of Plausible but Incorrect Options: Distractor Plausibility in Synonym-Based Vocabulary Tests\",\"authors\":\"Ulrich Ludewig, Jakob Schwerter, Nele McElvany\",\"doi\":\"10.1177/07342829231167892\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"A better understanding of how distractor features influence the plausibility of distractors is essential for an efficient multiple-choice (MC) item construction in educational assessment. The plausibility of distractors has a major influence on the psychometric characteristics of MC items. Our analysis utilizes the nominal categories model to investigate German fourth graders' (N = 924) selection of response options in a German MC Vocabulary test. We used principles from cognitive psychology to identify relevant option features capturing the option’s potential to distract students from the correct answer. The results show that only a few option characteristics explain option choice behavior to a large extent. Options with distracting features (i.e., semantic relatedness and orthographic similarity) increase the item difficulty and discrimination, whereas distractors that are less synonym than the attractor decrease item discrimination. Implications for test score interpretations and item construction guidelines are highlighted.\",\"PeriodicalId\":51446,\"journal\":{\"name\":\"Journal of Psychoeducational Assessment\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2023-04-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Psychoeducational Assessment\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1177/07342829231167892\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"PSYCHOLOGY, EDUCATIONAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Psychoeducational Assessment","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/07342829231167892","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PSYCHOLOGY, EDUCATIONAL","Score":null,"Total":0}
The Features of Plausible but Incorrect Options: Distractor Plausibility in Synonym-Based Vocabulary Tests
A better understanding of how distractor features influence the plausibility of distractors is essential for an efficient multiple-choice (MC) item construction in educational assessment. The plausibility of distractors has a major influence on the psychometric characteristics of MC items. Our analysis utilizes the nominal categories model to investigate German fourth graders' (N = 924) selection of response options in a German MC Vocabulary test. We used principles from cognitive psychology to identify relevant option features capturing the option’s potential to distract students from the correct answer. The results show that only a few option characteristics explain option choice behavior to a large extent. Options with distracting features (i.e., semantic relatedness and orthographic similarity) increase the item difficulty and discrimination, whereas distractors that are less synonym than the attractor decrease item discrimination. Implications for test score interpretations and item construction guidelines are highlighted.
期刊介绍:
The Journal of Psychoeducational Assessment (JPA) publishes contemporary and important information focusing on psychological and educational assessment research and evidence-based practices as well as assessment instrumentation. JPA is well known internationally for the quality of published assessment-related research, theory and practice papers, and book and test reviews. The methodologically sound and impiricially-based studies and critical test and book reviews will be of particular interest to all assessment specialists including practicing psychologists, psychoeducational consultants, educational diagnosticians and special educators.