未回答问题对考生潜在特质的影响:项目反应理论视角。

African Journal of Psychological Assessment Pub Date : 2024-12-16 eCollection Date: 2024-01-01 DOI:10.4102/ajopa.v6i0.161
Joseph T Akinboboye, Musa A Ayanwale, David A Adewuni, Yohanna I Vincent
{"title":"未回答问题对考生潜在特质的影响:项目反应理论视角。","authors":"Joseph T Akinboboye, Musa A Ayanwale, David A Adewuni, Yohanna I Vincent","doi":"10.4102/ajopa.v6i0.161","DOIUrl":null,"url":null,"abstract":"<p><p>In grading examinees' responses to test items, it is not uncommon to find that some examinees omit responses to specific items. The number of omitted responses must be considered in the psychometric analysis of test data. Omitted responses cannot be ignored, as mishandling them can jeopardise the validity of the test. This study investigates the impact of omitted responses on examinee characteristics in Mathematics Achievement Test (MAT), using item response theory (IRT) in Osun State, Nigeria. A descriptive survey research design was employed, with a sample of 600 senior secondary school 3 (SSS 3) students from eight randomly selected schools. The instrument used was a 40-item multiple-choice MAT, adapted from the West African Examinations Council's items, with a reliability coefficient of 0.88. The instrument was content-validated by experts in Mathematics using the Lawshe content validity ratio, giving a 0.82 content validity index. The results indicate significant differences in estimated ability levels among groups, with varying probabilities of examinees producing omitted responses. The study recommends the consideration of omitted responses in IRT-based ability estimation and emphasises the importance of comparable ability groupings. This research contributes to the understanding of the complexities of educational measurement and highlights the need for careful handling of omitted responses to ensure the validity of test inferences.</p><p><strong>Contribution: </strong>This study contributes by highlighting the importance of considering omitted responses in MAT, emphasising their impact on estimated ability levels and the validity of test inferences, thus informing fairer assessment practices and enhancing the reliability of educational measurements.</p>","PeriodicalId":34043,"journal":{"name":"African Journal of Psychological Assessment","volume":"6 ","pages":"161"},"PeriodicalIF":0.0000,"publicationDate":"2024-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12082205/pdf/","citationCount":"0","resultStr":"{\"title\":\"Impact of unanswered questions on examinees' latent traits: An item response theory perspective.\",\"authors\":\"Joseph T Akinboboye, Musa A Ayanwale, David A Adewuni, Yohanna I Vincent\",\"doi\":\"10.4102/ajopa.v6i0.161\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>In grading examinees' responses to test items, it is not uncommon to find that some examinees omit responses to specific items. The number of omitted responses must be considered in the psychometric analysis of test data. Omitted responses cannot be ignored, as mishandling them can jeopardise the validity of the test. This study investigates the impact of omitted responses on examinee characteristics in Mathematics Achievement Test (MAT), using item response theory (IRT) in Osun State, Nigeria. A descriptive survey research design was employed, with a sample of 600 senior secondary school 3 (SSS 3) students from eight randomly selected schools. The instrument used was a 40-item multiple-choice MAT, adapted from the West African Examinations Council's items, with a reliability coefficient of 0.88. The instrument was content-validated by experts in Mathematics using the Lawshe content validity ratio, giving a 0.82 content validity index. The results indicate significant differences in estimated ability levels among groups, with varying probabilities of examinees producing omitted responses. The study recommends the consideration of omitted responses in IRT-based ability estimation and emphasises the importance of comparable ability groupings. This research contributes to the understanding of the complexities of educational measurement and highlights the need for careful handling of omitted responses to ensure the validity of test inferences.</p><p><strong>Contribution: </strong>This study contributes by highlighting the importance of considering omitted responses in MAT, emphasising their impact on estimated ability levels and the validity of test inferences, thus informing fairer assessment practices and enhancing the reliability of educational measurements.</p>\",\"PeriodicalId\":34043,\"journal\":{\"name\":\"African Journal of Psychological Assessment\",\"volume\":\"6 \",\"pages\":\"161\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-12-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12082205/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"African Journal of Psychological Assessment\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.4102/ajopa.v6i0.161\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"African Journal of Psychological Assessment","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4102/ajopa.v6i0.161","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在给考生对测试项目的反应打分时,经常会发现一些考生忽略了对特定项目的反应。在对测试数据进行心理测量分析时,必须考虑被遗漏的应答数。遗漏的回答不能被忽略,因为处理不当可能会危及测试的有效性。本研究利用项目反应理论(IRT)在尼日利亚奥逊州调查了数学成就测试(MAT)中遗漏的回答对考生特征的影响。采用描述性调查研究设计,随机抽取8所学校的600名高中三年级学生作为样本。所使用的工具是40项多项选择题MAT,改编自西非考试理事会的项目,可靠性系数为0.88。该仪器经数学专家采用Lawshe内容效度比进行内容验证,内容效度指标为0.82。结果表明,各组之间的估计能力水平存在显著差异,考生漏答的概率也有所不同。该研究建议在基于irt的能力评估中考虑遗漏的回答,并强调可比较的能力分组的重要性。本研究有助于理解教育测量的复杂性,并强调需要仔细处理遗漏的回答,以确保测试推断的有效性。贡献:本研究的贡献在于强调了在MAT中考虑遗漏答案的重要性,强调了它们对估计能力水平和测试推断有效性的影响,从而为更公平的评估实践提供了信息,提高了教育测量的可靠性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Impact of unanswered questions on examinees' latent traits: An item response theory perspective.

In grading examinees' responses to test items, it is not uncommon to find that some examinees omit responses to specific items. The number of omitted responses must be considered in the psychometric analysis of test data. Omitted responses cannot be ignored, as mishandling them can jeopardise the validity of the test. This study investigates the impact of omitted responses on examinee characteristics in Mathematics Achievement Test (MAT), using item response theory (IRT) in Osun State, Nigeria. A descriptive survey research design was employed, with a sample of 600 senior secondary school 3 (SSS 3) students from eight randomly selected schools. The instrument used was a 40-item multiple-choice MAT, adapted from the West African Examinations Council's items, with a reliability coefficient of 0.88. The instrument was content-validated by experts in Mathematics using the Lawshe content validity ratio, giving a 0.82 content validity index. The results indicate significant differences in estimated ability levels among groups, with varying probabilities of examinees producing omitted responses. The study recommends the consideration of omitted responses in IRT-based ability estimation and emphasises the importance of comparable ability groupings. This research contributes to the understanding of the complexities of educational measurement and highlights the need for careful handling of omitted responses to ensure the validity of test inferences.

Contribution: This study contributes by highlighting the importance of considering omitted responses in MAT, emphasising their impact on estimated ability levels and the validity of test inferences, thus informing fairer assessment practices and enhancing the reliability of educational measurements.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
13
审稿时长
20 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信