Difficulty, Discrimination and Pseudo - Guessing Indices of West African Examinations Council Core Mathematics Multiple Choice Items: Theoretical and Practical Implications of Using Item Response Theory

Andrews Cobbinah, Simon Ntumi
{"title":"Difficulty, Discrimination and Pseudo - Guessing Indices of West African Examinations Council Core Mathematics Multiple Choice Items: Theoretical and Practical Implications of Using Item Response Theory","authors":"Andrews Cobbinah, Simon Ntumi","doi":"10.14505/jres.v13.15.06","DOIUrl":null,"url":null,"abstract":"Viewing from the psychometric models of modern assessment, it is imperative to note that assessment has been undergoing major constructive modifications. One of the main modifications is the transition from the use of classical test theory (CTT) to modern test models (IRT) as well as methods used in test construction. This is to say that the pendulum swing in test construction techniques is from CTT to IRT. Clearly, the properties of IRT create several benefits in the area of test design and item banking over CTT. This paper estimated the IRT psychometric proprieties (difficulty-1PL, discrimination-2PL and guessing indices-3PL) of West African Examinations Council (WAEC) 2020 core mathematics objectives test examination in Ghana within the remit of IRT. The study revealed that averagely, the 2020 core mathematics objectives test examination were within the difficulty level (1PL) of the examines. In terms of discrimination level (2PL), the psychometric properties indicated that most of the items discriminated among the examinees. However, on the Pseudo-guessing parameter (3PL), it was found that most items were subjected to pseudo-guessing. Theoretically and practically, the way items are constructed could have influenced outcome. Therefore, we strongly advocate and recommend that item writers for examination body like West African Examinations Council (WAEC) should rigorously be trained to be more conscious of theoretical and practical implications of the guessing parameter. This will help in avoiding test items that are prone to pseudo-guessing.","PeriodicalId":350338,"journal":{"name":"Journal of Research in Educational Sciences","volume":"68 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Research in Educational Sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.14505/jres.v13.15.06","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Viewing from the psychometric models of modern assessment, it is imperative to note that assessment has been undergoing major constructive modifications. One of the main modifications is the transition from the use of classical test theory (CTT) to modern test models (IRT) as well as methods used in test construction. This is to say that the pendulum swing in test construction techniques is from CTT to IRT. Clearly, the properties of IRT create several benefits in the area of test design and item banking over CTT. This paper estimated the IRT psychometric proprieties (difficulty-1PL, discrimination-2PL and guessing indices-3PL) of West African Examinations Council (WAEC) 2020 core mathematics objectives test examination in Ghana within the remit of IRT. The study revealed that averagely, the 2020 core mathematics objectives test examination were within the difficulty level (1PL) of the examines. In terms of discrimination level (2PL), the psychometric properties indicated that most of the items discriminated among the examinees. However, on the Pseudo-guessing parameter (3PL), it was found that most items were subjected to pseudo-guessing. Theoretically and practically, the way items are constructed could have influenced outcome. Therefore, we strongly advocate and recommend that item writers for examination body like West African Examinations Council (WAEC) should rigorously be trained to be more conscious of theoretical and practical implications of the guessing parameter. This will help in avoiding test items that are prone to pseudo-guessing.
西非考试委员会核心数学选择题的难度、辨析和伪猜测指标:运用项目反应理论的理论和实践意义
从现代评估的心理测量模型来看,必须注意到评估正在经历重大的建设性修改。其中一个主要的修改是从使用经典测试理论(CTT)到现代测试模型(IRT)以及测试构建中使用的方法的过渡。也就是说,试验施工技术的钟摆是从CTT到IRT。显然,与CTT相比,IRT的特性在测试设计和题库方面创造了一些好处。本文估计了西非考试委员会(WAEC) 2020年加纳核心数学目标测试考试的IRT心理测量特性(难度-1 pl,判别-2 pl和猜测指数-3 pl)在IRT职权范围内。研究显示,平均而言,2020年核心数学目标测试考试在考试的难度水平(1PL)之内。在歧视水平(2PL)方面,心理测量特征表明大多数项目在考生中存在歧视。然而,在伪猜测参数(3PL)上,发现大多数项目都受到伪猜测的影响。从理论上和实践上讲,项目的构建方式可能会影响结果。因此,我们强烈主张并建议像西非考试委员会(WAEC)这样的考试机构的考题编写者应该接受严格的培训,以更加意识到猜测参数的理论和实践意义。这将有助于避免容易产生伪猜测的测试项目。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信