Non-Parametric CD-CAT Item Selection Strategy and Termination Rules Based on Binary Search Algorithm

Junjie Li, Huijing Zheng
{"title":"Non-Parametric CD-CAT Item Selection Strategy and Termination Rules Based on Binary Search Algorithm","authors":"Junjie Li, Huijing Zheng","doi":"10.59863/dkui7768","DOIUrl":null,"url":null,"abstract":"CD-CAT plays a significant role in diagnosing and assessing students, contributing significantly to improving teaching effectiveness. However, in classroom teaching scenarios, unlike large-scale assessments where a large number of samples can be used to accurately estimate item parameters, non-parametric CD-CAT becomes the only feasible choice. Compared to parametric CD-CAT, non-parametric CD-CAT started later, and research mainly focuses on non-parametric item selection strategies. However, the existing non-parametric item selection strategies have the disadvantage of low efficiency, and there is little research on non-parametric termination rules. Therefore, this study proposes two more efficient item selection strategies: Non-Parametric Dynamic Binary Search (NDBS) and General Non-Parametric Dynamic Binary Search (GNDBS), as well as a non-parametric termination rule:Non-parametric Dynamic Binary Searching Index (NDBI). Simulation results show: (1) Under all conditions, the pattern classification accuracy rate of NDBS is higher than that of NPS, so NDBS can be used as the item selection strategy when there are no samples available. (2) In most cases, the performance of GNDBS is better than other item selection strategies, so GNDBS can be chosen as the item selection strategy when there are few samples available. (3) In variable-length tests, when the research objective is to obtain more accurate classification results, the critical value of the NDBI rule can be reduced; conversely, the critical values of the NDBI and GNDBI rules can be appropriately increased.","PeriodicalId":72586,"journal":{"name":"Chinese/English journal of educational measurement and evaluation","volume":"269 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chinese/English journal of educational measurement and evaluation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.59863/dkui7768","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

CD-CAT plays a significant role in diagnosing and assessing students, contributing significantly to improving teaching effectiveness. However, in classroom teaching scenarios, unlike large-scale assessments where a large number of samples can be used to accurately estimate item parameters, non-parametric CD-CAT becomes the only feasible choice. Compared to parametric CD-CAT, non-parametric CD-CAT started later, and research mainly focuses on non-parametric item selection strategies. However, the existing non-parametric item selection strategies have the disadvantage of low efficiency, and there is little research on non-parametric termination rules. Therefore, this study proposes two more efficient item selection strategies: Non-Parametric Dynamic Binary Search (NDBS) and General Non-Parametric Dynamic Binary Search (GNDBS), as well as a non-parametric termination rule:Non-parametric Dynamic Binary Searching Index (NDBI). Simulation results show: (1) Under all conditions, the pattern classification accuracy rate of NDBS is higher than that of NPS, so NDBS can be used as the item selection strategy when there are no samples available. (2) In most cases, the performance of GNDBS is better than other item selection strategies, so GNDBS can be chosen as the item selection strategy when there are few samples available. (3) In variable-length tests, when the research objective is to obtain more accurate classification results, the critical value of the NDBI rule can be reduced; conversely, the critical values of the NDBI and GNDBI rules can be appropriately increased.
基于二元搜索算法的非参数 CD-CAT 项目选择策略和终止规则
CD-CAT 在诊断和评估学生方面发挥着重要作用,对提高教学效果大有裨益。然而,在课堂教学场景中,不同于大规模测评可以利用大量样本准确估计项目参数,非参数 CD-CAT 成为唯一可行的选择。与参数 CD-CAT 相比,非参数 CD-CAT 起步较晚,研究主要集中在非参数项目选择策略上。然而,现有的非参数项目选择策略存在效率低的缺点,而且关于非参数终止规则的研究也很少。因此,本研究提出了两种更有效的项目选择策略:非参数动态二进制搜索(Non-Parametric Dynamic Binary Search,NDBS)和一般非参数动态二进制搜索(General Non-Parametric Dynamic Binary Search,GNDBS),以及一种非参数终止规则:非参数动态二进制搜索索引(Non-Parametric Dynamic Binary Searching Index,NDBI)。仿真结果表明:(1) 在所有条件下,NDBS 的模式分类准确率都高于 NPS,因此当没有可用样本时,可以使用 NDBS 作为项目选择策略。(2)在大多数情况下,GNDBS 的性能优于其他项目选择策略,因此在可用样本较少时,可以选择 GNDBS 作为项目选择策略。(3)在变长测试中,当研究目标是获得更准确的分类结果时,可以降低 NDBI 规则的临界值;反之,可以适当提高 NDBI 和 GNDBI 规则的临界值。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信