Monitoring Item Performance With CUSUM Statistics in Continuous Testing
IF 1.9
3区 心理学
Q2 EDUCATION & EDUCATIONAL RESEARCH
引用次数: 3
Abstract
In many educational assessments, items are reused in different administrations throughout the life of the assessments. Ideally, a reused item should perform relatively similarly over time. In reality, an item may become easier with exposure, especially when item preknowledge has occurred. This article presents a novel cumulative sum procedure for detecting item preknowledge in continuous testing where data for each reused item may be obtained from small and varying sample sizes across administrations. Its performance is evaluated with simulations and analytical work. The approach is effective in detecting item preknowledge quickly with group size at least 10 and is easy to implement with varying item parameters. In addition, it is robust to the ability estimation error introduced in the simulations.在连续测试中使用CUSUM统计监测项目性能
在许多教育评估中，项目在评估的整个生命周期内被不同的管理部门重复使用。理想情况下，随着时间的推移，重复使用的项目应该表现得相对相似。事实上，一个项目可能会随着曝光而变得更容易，尤其是当项目发生预先知情时。本文提出了一种新的累积和程序，用于在连续测试中检测项目先验知识，其中每个重复使用项目的数据可以从不同管理部门的小样本量和不同样本量中获得。通过模拟和分析工作对其性能进行了评估。该方法在组大小至少为10的情况下快速检测项目先验知识是有效的，并且在不同项目参数的情况下易于实现。此外，它对仿真中引入的能力估计误差具有鲁棒性。
本文章由计算机程序翻译，如有差异，请以英文原文为准。
求助全文
约1分钟内获得全文
求助全文
来源期刊
CiteScore
4.40
自引率
4.20%
发文量
21
期刊介绍：
Journal of Educational and Behavioral Statistics, sponsored jointly by the American Educational Research Association and the American Statistical Association, publishes articles that are original and provide methods that are useful to those studying problems and issues in educational or behavioral research. Typical papers introduce new methods of analysis. Critical reviews of current practice, tutorial presentations of less well known methods, and novel applications of already-known methods are also of interest. Papers discussing statistical techniques without specific educational or behavioral interest or focusing on substantive results without developing new statistical methods or models or making novel use of existing methods have lower priority. Simulation studies, either to demonstrate properties of an existing method or to compare several existing methods (without providing a new method), also have low priority. The Journal of Educational and Behavioral Statistics provides an outlet for papers that are original and provide methods that are useful to those studying problems and issues in educational or behavioral research. Typical papers introduce new methods of analysis, provide properties of these methods, and an example of use in education or behavioral research. Critical reviews of current practice, tutorial presentations of less well known methods, and novel applications of already-known methods are also sometimes accepted. Papers discussing statistical techniques without specific educational or behavioral interest or focusing on substantive results without developing new statistical methods or models or making novel use of existing methods have lower priority. Simulation studies, either to demonstrate properties of an existing method or to compare several existing methods (without providing a new method), also have low priority.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
