Investigation of Pre-Knowledge Cheating via Joint Hierarchical Modeling Patterns of Response Accuracy and Response Time

Abstract

With the rise of computer- based testing, increasingly more attention has been given to response time (RT) in assessment practice and psychometric research. This study aims to reveal the rate of Type I error in the detection of preknowledge cheating behaviors, and the rate of power of Kullback–Leibler divergence (KL) measure, and person fit statistic under different conditions via modeling patterns of response accuracy (RA) and RT, using a joint hierarchical model. The test length, difficulty level of the compromised items, the ratio of compromised items, and changing in RTs of the compromised items variables were varied. KL measure has a high power and Type I error rate mean values than person fit statistics for RA and RT patterns under all conditions.