Retest Reliability of Situational Judgment Tests

Abstract. A situational judgment test (SJT) is a psychological instrument typically used to assess the suitability of applicants in personnel selection or development. Interest in SJTs has increased over the past decades as research has shown considerable validity of SJTs and various other benefits. Researchers often provide information about internal consistency reliability of SJTs, but this estimate is known to be unsuitable for SJTs because they are heterogeneous tests; a better estimate for the reliability of SJTs may be retest reliability. Thus, this study represents the first meta-analysis investigating the retest reliability of SJTs. The results reveal a pooled retest reliability estimate of r = .698 based on k = 37 coefficients. Additionally, variables associated with test characteristics and variables containing information about the study and the participants were examined as potential moderators.