Measuring Teamwork Competencies Cross-Culturally Through Computerized Adaptive Testing: Implications for Human Resource Management

Abstract

This article examines the psychometric properties of a Computerized Adaptive Test for Measuring Teamwork Competencies (CAT-TWC). Using item response theory and a multicultural team framework, we examine the dimensionality, precision, and measurement invariance of the measures obtained with the CAT-TWC in a first study with participants from China (N = 526), Spain (N = 318), and the USA (N = 374). In a second study including participants in multicultural teams (N = 73), we analyze the convergent, predictive, and incremental validity of the measures obtained through the CAT-TWC. The study reveals that CAT-TWC is consisten with the structure proposed by Stevens and Campion (1994) and that the metrics collected through CAT-TWC demonstrate measurement invariance and precision across the adaptive administration process. There is evidence showing the CAT-TWC's convergent validity with individual teamwork behaviors. It also posesses predictive validity at both the individual level (in relation to individual task performance and individual adaptability) and the team level (team adaptability), as well as incremental validity in comparison to individual performance and team performance outputs such as overall team performance and team adaptability. We discuss the implications of implementing CAT-TWC in both professional and research contexts.