Holistic Assessment of Computational Thinking for Undergraduate: Reliability and Convergent Validity

Abstract

This paper reports a pilot test to a scale called 'Holistic Assessment of Computational Thinking (Hi-ACT. Hi-ACT is seven-point Likert type scale comprises 155 items, resulting form a consensus study completed earlier, which aimed at measure undergraduate students computational thinking skill. The questionnaire was piloted among fourth-year undergraduate students recruited from five faculties in two universities (N=548) in Indonesia. Structural equation modeling with partial least squares technique was followed to establish the factor structure of the scale. The internal consistency reliability was assessed using composite reliability. The convergent validity was evaluated based on two criteria, the outer loadings and the average variance extracted. Accordingly, 44 items that did not load properly on a particular construct were excluded, and the refined scale has confirmed its reliability and validity to the acceptable requirements.