Work-in-Progress–Motion Tracking Data as a Proxy for Cognitive Load in Immersive Learning

Abstract

Recent research has produced mixed results regarding the effectiveness of learning in VR. It has been suggested that the rich multisensory input in VR may induce cognitive overload that impedes the learning process. Cognitive load is typically measured by administering questionnaires. Although questionnaires are easily used, they imply the need to interrupt students during learning or to assess cognitive load in retrospect. In this work-in-progress paper, we argue that VR motion tracking data has the potential to provide unobtrusive, yet valid measures of cognitive load. We report preliminary results from a user study that aims at predicting cognitive load using the tracking data of a VR headset and two hand controllers. Using a recurrent neural network, we were able to distinguish between different levels of cognitive load with an accuracy of more than 88 percent. Based on this finding, we reflect on future research directions and practical considerations.