Geometry Wall: An Embodied Gesture-based Game for Supporting Spatial Ability

Research has shown that interaction design based on embodied cognition has a significant effect on the understanding of abstract concepts. Spatial ability as one of the core literacies in mathematics education can be difficult to train. On this basis, we have designed and developed a gesture-based spatial skills game training system, which allows students to manipulate objects synchronously with gestures to complete game tasks, thereby practicing spatial skills. We then invited 20 students to conduct a pre-experiment and recorded the changes in spatial ability, operational data during the learning process, and the acceptance of the technology through questionnaires and system logs. The results showed significant improvements in all dimensions of spatial ability through this game training system, with two processual characteristic sequences reflecting the status of problem-solving strategies used by participants with different styles. In the technology acceptance survey, there were some issues with ease of use, but overall satisfaction with the game system as a whole was high.