Mixed Reality Robotics for STEM Education

Abstract

This work presents an overview of a new system to provide motion tracking and mixed reality integration of robots for use in K12 STEM education. The robots, commanded by students through a block-based programming environment, are placed in a virtual environment visible as an overlay on the physical space. The system’s control loop allows the robots to interact with virtual objects as if they are physically present within easily reconfigurable environments. This virtual space allows for lower cost robots to be used by incorporating virtual sensors and actuators, and creates the potential for a wider range of scenarios for students to work with.