Application of Virtual Reality in Developing the Digital Twin for an Integrated Robot Learning System

Abstract

Robotics includes complex mathematical calculations and coordinate transformations in forward and inverse kinematics, path planning, and robot dynamics. Students may experience a high cognitive load and lose learning motivation because robotics can be complex and challenging to understand. This study applied virtual reality (VR) technology in robotics education to simplify and visualize complex robot kinematics, aiming to increase learning motivation and reduce cognitive load. This study incorporated real and virtual robot control to develop an integrated robot learning system. This system enables learners to control the digital twin of a physical robot and observe the synchronized motion of both the virtual and physical robots. Users can operate the virtual robot to achieve the target position by setting joint parameters or using values calculated from inverse kinematics. They can also understand the principle of digital twins by observing the synchronous motion of both robots. A teaching experiment was conducted to explore the performance of applying VR in robotics education and its impacts on cognitive load and learning motivation. The system was improved based on user responses to facilitate subsequent promotional activities. VR can transform complex robotics into easily understandable learning experiences and provide an interactive user interface, making the system a suitable learning tool for STEM education.