The Body Sensor Suit with Mixed Reality Interactive Games

Abstract

With the progress of the technology, the Virtual Reality (VR) that only provides viewing becomes more difficultly to provide users the better VR experience. In order to enhance VR interaction, there are various technologies to improve better VR experiences, such as users could control and move by their hand and feet. However, the most of the VR equipment only operate by controller’s direction and the triggers on the controller button, it leads that users cannot use their own body to have an intuitive control.In order to improve this issue, this study focuses on maximizing the interactivity of VR of long-range moving, thus smartphone is chosen as our development platform. Based on Google ARCore library, the values of accelerometer, magnetism sensor and gyroscope from 9-axis sensor can be got. Furthermore, the Inertial Measurement Unit (IMU) is used to calculate information and motion tracking of body. Therefore, the smartphone could detect the body node on the user’s three-dimensional movement accurately, and feedback the control information into mixed reality interactive games.