Immersive Driving Car Simulation for Children Using Natural User Interface Controller

Abstract

In this project, we tried to narrow down the gap between real world and synthetic environment. For that purpose, we developed an immersive driving car simulation that combines tangible tool with mixed reality environment. As tangible tool, we developed a real physical mini car that employ arduino sensor inside. To provide an immersive sensation among user and arduino mini car, we employ camera belongs to smart phone in front of our car that it will create real-driving-sensation since the user will feel like s/he sit and drive inside the car. As car controller, we optimized a natural user interface (NUI) controller that employ widely-used RGBD sensor, Kinect. Using our scenario, user will enjoy a real-driving-sensation since they can witness real scene captured by smart phone camera installed in front of mini arduino car. Further more, user can control the mini car using their hand gesture captured by Kinect. Finally, while user driving the car, they will find several Augmented Reality (AR) markers that will visualize various traffic instruments and it will create an edutainment content about traffic rule.