Intuitive 3D flight gaming with tangible objects

Abstract

Object movement in virtual 3D space involves 3D rotations and translations. Conventional desktop interfaces are difficult for a user to simultaneously control the variations of six degrees of freedom. In this paper, we present a vision-based user-friendly method for this purpose. A user can simply grasp one or more objects and fly the objects intuitively. The proposed system using an efficient method to detect and track the objects in the scene. The estimated object motions are used to drive the corresponding targets on the screen or to trigger predefined actions. This interface can track more than one objects at an interactive rate and is applied to a 3D flight shooting game.