Integrating the Kinect camera, gesture recognition and mobile devices for interactive discussion

Abstract

The Microsoft Kinect camera is a revolutionary and useful depth camera giving new user experience of interactive gaming on the Xbox platform through gesture or motion detection. Besides the infrared-based depth camera, an array of built-in microphones for voice command is installed along the horizontal bar of the Kinect camera. As a result, there are increasing interests to apply the Kinect camera for various real-life applications including the control of squirt guns for outdoor swimming pools. In additional to the Kinect camera, mobile devices such as the smartphones readily integrated with motion sensors have been used for different real-time control tasks like the remote control of robots. In this project, we propose to integrate the Microsoft Kinect camera together with the smartphones as intelligent control for interactive discussion or presentation for the future e-learning system. To demonstrate the feasibility of our proposal, a prototype of our proposed gesture recognition and command specification software is built using the C# language on the MS .NET platform, and will be evaluated with a careful plan. Furthermore, there are many interesting directions for further investigation of our proposal.