A Virtual Reality Application using Hand Motion Tracking with Leap Motion Sensor

Abstract

The kinesiological treatment of hand typically requires exercise either of mobility, elasticity or reflexes in the hands. This exercises requires to be evaluated by an expert, however, he could not be present. An alternative is the use of technologies, where eventually these exercises could be remotely modelled using 3D models for a more detailed representation of action respect to typical video records. Nonetheless, the hands are a very complex object as it is conformed by multiple parts, which difficults the application of typical sensors as RGB cameras. In this work, we propose to develop a software capable of implementing hand tracking system over a real-time infrared device. This system associates the sensor measures to precise position and pose of the hand. Besides, the software graph the hands three-dimensionally in a virtual environment considering different exercises that the user might perform. We expect that this proposal will be the basis of an application for kinesiological exercise in the hands, since this implementation technology also aims to increase the motivation of users to carry out the exercises and consequently, this could even mean a decrease in the recovery time.