Real-Time Finger Tracking for Virtual Instruments

Abstract

Human Computer Interaction is becoming a major component in computer science related fields allowing humans to communicate with machines in very simple ways exploring new dimensions of research. Kinect, the 3D sensing device introduced by Microsoft which allows developers to use depth data for research. Recently, there are several mature libraries such as NITE and Kinect SDK which provide functions of Human skeleton tracking. Therefore, users may find that these applications only work with big joints of human body. When it comes to the tracking of fingers, devices such as Leap Motion will be mentioned because it provides APIs and games, which users can communicate with the computer by their fingers. Although Leap Motion Provides functions of finger tracking, the operating distance is short and users need to sit in a fixed position. Here, in this paper, authors' experimental efforts on detailed hand tracking including fingers based on Microsoft Kinect. Analyzing the depth information captured by Kinect in real time, users can apply the result in different scopes such as device controller and Virtual Instruments.