Kinect in neurorehabilitation: Computer vision system for real time hand and object detection and distance estimation

Abstract

This paper presents image processing and scene analysis methods that can provide artificial vision that is of interest for automatic selection of hand trajectory and prehension. The new algorithm, which uses data from the Kinect sensor, allows real-time detection of the hand of the person grasping an object at working table in front of that person. The outputs are real world coordinates of the hand and the object. The image processing is done in Matlab over the depth image stream taken from the Microsoft Kinect as a sensory input. Results show that in the presented system setup our program is capable of tracking hand movements in the transverse plane and estimating hand and object position in real-time with tolerable estimation error for the selection of stimulation paradigm that could control hand trajectory.