Assisted Guidance for the Blind Using the Kinect Device

Abstract

This paper proposes a real-time system to provide location based guidance and obstacle avoidance of blind persons in indoor environments. The system integrates navigation features based on visual recognition of markers and the detection and classification of possible obstacles in front of the blind person. The system uses the Microsoft Kinect sensor to acquire RGB-D images of the scene. The RGB camera provides input for a real-time tracking algorithm which identifies a trained set of wall-mounted visual markers. The user's pose is estimated combining marker information with GIS data. Depth information is used to classify nearby obstacles. The results of experimental tests with two blind subjects are presented and discussed.