In-door Obstacle Detection and Avoidance System for Visually Impaired People

Abstract

This paper proposes an edge-technology based feedback system for the visually impaired people in a form of smart glasses. The glasses contain a microcomputer attached with a depth sensing camera. The proposed feedback system is an assistant for the visually impaired population which detects and identifies objects, obstacles and provides feedback in real-time. The main purpose is to assist the visually impaired user in-door just by receiving an audio query about the required object and giving an audio feedback i.e. name, distance and direction of that particular object. The system has an audio I/O device to interpret the audio messages. The system is capable of completing all the necessary processing i.e. detecting objects in the surrounding, measuring the distance and direction of the objects, identifying objects on user’s query, recognizing user’s speech and converting it into suitable text, detecting obstacles and providing audio feedback to the user. The visually impaired user just has to send an audio query and receive system’s audio feedback to get the required in-door object by avoiding all the obstacle in the provided path.