Real time environment perception for visually impaired

Abstract

The widespread availability of mobile platform with internet connectivity, has the potential to bring substantial benefits to the people with sensory impairments such as visually impaired people. With the substantial advancement in computer vision at identifying objects, the solution is to propose an application on a mobile platform which segments image captured through the camera into separate objects, which are passed on to an image classification cloud server. The application then proceeds to dictate the name of the object according to the relative position of the object from the user along with a binaural audio experience to perceive the environment. This solution can help visually impaired people to live their live more easily and with less assistance. Future prospects of this solution involve assisted movement and text reading.