Full Duplex Smart System for Deaf & Dumb and Normal People

Abstract

Ability to express yourself to the events that occurs in your surroundings is one of the priceless gift that we have. Normal human being have the ability to see, listen, talk and express themselves but there are few people who are unable to communicate and are not able to express themselves. Moreover it is also difficult for them to understand what normal people are saying to them and for normal people too to commute with them. Therefore to bridge the gap between these two we have created a full duplex smart communication system that less the communication and its gap between the normal people and the people who are unable to communicate. Our system focuses on Deaf & Dumb (D&D) people. Using our approach we have achieved an accuracy and precision of 95% and 85.5%. This paper has two major contributions. At start, uses the Leap Motion Device for hand gesture recognition. This will track data that will be used for training Pakistani Sign Language (PSL). In the second part, when normal people is trying to communicate with them, they can do it without learning a sign language. We have implemented this by using our Android Application that converts speech to text language that can be understood by the deprived one easily.