A Smart Hand Glove that Converts Gesture into Text & Speech to Assist the Handicapped-(Handtalk)

Abstract

Human being wants to convey their feelings by interacting with people surrounding them. But this is not a case of speech-hearing impaired people whom we call deaf-dumb. This community face lots of helplessness & discrimination. According to World Federation of the Deaf (WFD), there are approximately 70 million deaf & mute people. Previous research works focused on building a communication system for this community but most are prone to inconveniency, for example, heavyweight, expensive, and user-unfriendly. Our paper focused on introducing a system with simplicity, ease of operability, portability. Overcoming the helplessness, we developed a smart hand talk system through which, hand gestures provided by the user will give text & speech output and send the output to a server for emergency response of doctors or family members. The proposed system can control appliances. It sheds light on measuring actions of deaf-dumb people using flex sensors attached to the glove. The glove is placed in hands, whenever a specific sign/gesture will be commanded for action, the analog value will be obtained and the corresponding function will be identified by the arduino board. A xampp server connected to the system will ensure emergency care by doctors or family members.