IoT Based Sign Language Recognition System

Abstract

Sign language is the key communication medium, which deaf and mute people use in their day - to-day life. Talking to disabled people will cause a difficult situation since a non-mute person cannot understand their hand gestures and in many instances, mute people are hearing impaired. Same as Sinhala, Tamil, English, or any other language, sign language also tend to have differences according to the region. This paper is an attempt to assist deaf and mute people to develop an effective communication mechanism with non-mute people. The end product of this project is a combination of a mobile application that can translate the sign language into digital voice and loT-enabled, light-weighted wearable glove, which capable of recognizing twenty-six English alphabet, digits, and words. Better user experience provides with voice-to-text feature in mobile application to reduce the communication gap within mute and non-mute communities. Research findings and results from the current system visualize the output of the product can be optimized up to 25 % –35 % with an enhanced pattern recognition mechanism.