Wireless Glove for Hand Gesture Acknowledgment: Sign Language to Discourse Change Framework in Territorial Dialect

Abstract

Generally deaf-dumb people use sign language for communication, but they find it difficult to communicate in a society where most of the people do not understand sign language. Due to which communications between deaf-mute and a normal person have always been a challenging task. The idea proposed in this paper is a digital wireless glove which can convert sign language to text and speech output. The glove is embedded with flex sensors and a 9DOF inertial measurement unit (IMU) to recognize the gesture. A 9-degree of freedom inertial measurement unit (IMU) and flex sensors are used to track the orientation of fingers and motion of hand in three dimensional spaces which senses the gestures of a person in the form of bend of fingers and tilt of the hand fist. This system was tried for its practicality in changing over gesture based communication and gives the continuous discourse yield in local dialect and additionally shows the text on GLCD module. The text show being in English, the voice yield of the glove will be in provincial dialect (here Kannada). So this glove goes about as a communicator which in part encourages them to get their necessities and an interpreter giving greater adaptability in correspondence. In spite of the fact that the glove is planned for gesture based communication to discourse transformation, it is a multipurpose glove and discovers its applications in gaming, mechanical autonomy and therapeutic field.In this paper, we propose an approach to avoid the gap between customer and software robotics development. We define a EUD (End-User Development) environment based on the visual programming environment Scratch, which has already proven in children learning computer science. We explain the interests of the environment and show two examples based on the Lego Mindstorms and on the Robosoft Kompai robot.