Smart Translation for Physically Challenged People Using Machine Learning

Abstract

In sign language, hand motions are one of the nonverbal communication modalities employed. It is most typically used by deaf and hard of hearing persons who have hearing or speech impairments. Difficulties communicating with one another or with regular people folks. Several sign language systems have been created by There are numerous producers all throughout the world, but they are neither versatile nor adaptable, end-user-friendly in terms of price. Our project's goal is to create a feasible system for communication for deaf people. This project is divided into two sections. (1) It translates an audio message into sign language, and (2) it translates images/video into text/speech. The first category we'll take input as audio, turns the audio recorded message into text message, and later displays predetermined Indian Sign Language(ISL) visuals or GIFs. The use of this technique facilitates communication between hearing and deaf persons. In the second category, we will gather photographs and train images with CNN and present the results.