Expressive sign language system for deaf kids with MPEG-4 approach of virtual human character

Abstract

Children with language impairments during their significant developmental periods within ‎childhood are exposed to cognitive risk, social impairments, along with language. This is difficult ‎with children born deaf from hearing parents who own little or no experience of communicating ‎in sign language. This system presents the sign language in the context of British ‎Sign Language (BSL) for producing utterances through virtual characters. In capturing, Kinect ‎sensors use a motion capture sensor for motion actors. The connection uses sensors to read data, ‎connect to high-quality 3D scans, and then use these high-quality scans of the animated MPEG-4 ‎face and hand models. The main challenges of this system are the simultaneous capture of data ‎for the whole hand and the development of the MPEG-4 approach considering the animation ‎engines with descriptive sign language features. After synchronizing motion data from motion ‎capture results with Kinect, the combined hand character adjusts points, frames, and time with ‎virtual characters based on the motion of character actors. This study demonstrates the skills of ‎this sign language system instrumental in presenting an assessment by users, highlighting the ‎importance of the hand part in creating new accents and signs in BSL. We have validated this ‎system by testing the reliability and functionality of the virtual characters.‎.