Mobile multimedia application for deaf users

Abstract

Mobile telephone systems have made a great progress in general, but deaf people are practically excluded from the benefits of mobiles. Some cases the information flow is available only in the form of human speech. Our aim was to develop a new communication aid for deaf users. Our system directly converts the audio speech signal into the video of animated face, so the deaf users can receive voice messages by lip-reading. Our system was implemented and tested in a PC environment earlier. This paper reports on the implementation on mobile phones. The implementation problems and the potential steps for further improvements are also discussed.deaf users.