Intelligent Gesture Recognition to Design more Efficient & Intelligent Multimodal System

Technologies used in multimodal interfaces include conventional direct-manipulation devices like the keyboard, mouse, and pen and touch screen, as well as progressively more advanced recognition technologies such as speech recognition, 2D and 3D gesture recognition, and lip movement and gaze tracking. Usability studies, exploring and evaluating the human factors involved in multimodal input, provide useful insight and guidance toward the design and implementation of multimodal interfaces. The primary goal in the design of any user interface is to facilitate the interaction between user and machine. This user-centered goal is the guiding force behind choices made in the design process. There are, of course, many system engineering issues that influence interface design decisions such as schedules, proper functionality, reliability, etc. However, addressing these issues ideally serves the purpose of creating a better user experience with the system. One purpose of researching multimodal interfaces from an HCI perspective is to evaluate how to take advantage of the benefits they provide over unimodal recognition-based interfaces and conventional keyboard and mouse interfaces. Such advantages include flexibility, availability, adaptability, efficiency, lower error rate, and a more intuitive and natural interaction [1, 2]. Technology is one way to remove the hindrances and benefit the people. It is found that all the recent techniques for Multimodal System are based on computer tools, techniques and technologies like: Artificial Intelligence; Expert System; Graph Matching; Soft Computing; Natural Language Processing (NLP); Multi-Modal and HCI. Several researchers have explored their possibilities and have achieved results to certain extent, but progress in Speech Recognition & Language Understanding using gestures, & optimization as a whole has been limited which gives us future scope to go ahead in this domain.