Smart presentation system using hand gestures and Indonesian speech command

Abstract

The development of technology for supporting learning system at this time takes place very rapidly. Human Computer Interaction provides users that allows to control presentations in a natural way by their body gestures and voice commands. The authors propose a simple system that can be use to control presentation by using hand gestures and also by using Indonesian speech recognition. Our proposed system consist of gesture recognition with Kinect 3D skeletal data, and utilize Google Speech API to recognize Indonesian language as voice command. In this system we built applications to perform hand gestures and speech recognitions and utilize libraries to perform mouse and keyboard actions in presentation application. From the experiments, hand gestures application can process in realtime with the accuracy more than 90%, and for Indonesian language speech recognition gave accuracy almost 99% with average speed of recognition around 1 second.