A 3D interactive kiosk system

Abstract

One of the long-term goals in human-computer interaction is to utilize more intuitive and natural methods such as speech and hand gesture that a user would employ for communication. In this paper, we present a multi-modal 3D interaction mechanism, in which user can interact with a 3D model of a tourist location displayed on the kiosk screen from a one meter distance by means of gestures and voice commands without wearing any special device in a public place, with a complex and non-static background environment. The system can be used in many applications such entertainment, touring, education, museum displays, and advertising.