An empirical study of speech and gesture interaction: toward the definition of ergonomic design guidelines

Abstract

We present two related empirical studies of the use of speech and gestures in simulated HCI environments. This research aims at providing designers of future multimodal interfaces for the general public with useful information on users’ expectations and requirements. Results demonstrate the usability of tractable artificial command languages composed of utterances from a restricted subset of natural language, a few pointing gestures, and multimodal combinations of both types of units.