Experimental multimodal user interface

Abstract

This paper describes the motivation of experimental multimodal user interface development and its usage in the smart/virtual environment. Using the transformation method, the independence of the user interface design from the particular implementation is guaranteed. The proposed experimental multimodal user interface for cooking activity is proof of the applicability of the transformation method. The proposal has been implemented for the graphical, voice and gestural user interface. This experimental interface can also be used when deployed in a virtual school environment.