Multimodal Interaction with Hypermedia Structures

Multimodal interfaces provide users with a number of different ways of interacting with a system. This paper proposes the integration of an explicit interaction model as an extension of the well-known MVC architectural pattern. It builds upon previous extensions regarding explicit structure, user interface (UI), and environmental models. In addition, this paper proposes an explicit UI layer in a service-oriented hypermedia infrastructure to address requirements from multimodal interfaces.