Supervision of task-oriented multimodal rendering for VR applications

Abstract

This article addresses the question of integrating multimodal rendering in Virtual Reality applications. It exposes first the interest of multimedia intelligent systems to improve human activity in Virtual Environments. Then it details the conception of a software module in charge of supervising multimodal information rendering, depending on the interaction and its context. From existing psychophysical studies and concrete applications, we propose a model, an architecture and a decision process. Finally a first implementation is presented to validate the core of the simulator and show the adaptability of its knowledge base.