Linking between real and virtual spaces: building the mixed reality stage environment

Abstract

The paper is concerned with the concept of a mixed reality (MR) stage environment as networked layering of physical space and virtual environments. The MR stage enables multiple performers to interact through intuitive free body interfaces. The goal is the creation of interface environments which allow participants to communicate in shared and remote physical spaces through their natural senses: hearing, seeing, speaking, gesturing, touching and moving around. Connecting the concept of the stage with the idea of digital information space comprises investigation in digital storytelling and the design of nonlinear structures. What we get is an instrument for the human body. What we see is actual movement of performers integrating virtual sound and images in real time onto the MR stage.