MiReAS: a mixed reality software framework for iterative prototyping of control strategies for an indoor airship

Abstract

Virtual prototyping has become an established design tool in complex interdisciplinary development processes using state-of-the-art virtual reality techniques. Due to numerous benefits virtual prototyping has seen increasing acceptance in recent years, especially in the development of systems that involve complex interactions between components or require the integration of newly developed hardware. Mixed reality, considered as an extension to VR, has high potential to support the development of complex systems that operate in a real world environment even further. In this paper we demonstrate that the principles of mixed reality prototyping can also be effectively applied to the development of complex systems if a structured process is defined and supported by a proper software framework. In our paper we present a system that supports an iterative approach to prototype complex dynamical systems. Using this approach allows the designer to seamlessly progress from an initial virtual prototype to the final system along the mixed reality continuum. We describe MiReAS, a mixed reality software framework that supports an iterative design evolution with arbitrary combinations of real and virtual elements. The use of the system is demonstrated by the development of interaction techniques and control strategies for an unmanned aerial vehicle.