MRStudio: A mixed reality display system for aircraft cockpit

Abstract

Mixed reality techniques are boosting for aviation progress. In this paper, we present MRStudio, a mixed reality display system for aircraft cockpit. The system architecture is given, with special attention paid upon such technical issues as three-dimensional map construction for aircraft cockpit, computer vision based 6-DOF head tracking, virtual aircraft cockpit panel construction and registration, and mixed reality display for aircraft cockpit using a flexible client-server architecture. A testing scenario on a full scale mockup of the COMAC's ARJ21 cockpit is described.