Mathematical Model of HoloLens 2 Goggles Kinematics for AR Support of Flight Simulator

Abstract

The paper describes how the kinematics model of HoloLens 2 goggles mounted on the user’s head is used for converting the reference frame fixed to the flight simulator with the reference frame fixed to the goggles. The constant correspondence between the two has to be kept to properly map the internal 3D space relative to the position of the device with the real 3D space of the flight simulator cockpit in which HoloLens 2 produces holographic objects. Such conversions are prerequisites of SLAM (Simultaneous Localization and Mapping) algorithms which are used by AR devices to build a map of an environment, and, at the same time, this map is used to compute the goggle’s own position and orientation. In the paper, we also present the application of HoloLens 2 goggles in the WrightBroS project to support flight simulator users (pilots and/or technicians) in their training and maintenance procedures. Keywords: augmented reality (AR), slam, kinematics, hololens 2, flight simulators