6DoF input for hololens using vive controller

Abstract

In this research we present a calibration method that enables 6 degree of freedom (DoF) interaction technology with high accuracy for the Microsoft HoloLens using HTC Vive controllers. We calibrate the HoloLens's front color camera with the Vive lighthouse sensors by tracking a reference image and a Vive tracker at the first beginning automatically, and the Vive controllers' position and pose data can be transmitted to the HoloLens in real time via the Bluetooth connection, which provides a more accurate and efficient input solution for users to manipulate the augmented content compared with the default gesture or head-gaze interfaces.