Driver posture recognition for 360-degree holographic media browsing

Abstract

To interactively display scene photos in an in-car environment, we propose a 360° holographic media browsing system, which can recognize a driver's posture to trigger relative visual information to be displayed on a head-up display (HUD) in a car. Recognizing a driver's posture is a challenging issue, due to the unstable lighting conditions and occlusion issues in a limited space in a car. In this paper, we propose a driver posture recognition scheme for triggering the 360° media to be displayed on a HUD. The contributions of this paper are tri-fold: (1) a real-time driver posture recognition algorithm analyzed from the geometric relationship among multiple joints in a spatial-temporal domain, (2) a user study for recognizing postures with different level is provided for further user interface design, and (3) a 360° holographic media is displayed on a HUD based on a unity game engine.