Be closer as you being there: HMD-based social interaction system

Abstract

The proposed system dose not only provides an immersive live 360 degree experience through the HMD-controlled remote stereoscopic cameras but also enables the users to perform social activities with an interactive virtual messenger. This system was originally developed to control a mobile robot/vehicle with monitoring purpose which is similar to DORA (Dexterous Observational Roving Automation) platform [ACKERMAN 2015]. However we duplicated and placed the system in a geographically dispersed location and connected between two systems over the real-time network. To enhance social interactivity, we implemented an interactive virtual messenger. As the result the system provides the feeling of social presence and the fun with an immersive experience.