Internet-wide multi-party tele-immersion framework for remote 3D collaboration

Abstract

Tele-presence and tele-immersion systems are growing to be more realistic these years. However, few show practical experiences in Internet wide tele-immersion, especially in acceptable end-to-end delay. We present a framework for multi-party tele-immersion applications that allow remote collaborative 3D interactions. This framework performs real-time stereo modeling based on the bumblebee cameras. It provides an architecture that supports several tele-immersion nodes to communicate in groups. This paper addresses how to reconstruct, compress and establish the system. The system has been set up in China NGI. Preliminary experiment results show that it's possible to have the delay under 100ms with 320*240 depth map and 640*480 texture images. The framework is also expected to be further extended for interaction with full-body reconstruction.