Virtual 3D Interactions between 2D Real Multi-Views

Abstract

In this paper, we introduce an image processing tool, Video Spatialization, as a new approach to navigate through a "virtualized" scene, only known by a limited set of 2D uncalibrated images (i.e without a 3D CAD model). We develop this approach in the context of an interactive application: a multipoint teleconferencing system for very low bit rate links (internet, mobile communications), based on the immer- sion of the 3D virtual models of all the participants, in a common virtualized meeting place controlled by video spatia- lization. This article contains (i) the recall of an efficient "mesh-oriented" algorithm for the reconstruction of real views and the synthesis of virtual ones from a triplet of uncalibrated views; (ii) some extensions of the original approach from one to n triplets of views to simulate 3D navigation and (iii) preliminary investigations using video spatialization for background control within the context of our virtual teleconferencing application.