Real-time generation and high-fidelity visualization of 3D video

Abstract

3D video is the ultimate image medium recording dynamic visual events in the real world as is. Recorded object behaviors can be observed from any viewpoint, because 3D video records the object's full 3D shape, motion, and precise surface properties (i.e. color and texture). This paper first describes a parallel pipeline processing method for real-time reconstructing dynamic 3D object shape from multi-view video images. Performance evaluation are given to demonstrate its effectiveness. Then, we present an algorithm of generating video texture on the reconstructed dynamic 3D object surfaces from the multi-view video images. Experimental results demonstrate its effectiveness in generating high fidelity object images from arbitrary viewpoints.