3D mesh and multi-view synthesis implementation using stereo cameras and a depth camera

Abstract

In this paper, we propose a new method of 3D mesh generation and view synthesis for multi-view video generation. The multi-view video can be produced by a view synthesis method and 3D mesh using RGB+Z images which are composed of one or two RGB images and one depth image. We create 36-view images using the view synthesis method and generate 3D mesh with vertexes and faces for free view rendering. Using the image synthesis method, warping, edge compensation, upsampling and 36-view generation processes are used. For 3D mesh, depth and RGB images are converted to the component of 3D mesh data. The quality of synthesized images is measured by MOS(Mean opinion score).