Registration of depth and video data in depth image based rendering

Abstract

Depth image based rendering (DIBR) has been proposed to create content for 3D-TV. In DIBR stereoscopic images are created from monoscopic images and associated depth data. Techniques deducing depth information from available video content have been applied to process video data lacking associated depth data for DIBR. Yet, artificial as well as recorded depth data may contain misalignments with respect to the video data. Misaligned depth data is a source of artifacts observable in the rendered 3D view. We show that by using an edge based registration method the spatial alignment of depth and video data can be improved, leading to an alleviation of the observed artifacts.