Spatio-temporal multi-view synthesis for free viewpoint television

Abstract

Interest in view synthesis is growing rapidly as it has tremendous applications in free viewpoint television (FTV), 3DTV, games, virtual reality etc. The main problem of view synthesis is that the virtual view contains holes in disoccluded regions. We propose a hole-filling algorithm to fill the disocclusion holes in the virtual view by exploiting the temporal information of the reference views. We also propose an algorithm to avoid the shining of background pixel through a foreground object in the virtual view due to the absence of foreground pixel information. We generate different zoomed views of the scene by applying the concept of view synthesis and observe the variation of holes with different zoom scales. Finally, we propose and demonstrate depth based image segmentation to facilitate parallel computing. Experimental results show that good quality virtual views are generated with high PSNR and with fewer artifacts.