Directional hole filling algorithm in new view synthesis for 3D video using local segmentation

Abstract

In this paper, a novel hole filling approach bases on the edge orientation for new view synthesis is presented. The hole pixels after warping processing are generated from the background pixels guided by the direction of edges. To obtain the better visual quality of the generated image at the free view point, the priority of each pixels on hole's boundary is first calculated, then the depth pixels in a local rectangle centered at high-priority pixel are segmented by k-means prior to apply filling process. Thus, the natural textures of virtual view over the hole can be archived in less blur and distortion. The experimental results show that the proposed method provides better performance objectively as well as subjectively.