Depth Based View Synthesis with Artifacts Removal for FTV

Abstract

View synthesis technology generates virtual views for display and high quality virtual view is of significantimportance to free-viewpoint TV (FTV) and three dimensional video(3DV). This paper proposes a novel virtual view synthesis method in multi-view system based on multi-view plus depth. Firstly, we project two reference depth maps to the intermediate virtual view and rectify the two candidate virtual depth maps. Secondly, we project reference texture to the virtual view with the rectified depth maps and blend the candidate virtual views. Finally, we in paint the remaining holes according to the adjacent depth and color samples in background regions. Experiment results demonstrate that the proposed method works well and generates high quality intermediate virtual views.