3DoF+ video compression algorithm based on distortion minimization interpolation with adaptive reference view selection

Abstract

The emerging 3DoF+ video offers more interactivity and deeper immersion. However, the bulky size of the 3DoF+ video imposes new challenges in its storage and processing. Thus, compressing 3DoF+ video efficiently is vitally important. Due to the geometric relationship between viewpoints, overlaps exist in views and this redundancy is available for further compression. However, existing compression algorithms either utilize partial information of the scene or still retain a lot of redundancy, which results in low quality reconstructed views. To address these problems, our study proposes to select reference views adaptively, which utilizes as few bits as possible to contain the necessary visual information of the scene. Besides, in order to reduce the residues between the reconstructed and original views, the distortion minimization interpolation (DMI) method is then proposed for further refining the synthesized views. The experimental results show that our method achieves on average 52.1% BD-rate reduction than direct coding with High Efficiency Video Coding (HEVC).