Atlas level rate distortion optimization for 6DoF immersive video compression

Proceedings of the 32nd Workshop on Network and Operating Systems Support for Digital Audio and Video Pub Date : 2022-06-17 DOI:10.1145/3534088.3534354

Soonbin Lee, Jong-Beom Jeong, Eun‐Seok Ryu

{"title":"Atlas level rate distortion optimization for 6DoF immersive video compression","authors":"Soonbin Lee, Jong-Beom Jeong, Eun‐Seok Ryu","doi":"10.1145/3534088.3534354","DOIUrl":null,"url":null,"abstract":"The Moving Picture Experts Group (MPEG) has started an immersive media standard project to enable multi-view video and depth representation in three-dimensional (3D) scenes. The MPEG immersive video (MIV) standard explores the six degree of freedom (6DoF) technologies of immersive content to support motion parallax. Despite the standard being designed to compress multi-view immersive media, MIV coding has not been investigated from the perspective of bit allocation. This paper presents an efficient bit allocation scheme for atlas level compression. The proposed model establishes a model of view synthesis distortion and analyzes the impact of distortion on complete views and patches. This paper also introduces packing alignment to separate two types of patches and characterize the distortion for each MIV atlas. By considering these characteristics, the proposed model derives a bitrate ratio between texture and geometry for model-based view-rendering optimization. Experimental results showed that the proposed method achieved a more accurate reconstruction of sequences under common test conditions (CTCs).","PeriodicalId":150454,"journal":{"name":"Proceedings of the 32nd Workshop on Network and Operating Systems Support for Digital Audio and Video","volume":"21 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 32nd Workshop on Network and Operating Systems Support for Digital Audio and Video","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3534088.3534354","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 4

Abstract

The Moving Picture Experts Group (MPEG) has started an immersive media standard project to enable multi-view video and depth representation in three-dimensional (3D) scenes. The MPEG immersive video (MIV) standard explores the six degree of freedom (6DoF) technologies of immersive content to support motion parallax. Despite the standard being designed to compress multi-view immersive media, MIV coding has not been investigated from the perspective of bit allocation. This paper presents an efficient bit allocation scheme for atlas level compression. The proposed model establishes a model of view synthesis distortion and analyzes the impact of distortion on complete views and patches. This paper also introduces packing alignment to separate two types of patches and characterize the distortion for each MIV atlas. By considering these characteristics, the proposed model derives a bitrate ratio between texture and geometry for model-based view-rendering optimization. Experimental results showed that the proposed method achieved a more accurate reconstruction of sequences under common test conditions (CTCs).

查看原文本刊更多论文

针对6DoF沉浸式视频压缩的Atlas级速率失真优化

运动图像专家组(MPEG)已经启动了一个沉浸式媒体标准项目，以实现三维(3D)场景中的多视图视频和深度表示。MPEG沉浸式视频(MIV)标准探索了沉浸式内容的六自由度(6DoF)技术，以支持运动视差。尽管该标准旨在压缩多视点沉浸式媒体，但MIV编码尚未从位分配的角度进行研究。提出了一种有效的地图集级压缩比特分配方案。该模型建立了视图综合畸变模型，分析了畸变对完整视图和斑块的影响。本文还引入了填充对齐来分离两种类型的贴片，并描述了每个MIV图集的畸变。通过考虑这些特征，该模型推导出纹理和几何之间的比特率比，用于基于模型的视图渲染优化。实验结果表明，该方法在普通测试条件下能较准确地重建序列。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Proceedings of the 32nd Workshop on Network and Operating Systems Support for Digital Audio and Video

自引率

0.00%

发文量