Higher quality live streaming under lower uplink bandwidth: an approach of super-resolution based video coding

Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video Pub Date : 2021-07-16 DOI:10.1145/3458306.3458874

Ying Chen, Qing Li, Aoyang Zhang, Longhao Zou, Yong Jiang, Zhimin Xu, Junlin Li, Zhenhui Yuan

{"title":"Higher quality live streaming under lower uplink bandwidth: an approach of super-resolution based video coding","authors":"Ying Chen, Qing Li, Aoyang Zhang, Longhao Zou, Yong Jiang, Zhimin Xu, Junlin Li, Zhenhui Yuan","doi":"10.1145/3458306.3458874","DOIUrl":null,"url":null,"abstract":"With the growing popularity of live streaming, high video quality and low latency with limited uplink bandwidth have become a significant challenge. In this study, we propose Live Super-Resolution Based Video Coding (LiveSRVC), a novel video uploading framework that improves the quality of live streaming with low latency under limited uplink bandwidth. We design a new super-resolution-based key frame coding module to improve the coding compression efficiency. LiveSRVC dynamically selects the bitrate and the compression ratio of key frames, mitigating the influence of uplink bandwidth capacity on live streaming quality. Trace-driven emulations verify that LiveSRVC can provide the same quality while reducing up to 50% of the required bandwidth compared to the original encoding method (H.264). LiveSRVC consumes at least 10X less GPU occupation time compared to the method of reconstructing all frames with super-resolution.","PeriodicalId":429348,"journal":{"name":"Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video","volume":"19 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"11","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3458306.3458874","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 11

Abstract

With the growing popularity of live streaming, high video quality and low latency with limited uplink bandwidth have become a significant challenge. In this study, we propose Live Super-Resolution Based Video Coding (LiveSRVC), a novel video uploading framework that improves the quality of live streaming with low latency under limited uplink bandwidth. We design a new super-resolution-based key frame coding module to improve the coding compression efficiency. LiveSRVC dynamically selects the bitrate and the compression ratio of key frames, mitigating the influence of uplink bandwidth capacity on live streaming quality. Trace-driven emulations verify that LiveSRVC can provide the same quality while reducing up to 50% of the required bandwidth compared to the original encoding method (H.264). LiveSRVC consumes at least 10X less GPU occupation time compared to the method of reconstructing all frames with super-resolution.

查看原文本刊更多论文

低上行带宽下的高质量直播:一种基于超分辨率的视频编码方法

随着网络直播的日益普及，在有限的上行带宽下实现高质量、低时延的视频传输已成为一项重大挑战。在本研究中，我们提出了一种基于实时超分辨率的视频编码(LiveSRVC)，这是一种新颖的视频上传框架，可以在有限的上行带宽下以低延迟提高直播流的质量。为了提高编码压缩效率，设计了一种新的基于超分辨率的关键帧编码模块。LiveSRVC动态选择关键帧的比特率和压缩比，减轻了上行带宽容量对直播质量的影响。跟踪驱动的仿真验证了LiveSRVC可以提供相同的质量，同时与原始编码方法(H.264)相比，所需带宽减少了50%。与使用超分辨率重建所有帧的方法相比，LiveSRVC至少节省了10倍的GPU占用时间。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

自引率

0.00%

发文量