Nils Genser, Jürgen Seiler, Franz Schilling, André Kaup
{"title":"Signal and Loss Geometry Aware Frequency Selective Extrapolation for Error Concealment","authors":"Nils Genser, Jürgen Seiler, Franz Schilling, André Kaup","doi":"10.1109/PCS.2018.8456259","DOIUrl":null,"url":null,"abstract":"The concealment of errors is an important task in image and video signal processing. Often, complex models are calculated to reconstruct the missing samples, which results in a long computation time. One method that achieves a very high reconstruction quality, but demands a moderate computational complexity only, is the block based Frequency Selective Extrapolation. Nevertheless, the reconstruction of a Full HD image can still take several minutes depending on the error pattern. To accelerate the computation, a novel algorithm is introduced in this paper that analyzes the adjacent, undistorted samples and optimizes the reconstruction parameters accordingly. Moreover, the analyzation is further used to adapt the partitioning of the blocks and the processing order. Similar to modern video codecs, e.g., High Efficiency Video Coding, a content based partitioning and processing is proposed as it takes the signal characteristics into account. Thus, the novel algorithm is on average four times faster than the state-of-the-art method and up to $25\\times $ quicker at best, while achieving a slightly higher reconstruction quality as well.","PeriodicalId":433667,"journal":{"name":"2018 Picture Coding Symposium (PCS)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 Picture Coding Symposium (PCS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/PCS.2018.8456259","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4
Abstract
The concealment of errors is an important task in image and video signal processing. Often, complex models are calculated to reconstruct the missing samples, which results in a long computation time. One method that achieves a very high reconstruction quality, but demands a moderate computational complexity only, is the block based Frequency Selective Extrapolation. Nevertheless, the reconstruction of a Full HD image can still take several minutes depending on the error pattern. To accelerate the computation, a novel algorithm is introduced in this paper that analyzes the adjacent, undistorted samples and optimizes the reconstruction parameters accordingly. Moreover, the analyzation is further used to adapt the partitioning of the blocks and the processing order. Similar to modern video codecs, e.g., High Efficiency Video Coding, a content based partitioning and processing is proposed as it takes the signal characteristics into account. Thus, the novel algorithm is on average four times faster than the state-of-the-art method and up to $25\times $ quicker at best, while achieving a slightly higher reconstruction quality as well.
错误隐藏是图像和视频信号处理中的一项重要任务。通常需要计算复杂的模型来重建缺失的样本,这导致计算时间很长。基于分块的频率选择外推法是一种实现高质量重构的方法,但只需要适度的计算复杂度。然而,全高清图像的重建仍然需要几分钟,这取决于错误模式。为了加快计算速度,本文介绍了一种新的算法,该算法对相邻的、未失真的样本进行分析,并相应地优化重建参数。此外,还进一步利用分析来调整块的划分和处理顺序。与高效视频编码(High Efficiency video Coding)等现代视频编解码器类似,本文提出了一种考虑信号特性的基于内容的分割和处理方法。因此,新算法的平均速度比最先进的方法快4倍,最多快25倍,同时实现了略高的重建质量。