Joint forward backward error concealment of redundantly coded video

Abstract

Error concealment at the video decoder is to recover erroneous picture region based on correctly decoded region in the same frame or the neighboring frames. However, the existing error concealment methods cannot give satisfactory result in some situations, e.g. when a whole frame is lost. In this paper, we propose a novel joint forward-backward concealment (JFBC) method. The key observation is that, a future frame can be recovered without using its reference frame when some error resilience tools, such as redundant picture, are used. Based on this observation, the proposed JFBC performs temporal error concealment along not only forward direction but also backward direction. Furthermore, the JFBC combines the forward concealment result and the backward concealment result by using linear minimum mean square error (LMMSE) estimation. The JFBC estimates for each pixel an error level such that the weights in LMMSE estimation are adaptive in pixel-level. In the experiments, the JFBC achieves considerable gain over the state-of-the-art temporal error concealment method.