Interpolation of lost frames of a video stream using object based motion estimation and compensation

Abstract

While transmitting a video stream some frames may be lost due to noise or congestion in the network. For interpolating the lost frames using the received frames various techniques were proposed, but these techniques are good only for slow motion video. For fast motion video, these interpolating techniques create artifacts in the interpolated frames. We propose a new technique for interpolating lost frames using object based motion estimation and compensation. The proposed method is based on the estimation of displacements of the minimum bounding box (MBB) sides of an object. From the received frames we first detect the type of motion (translation, rotation, part rotation) that the object has undergone. Then, after detecting the motion and the displacement of the object from one received frame to another received frame, the object in the missing frame is linearly interpolated from the object motion and the positions of the object in the two received frames.