A novel framework of frame rate up conversion integrated within HEVC coding

Frame rate up conversion (FRUC) is a key technology for providing high frame rate video with better visual quality, but at the cost of huge computational complexity and bandwidth consumption. In this paper, a standard compatible framework of FRUC integrated within high efficiency video coding (HEVC) is innovatively proposed. First, spatial and temporal motion candidates of skip mode are collected and employed for the motion estimation of FRUC, where FRUC selects the best motion vectors (MVs) according to the texture-aware criterion based on coding block size. Then, the interpolated frame is handed over to HEVC coding and mostly encoded as skip mode, which consumes very limited bits. Experimental results show that the proposed method has a great advantage both in computational complexity and bandwidth consumption compared with the traditional method of FRUC cascaded with coding.