Low-lighting video enhancement using constrained spatial-temporal model for real-time mobile communication

Abstract

Video quality in real-time mobile communication is often influenced by the ambient light. In the low-lighting condition, videos in real-time mobile communication are usually dark and lack details. To solve the above problem, we propose a fast low-lighting video enhancement algorithm by exploiting the constrained spatial-temporal model, in which three terms including luminance accuracy, contrast accuracy and temporal consistency are all considered. For the first term, the average luminance level of each frame is taken into account of a set of the off-line trained luminance enhancement functions. For the second term, the adjustment of the luminance range in the frame based statistical histogram is obtained for the adaptive contrast enhancement function. For the third term, the temporal consistency is utilized by considering the current enhancement function and these of the previous frames to avoid the flicker between these adjacent frames. Furthermore, the proposed method has been already implemented on Wechat, a social application that connects 800 million people with chat, calls and more. Extensive experiments demonstrate that the proposed method achieves better enhancement results than many current state-of-the-art methods.