Content adaptive JND profile by leveraging HVS inspired channel modeling and perception oriented energy allocation optimization

Abstract

The existing just noticeable difference (JND) models consider the effects of various covariates, however, they rarely account for the fusion relationship between the covariates, i.e., they lack a holistic understanding of the mechanisms of visual perception and disregarding the significant impact of energy consumption on visual perception. In fact, visual perception is no exception to the rule that nerve activities and energy supply are inextricably linked. Based on this insight, this paper proposes a novel JND estimation model employing content-adaptive energy allocation. Primarily, the information theory is applied to the visual perception system by conceptualizing human visual system (HVS) as an information communication framework. Then, leveraging the relationship between energy consumption and information perception, this paper quantitatively measures the HVS energy consumption as uniform metric to describe the complicated and heterogeneous HVS perception process, and then construct JND model by fusing low-level and Semantic-level features. Numerous simulation results verify that the proposed JND model is significantly competitive with other frontier models and highly compatible with HVS.