Nonlinear analysis of video images using deep recurrent auto-associative neural networks for facial understanding

Abstract

Preliminary experiments on the deep architectures of the Auto-Associative Neural Networks demonstrated that they have a fascinating ability in complex nonlinear feature extraction, manifold formation and dimension reduction. However, they should successfully pass a serious challenge of training. Furthermore, using the valuable information inclined in video sequences is so helpful in manifold formation and recognition tasks. Considering sequential information, the recurrent networks are widely used in dynamical modeling. This paper presents a novel nine-layer deep recurrent auto-associative neural network which is capable of simultaneously extracting three different information (identity, emotion and gender) from videos of the face. The proposed framework is extensively evaluated on extended Cohn-Kanade database in analyzing dynamical facial expression. The experimental results demonstrate that the recognition rates of emotion and gender are 95.35% and 97.42%, respectively which is comparable with other state-of-the-art.