Facial Expression Recognition: a Comparison with Different Classical and Deep Learning Methods

Abstract

Facial Expression Recognition (FER), also known as Facial Emotion Recognition, is an active topic in computer vision and machine learning fields. This paper analyzes different feature extraction and classification methods to propose an efficient facial expression recognition system. We have studied several feature extraction methods, including Histogram of Oriented Gradients (HOG), face-encoding, and the features extracted by a VGG16 Network. For classification, different classical classifiers, including Support Vector Machines (SVM), Adaptive Boosting (AdaBoost), and Logistic Regression, are evaluated with these features. Besides, we have trained a ResNet50 model from scratch and also tuned a ResNet50 which is pre-trained on VGGFace2 dataset. Finally, a part-based ensemble classifier is also proposed by focusing on different parts of face images. The experimental results provided on FER-2013 Dataset show that the tuned model of ResNet50 with a complete image of face, achieves higher performance than the other methods.