Frame-based face emotion recognition using linear discriminant analysis

In this paper, a frame-based method with reference frame was proposed to recognize six basic facial emotions (anger, disgust, fear, happy, sadness and surprise) and also neutral face. By using face landmarks, a fast algorithm was used to calculate an appropriate descriptor for each frame. Furthermore, Linear Discriminant Analysis (LDA) was used to reduce the dimension of defined descriptors and to classify them. The LDA problem was solved using the least squares solution and Ledoit-Wolf lemma. The proposed method was also compared with some studies on CK+ dataset which has the best accuracy among them. To generalize the proposed method over CK+ dataset, a landmark detector was needed. Therefore, dlib library was used for this purpose. Note that all the codes are available online at: http://ee.sharif.edu/∼hatef.otroshi/Emotion_ Recognition_LDA_2017.html.