Facial Expressions and Body Postures Emotion Recognition based on Convolutional Attention Network

Abstract

Emotion recognition plays an important role in the fields of medical care, education, services, and public safety. In the video, the emotion could be recognized through facial expressions and body postures. In this paper, we proposed the ER-FLS (Emotion Recognition based on Facial Landmark and Skeleton) Model, which could recognize emotions through the combination of the skeleton and facial landmarks. The model has a lightweight network structure and could focus on the key areas of face and skeleton landmarks with an attention mechanism. By calculating the similarity between global and local features, and update the weights, the recognition accuracy could be enhanced. The experimental analysis proved that the ER-FLS Model achieves 90.63% accuracy of emotional recognition.