EmotionNet: ResNeXt Inspired CNN Architecture for Emotion Analysis on Raspberry Pi

Abstract

Facial Expression Recognition has seen remarkable advancements in scientific research and development in recent years. Furthermore, these advancements have enabled to efficiently extract facial features for psychological analysis, improvement of consumer experience, and research on human-computer interaction. Facial expressions play a vital role in human existence because they are a significant part of non-verbal communication. However, existing FER systems require large computational capacity, rendering them unusable for use in either small-scale systems or large-scale deployments. Presented work aims to find a solution to aforesaid problem by developing an FER system capable of running on affordable and modular devices specifically Raspberry pi. In presented work, the FER system is developed that identifies and extracts the face using OpenCV, then classifies the expressions using a ResNeXt inspired CNN architecture named EmotionNet. The classifier network was trained on the FERPlus dataset, and it achieved 70.22% micro-accuracy on the test set. An interactive GUI platform was designed using KivyMD to control the overall system. The classification of facial expression takes place into the following five categories: neutral, happy, sad, angry, and surprised. The detected emotion is used to generate a descriptive report consisting of qualitative material, in order to apprise the user of their state of emotion, and alter it in case of negative emotions. The developed system running on Raspberry Pi provides a high throughput rate of 1.33 frames per second.