Spatiotemporal Emotion Recognition Method Based on EEG Signals During Music Listening Using 1D-CNN & Stacked-LSTM

Abstract

Recognizing people's emotions accurately can help to improve people's feeling of happiness by adjusting their emotion immediately, which makes emotion recognition an active research topic recently. Electroencephalography (EEG) signals, which are electrical response of the human brain scalp, reflecting people's emotions and psychological activities, can be applied as an important tool for the emotion recognition. This paper focuses on the emotion recognition based on EEG signals during music listening. To this end, we first propose an emotion recognition scheme by combining the one-dimensional convolutional neural network (1D-CNN) and the stacked long short term memory (Stacked-LSTM), where the 1D-CNN is exploited to extract spatial features from EEG signals automatically and the Stacked-LSTM is applied for further temporal features extraction. We then conducted lots of experiments to validate the efficiency of our proposed scheme regarding the accuracy of emotion recognition. Finally, a comparison between our proposed scheme and other commonly methods used for emotion recognition based EEG signals (e.g., EEGNet, 1D-CNN, LSTM and SVM). The experimental results showed that our proposed scheme is feasible and outperform other commonly used methods in terms of classification accuracy.