Speech Emotion Recognition based on Interactive Convolutional Neural Network

Abstract

Speech emotion recognition (SER) plays an indispensable role in intelligent speech application. The MFCC that rich in frequency characteristic, is widely used as an input in the task of SER. However, the performance of previous work has been restricted by neglecting the interaction of different frequencies in MFCC, since the converged communication of frequency is also critical for us to generate discriminative emotion feature representations. Therefore, in this paper, we propose an interactive convolutional neural network (ICNN), where the input feature map will be factorized into different frequency scales for interactive convolution. Massive experiments have been conducted to evaluate the effects of introduced ICNN, and the results show that with the help of interactive convolution, we can reduce the redundant information of feature map effectively, and improve the accuracy of SER tasks.