{"title":"基于卷积神经网络的语音情感识别系统特征对比分析","authors":"Prachii Kumar, K. S. Shushrutha","doi":"10.1109/ISPACS51563.2021.9651089","DOIUrl":null,"url":null,"abstract":"In the past decade, Speech Emotion Recognition (SER) in many spoken languages has become a field of growing interest. MFCCs (Mel Frequency Cepstrum Coefficients) are commonly utilized representations for audio classification, and are now becoming a prominent feature in SER systems. However, in the view of a performance analysis, there exists another feature named PCEN (Per Channel Energy Normalization) that has proven to outperform MFCCs in the context of speech. In order to compare the performances of the MFCC and PCEN, they have individually been used as inputs into a one dimensional Convolutional Neural Network (CNN). The samples from the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) were utilized. Furthermore, the framework proposed in this paper obtains an accuracy of 85.3% for the configuration that utilizes PCEN, 77.4% for the configuration that uses only the MFCCs as inputs, and 78.1% that combines both.","PeriodicalId":359822,"journal":{"name":"2021 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Comparative Analysis of Features In a Speech Emotion Recognition System using Convolutional Neural Networks\",\"authors\":\"Prachii Kumar, K. S. Shushrutha\",\"doi\":\"10.1109/ISPACS51563.2021.9651089\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the past decade, Speech Emotion Recognition (SER) in many spoken languages has become a field of growing interest. MFCCs (Mel Frequency Cepstrum Coefficients) are commonly utilized representations for audio classification, and are now becoming a prominent feature in SER systems. However, in the view of a performance analysis, there exists another feature named PCEN (Per Channel Energy Normalization) that has proven to outperform MFCCs in the context of speech. In order to compare the performances of the MFCC and PCEN, they have individually been used as inputs into a one dimensional Convolutional Neural Network (CNN). The samples from the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) were utilized. Furthermore, the framework proposed in this paper obtains an accuracy of 85.3% for the configuration that utilizes PCEN, 77.4% for the configuration that uses only the MFCCs as inputs, and 78.1% that combines both.\",\"PeriodicalId\":359822,\"journal\":{\"name\":\"2021 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS)\",\"volume\":\"10 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-11-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISPACS51563.2021.9651089\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISPACS51563.2021.9651089","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
摘要
在过去的十年中,许多口语语言的语音情感识别(SER)已经成为一个越来越受关注的领域。MFCCs (Mel Frequency倒谱系数)是音频分类中常用的表征,目前已成为SER系统中的一个重要特征。然而,从性能分析的角度来看,存在另一个被称为PCEN (Per Channel Energy Normalization)的特征,该特征已被证明在语音环境中优于mfc。为了比较MFCC和PCEN的性能,将它们分别作为一维卷积神经网络(CNN)的输入。使用的样本来自Ryerson情绪言语与歌曲视听数据库(RAVDESS)。此外,本文提出的框架在使用PCEN的配置中获得了85.3%的准确率,在仅使用mfc作为输入的配置中获得了77.4%的准确率,在两者结合的配置中获得了78.1%的准确率。
Comparative Analysis of Features In a Speech Emotion Recognition System using Convolutional Neural Networks
In the past decade, Speech Emotion Recognition (SER) in many spoken languages has become a field of growing interest. MFCCs (Mel Frequency Cepstrum Coefficients) are commonly utilized representations for audio classification, and are now becoming a prominent feature in SER systems. However, in the view of a performance analysis, there exists another feature named PCEN (Per Channel Energy Normalization) that has proven to outperform MFCCs in the context of speech. In order to compare the performances of the MFCC and PCEN, they have individually been used as inputs into a one dimensional Convolutional Neural Network (CNN). The samples from the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) were utilized. Furthermore, the framework proposed in this paper obtains an accuracy of 85.3% for the configuration that utilizes PCEN, 77.4% for the configuration that uses only the MFCCs as inputs, and 78.1% that combines both.