基于深度学习的马拉地语料库情感计算分析

K. Bhangale, Dipali Dhake, Rupali Kawade, Triveni Dhamale, Vaishnavi Patil, Nehul Gupta, Vedangi Thakur, Tamanna Vishnoi
{"title":"基于深度学习的马拉地语料库情感计算分析","authors":"K. Bhangale, Dipali Dhake, Rupali Kawade, Triveni Dhamale, Vaishnavi Patil, Nehul Gupta, Vedangi Thakur, Tamanna Vishnoi","doi":"10.1109/CONIT59222.2023.10205770","DOIUrl":null,"url":null,"abstract":"Speech Emotion Recognition (SER) has a broad variety of potential applications, including improving human-computer interaction in virtual reality and gaming environments, improving the identification and monitoring of mental health conditions, and improving the accuracy of chatbots and speech-based assistants. It must contend with cross-corpus SER, intonation and dialectal differences, as well as prosodic shifts brought on by factors like age, gender, locality, and religion. Deep Convolution Neural Network-based SER for Marathi is presented in this study. For the emotions of anger, happiness, sadness, and neutrality, our fresh Marathi data set includes 300 recordings of 15 speakers. On the basis of accuracy, precision, recall, and F1-score, the performance of the proposed DCNN is assessed using the new data set. The proposed scheme offers overall data accuracy of 0.4750, 0.4076, and 0.3927 for 5, 10, and 15 speakers, respectively, and overall accuracy of 0.6652, 0.6361, and 0.5800 for 5, 10, and 15 speakers, respectively, after feature extraction, which represents an improvement over the current state of the art used for SER for Marathi Corpus.","PeriodicalId":377623,"journal":{"name":"2023 3rd International Conference on Intelligent Technologies (CONIT)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Learning-based Analysis of Affective Computing for Marathi Corpus\",\"authors\":\"K. Bhangale, Dipali Dhake, Rupali Kawade, Triveni Dhamale, Vaishnavi Patil, Nehul Gupta, Vedangi Thakur, Tamanna Vishnoi\",\"doi\":\"10.1109/CONIT59222.2023.10205770\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Speech Emotion Recognition (SER) has a broad variety of potential applications, including improving human-computer interaction in virtual reality and gaming environments, improving the identification and monitoring of mental health conditions, and improving the accuracy of chatbots and speech-based assistants. It must contend with cross-corpus SER, intonation and dialectal differences, as well as prosodic shifts brought on by factors like age, gender, locality, and religion. Deep Convolution Neural Network-based SER for Marathi is presented in this study. For the emotions of anger, happiness, sadness, and neutrality, our fresh Marathi data set includes 300 recordings of 15 speakers. On the basis of accuracy, precision, recall, and F1-score, the performance of the proposed DCNN is assessed using the new data set. The proposed scheme offers overall data accuracy of 0.4750, 0.4076, and 0.3927 for 5, 10, and 15 speakers, respectively, and overall accuracy of 0.6652, 0.6361, and 0.5800 for 5, 10, and 15 speakers, respectively, after feature extraction, which represents an improvement over the current state of the art used for SER for Marathi Corpus.\",\"PeriodicalId\":377623,\"journal\":{\"name\":\"2023 3rd International Conference on Intelligent Technologies (CONIT)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 3rd International Conference on Intelligent Technologies (CONIT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CONIT59222.2023.10205770\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 3rd International Conference on Intelligent Technologies (CONIT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CONIT59222.2023.10205770","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

语音情感识别(SER)具有广泛的潜在应用,包括改善虚拟现实和游戏环境中的人机交互,改善心理健康状况的识别和监测,以及提高聊天机器人和基于语音的助手的准确性。它必须应对跨语料库的SER、语调和方言差异,以及年龄、性别、地域和宗教等因素带来的韵律变化。本文提出了一种基于深度卷积神经网络的马拉地语语音识别方法。对于愤怒、快乐、悲伤和中立的情绪,我们的新马拉地语数据集包括15个说话者的300个录音。在准确度、精密度、召回率和f1分数的基础上,使用新数据集评估了所提出的DCNN的性能。经过特征提取后,该方案对5、10和15名说话者的总体数据精度分别为0.4750、0.4076和0.3927,对5、10和15名说话者的总体数据精度分别为0.6652、0.6361和0.5800,比马拉地语语料库SER使用的当前技术水平有了提高。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep Learning-based Analysis of Affective Computing for Marathi Corpus
Speech Emotion Recognition (SER) has a broad variety of potential applications, including improving human-computer interaction in virtual reality and gaming environments, improving the identification and monitoring of mental health conditions, and improving the accuracy of chatbots and speech-based assistants. It must contend with cross-corpus SER, intonation and dialectal differences, as well as prosodic shifts brought on by factors like age, gender, locality, and religion. Deep Convolution Neural Network-based SER for Marathi is presented in this study. For the emotions of anger, happiness, sadness, and neutrality, our fresh Marathi data set includes 300 recordings of 15 speakers. On the basis of accuracy, precision, recall, and F1-score, the performance of the proposed DCNN is assessed using the new data set. The proposed scheme offers overall data accuracy of 0.4750, 0.4076, and 0.3927 for 5, 10, and 15 speakers, respectively, and overall accuracy of 0.6652, 0.6361, and 0.5800 for 5, 10, and 15 speakers, respectively, after feature extraction, which represents an improvement over the current state of the art used for SER for Marathi Corpus.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信