Stress Detection based on TEO and MFCC speech features using Convolutional Neural Networks (CNN)

Muhammad Syafiq Nordin, A. L. Asnawi, Nur Aishah Binti Zainal, R. F. Olanrewaju, A. Jusoh, S. Ibrahim, N. F. M. Azmin
{"title":"Stress Detection based on TEO and MFCC speech features using Convolutional Neural Networks (CNN)","authors":"Muhammad Syafiq Nordin, A. L. Asnawi, Nur Aishah Binti Zainal, R. F. Olanrewaju, A. Jusoh, S. Ibrahim, N. F. M. Azmin","doi":"10.1109/ICOCO56118.2022.10031771","DOIUrl":null,"url":null,"abstract":"The effect of stress on mental and physical health is very concerning making it a fascinating and socially valuable field of study nowadays. Although a number of stress markers have been deployed, there are still issues involved with using these kinds of approaches. By developing a speech-based stress detection system, it could solve the problems faced by other currently available methods of detecting stress since it is a non-invasive and contactless approach. In this work, a fusion of Teager Energy Operator (TEO) and Mel Frequency Cepstral Coefficients (MFCC) namely Teager-MFCC (T-MFCC) are proposed as the speech features to be extracted from speech signals in recognizing stressed emotions. Since stressed emotions affect the nonlinear components of speech, TEO is applied to reflect the instantaneous energy of the components. Convolutional Neural Network (CNN) classifier is used with the proposed T- MFCC features on the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) corpus. The proposed method (T-MFCC) had shown a better performance with classification accuracies of 95.83% and 95.37% for male and female speakers respectively compared to the MFCC feature extraction technique which achieves 84.26% (male) and 93.98% (female) classification accuracies.","PeriodicalId":319652,"journal":{"name":"2022 IEEE International Conference on Computing (ICOCO)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE International Conference on Computing (ICOCO)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICOCO56118.2022.10031771","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

The effect of stress on mental and physical health is very concerning making it a fascinating and socially valuable field of study nowadays. Although a number of stress markers have been deployed, there are still issues involved with using these kinds of approaches. By developing a speech-based stress detection system, it could solve the problems faced by other currently available methods of detecting stress since it is a non-invasive and contactless approach. In this work, a fusion of Teager Energy Operator (TEO) and Mel Frequency Cepstral Coefficients (MFCC) namely Teager-MFCC (T-MFCC) are proposed as the speech features to be extracted from speech signals in recognizing stressed emotions. Since stressed emotions affect the nonlinear components of speech, TEO is applied to reflect the instantaneous energy of the components. Convolutional Neural Network (CNN) classifier is used with the proposed T- MFCC features on the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) corpus. The proposed method (T-MFCC) had shown a better performance with classification accuracies of 95.83% and 95.37% for male and female speakers respectively compared to the MFCC feature extraction technique which achieves 84.26% (male) and 93.98% (female) classification accuracies.
基于TEO和MFCC语音特征的卷积神经网络(CNN)应力检测
压力对心理和身体健康的影响是非常令人关注的,使其成为当今一个迷人的和有社会价值的研究领域。尽管已经部署了许多压力标记,但使用这些方法仍然存在一些问题。通过开发基于语音的压力检测系统,它可以解决目前其他可用的压力检测方法所面临的问题,因为它是一种非侵入性和非接触式的方法。本文提出了一种Teager能量算子(TEO)和Mel频率倒谱系数(MFCC)的融合,即Teager-MFCC (T-MFCC)作为语音信号中提取的语音特征,用于识别压力情绪。由于应激情绪会影响语音的非线性成分,因此采用TEO来反映这些成分的瞬时能量。将卷积神经网络(CNN)分类器与所提出的T- MFCC特征结合在Ryerson情感语音和歌曲视听数据库(RAVDESS)语料库上。该方法(T-MFCC)对男性和女性说话人的分类准确率分别为95.83%和95.37%,而MFCC特征提取技术对男性和女性说话人的分类准确率分别为84.26%和93.98%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信