基于 MSA 和 1D 融合特征的中风后构音障碍语音识别。

IF 1.7 4区 医学 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Ye Wujian, Zheng Yingcong, Chen Yuehai, Liu Yijun, Mou Zhiwei
{"title":"基于 MSA 和 1D 融合特征的中风后构音障碍语音识别。","authors":"Ye Wujian, Zheng Yingcong, Chen Yuehai, Liu Yijun, Mou Zhiwei","doi":"10.1080/10255842.2024.2410228","DOIUrl":null,"url":null,"abstract":"<p><p>Post-stroke Dysarthria (PSD) is one of the common sequelae of stroke. PSD can harm patients' quality of life and, in severe cases, be life-threatening. Most of the existing methods use frequency domain features to recognize the pathological voice, which makes it hard to completely represent the characteristics of pathological voice. Although some results have been achieved, there is still a long way to go for practical applications. Therefore, an improved deep learning-based model is proposed to classify between the pathological voice and the normal voice, using a novel fusion feature (MSA) and an improved 1D ResNet network hybrid bi-directional LSTM with dilated convolution (named 1D DRN-biLSTM). The experimental results show that our fusion features bring greater improvement in pathological speech recognition than the method that only analyzes the MFCC features, and can better synthesize the hidden features that characterize pathological speech. In terms of model structure, the introduction of dilated convolution and LSTM can further improve the performance of the 1D Resnet network, compared to ordinary networks such as CNN and LSTM. The accuracy of this method reaches 82.41% and 100% at the syllable level and speaker level, respectively. Our scheme outperforms other existing methods in terms of feature learning capability and recognition rate, and will help to play an important role in the assessment and diagnosis of PSD in China.</p>","PeriodicalId":50640,"journal":{"name":"Computer Methods in Biomechanics and Biomedical Engineering","volume":" ","pages":"1-11"},"PeriodicalIF":1.7000,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Post-Stroke Dysarthria Voice Recognition based on Fusion Feature MSA and 1D.\",\"authors\":\"Ye Wujian, Zheng Yingcong, Chen Yuehai, Liu Yijun, Mou Zhiwei\",\"doi\":\"10.1080/10255842.2024.2410228\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Post-stroke Dysarthria (PSD) is one of the common sequelae of stroke. PSD can harm patients' quality of life and, in severe cases, be life-threatening. Most of the existing methods use frequency domain features to recognize the pathological voice, which makes it hard to completely represent the characteristics of pathological voice. Although some results have been achieved, there is still a long way to go for practical applications. Therefore, an improved deep learning-based model is proposed to classify between the pathological voice and the normal voice, using a novel fusion feature (MSA) and an improved 1D ResNet network hybrid bi-directional LSTM with dilated convolution (named 1D DRN-biLSTM). The experimental results show that our fusion features bring greater improvement in pathological speech recognition than the method that only analyzes the MFCC features, and can better synthesize the hidden features that characterize pathological speech. In terms of model structure, the introduction of dilated convolution and LSTM can further improve the performance of the 1D Resnet network, compared to ordinary networks such as CNN and LSTM. The accuracy of this method reaches 82.41% and 100% at the syllable level and speaker level, respectively. Our scheme outperforms other existing methods in terms of feature learning capability and recognition rate, and will help to play an important role in the assessment and diagnosis of PSD in China.</p>\",\"PeriodicalId\":50640,\"journal\":{\"name\":\"Computer Methods in Biomechanics and Biomedical Engineering\",\"volume\":\" \",\"pages\":\"1-11\"},\"PeriodicalIF\":1.7000,\"publicationDate\":\"2024-10-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer Methods in Biomechanics and Biomedical Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1080/10255842.2024.2410228\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Methods in Biomechanics and Biomedical Engineering","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1080/10255842.2024.2410228","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

中风后构音障碍(PSD)是常见的中风后遗症之一。构音障碍会损害患者的生活质量,严重时还会危及生命。现有的方法大多使用频域特征来识别病态语音,很难完全代表病态语音的特征。虽然已经取得了一些成果,但在实际应用中还有很长的路要走。因此,我们提出了一种基于深度学习的改进模型,利用一种新颖的融合特征(MSA)和一种带扩张卷积的改进型一维 ResNet 网络混合双向 LSTM(命名为一维 DRN-biLSTM)来对病态声音和正常声音进行分类。实验结果表明,与只分析 MFCC 特征的方法相比,我们的融合特征在病理语音识别方面带来了更大的改进,能更好地合成病理语音的隐藏特征。在模型结构方面,与 CNN 和 LSTM 等普通网络相比,引入扩张卷积和 LSTM 可以进一步提高一维 Resnet 网络的性能。该方法在音节级和说话人级的准确率分别达到了 82.41% 和 100%。我们的方案在特征学习能力和识别率方面都优于其他现有方法,将有助于在中国的 PSD 评估和诊断中发挥重要作用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Post-Stroke Dysarthria Voice Recognition based on Fusion Feature MSA and 1D.

Post-stroke Dysarthria (PSD) is one of the common sequelae of stroke. PSD can harm patients' quality of life and, in severe cases, be life-threatening. Most of the existing methods use frequency domain features to recognize the pathological voice, which makes it hard to completely represent the characteristics of pathological voice. Although some results have been achieved, there is still a long way to go for practical applications. Therefore, an improved deep learning-based model is proposed to classify between the pathological voice and the normal voice, using a novel fusion feature (MSA) and an improved 1D ResNet network hybrid bi-directional LSTM with dilated convolution (named 1D DRN-biLSTM). The experimental results show that our fusion features bring greater improvement in pathological speech recognition than the method that only analyzes the MFCC features, and can better synthesize the hidden features that characterize pathological speech. In terms of model structure, the introduction of dilated convolution and LSTM can further improve the performance of the 1D Resnet network, compared to ordinary networks such as CNN and LSTM. The accuracy of this method reaches 82.41% and 100% at the syllable level and speaker level, respectively. Our scheme outperforms other existing methods in terms of feature learning capability and recognition rate, and will help to play an important role in the assessment and diagnosis of PSD in China.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
4.10
自引率
6.20%
发文量
179
审稿时长
4-8 weeks
期刊介绍: The primary aims of Computer Methods in Biomechanics and Biomedical Engineering are to provide a means of communicating the advances being made in the areas of biomechanics and biomedical engineering and to stimulate interest in the continually emerging computer based technologies which are being applied in these multidisciplinary subjects. Computer Methods in Biomechanics and Biomedical Engineering will also provide a focus for the importance of integrating the disciplines of engineering with medical technology and clinical expertise. Such integration will have a major impact on health care in the future.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信