一种基于表面肌电信号的变速无声语音识别方法

Sui Liang, Yin Xu, Zhaohua Yuan, Lining Sun, Weida Li, Hongmiao Zhang
{"title":"一种基于表面肌电信号的变速无声语音识别方法","authors":"Sui Liang, Yin Xu, Zhaohua Yuan, Lining Sun, Weida Li, Hongmiao Zhang","doi":"10.1109/ICARM58088.2023.10218782","DOIUrl":null,"url":null,"abstract":"In the practical implementation of silent speech recognition based on surface electromyography (sEMG) signal, the change in the subjects' speech speed will affect the recognition performance. To mitigate this effect, a silent speech recognition method based on dynamic time warping (DTW) algorithm is proposed in this paper. Specifically, the facial sEMG signals of 22 Chinese words are collected, the energy threshold method is used to detect the active segment, the root mean square feature is extracted, and finally the DTW algorithm is used for recognition. The experimental results show that the method is robust to silent speech recognition tasks with different speech speeds. The average accuracy of using the DTW algorithm to classify uniform-speed words is 94.55%, and that of variable-speed words is 71.82%. In addition, the proposed method is suitable for few samples learning, which means it can quickly adapt to new tasks and individuals. These findings provide a novel way for the practical application of sEMG based silent speech recognition.","PeriodicalId":220013,"journal":{"name":"2023 International Conference on Advanced Robotics and Mechatronics (ICARM)","volume":"25 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Variable-speed Silent Speech Recognition Method based on Surface Electromyography Signal\",\"authors\":\"Sui Liang, Yin Xu, Zhaohua Yuan, Lining Sun, Weida Li, Hongmiao Zhang\",\"doi\":\"10.1109/ICARM58088.2023.10218782\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the practical implementation of silent speech recognition based on surface electromyography (sEMG) signal, the change in the subjects' speech speed will affect the recognition performance. To mitigate this effect, a silent speech recognition method based on dynamic time warping (DTW) algorithm is proposed in this paper. Specifically, the facial sEMG signals of 22 Chinese words are collected, the energy threshold method is used to detect the active segment, the root mean square feature is extracted, and finally the DTW algorithm is used for recognition. The experimental results show that the method is robust to silent speech recognition tasks with different speech speeds. The average accuracy of using the DTW algorithm to classify uniform-speed words is 94.55%, and that of variable-speed words is 71.82%. In addition, the proposed method is suitable for few samples learning, which means it can quickly adapt to new tasks and individuals. These findings provide a novel way for the practical application of sEMG based silent speech recognition.\",\"PeriodicalId\":220013,\"journal\":{\"name\":\"2023 International Conference on Advanced Robotics and Mechatronics (ICARM)\",\"volume\":\"25 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-07-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 International Conference on Advanced Robotics and Mechatronics (ICARM)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICARM58088.2023.10218782\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Advanced Robotics and Mechatronics (ICARM)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICARM58088.2023.10218782","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在实际实现基于表面肌电信号的无声语音识别时,被试语速的变化会影响识别效果。为了减轻这种影响,本文提出了一种基于动态时间规整(DTW)算法的无声语音识别方法。具体而言,采集22个中文单词的面部肌电信号,利用能量阈值法检测活动片段,提取均方根特征,最后利用DTW算法进行识别。实验结果表明,该方法对不同语速的无声语音识别任务具有较强的鲁棒性。使用DTW算法对匀速词分类的平均准确率为94.55%,对变速词分类的平均准确率为71.82%。此外,该方法适用于少量样本学习,这意味着它可以快速适应新的任务和个体。这些发现为基于表面肌电信号的无声语音识别的实际应用提供了一条新的途径。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Variable-speed Silent Speech Recognition Method based on Surface Electromyography Signal
In the practical implementation of silent speech recognition based on surface electromyography (sEMG) signal, the change in the subjects' speech speed will affect the recognition performance. To mitigate this effect, a silent speech recognition method based on dynamic time warping (DTW) algorithm is proposed in this paper. Specifically, the facial sEMG signals of 22 Chinese words are collected, the energy threshold method is used to detect the active segment, the root mean square feature is extracted, and finally the DTW algorithm is used for recognition. The experimental results show that the method is robust to silent speech recognition tasks with different speech speeds. The average accuracy of using the DTW algorithm to classify uniform-speed words is 94.55%, and that of variable-speed words is 71.82%. In addition, the proposed method is suitable for few samples learning, which means it can quickly adapt to new tasks and individuals. These findings provide a novel way for the practical application of sEMG based silent speech recognition.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信