Recurrent Neural Network Enabled Continuous Motion Estimation of Lower Limb Joints From Incomplete sEMG Signals

IF 4.8 2区 医学 Q2 ENGINEERING, BIOMEDICAL
Gang Wang;Long Jin;Jiliang Zhang;Xiaoqin Duan;Jiang Yi;Mingming Zhang;Zhongbo Sun
{"title":"Recurrent Neural Network Enabled Continuous Motion Estimation of Lower Limb Joints From Incomplete sEMG Signals","authors":"Gang Wang;Long Jin;Jiliang Zhang;Xiaoqin Duan;Jiang Yi;Mingming Zhang;Zhongbo Sun","doi":"10.1109/TNSRE.2024.3459924","DOIUrl":null,"url":null,"abstract":"Decoding continuous human motion from surface electromyography (sEMG) in advance is crucial for improving the intelligence of exoskeleton robots. However, incomplete sEMG signals are prevalent on account of unstable data transmission, sensor malfunction, and electrode sheet detachment. These non-ideal factors severely compromise the accuracy of continuous motion recognition and the reliability of clinical applications. To tackle this challenge, this paper develops a multi-task parallel learning framework for continuous motion estimation with incomplete sEMG signals. Concretely, a residual network is incorporated into a recurrent neural network to integrate the information flow of hidden states and reconstruct random and consecutive missing sEMG signals. The attention mechanism is applied for redistributing the distribution of weights. A jointly optimized loss function is devised to enable training the model for simultaneously dealing with signal anomalies/absences and multi-joint continuous motion estimation. The proposed model is implemented for estimating hip, knee, and ankle joint angles of physically competent individuals and patients during diverse exercises. Experimental results indicate that the estimation root-mean-square errors with 60% missing sEMG signals steadily converges to below 5 degrees. Even with multi-channel electrode sheet shedding, our model still demonstrates cutting-edge estimation performance, errors only marginally increase 1 degree.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"32 ","pages":"3577-3589"},"PeriodicalIF":4.8000,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10680114","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10680114/","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Decoding continuous human motion from surface electromyography (sEMG) in advance is crucial for improving the intelligence of exoskeleton robots. However, incomplete sEMG signals are prevalent on account of unstable data transmission, sensor malfunction, and electrode sheet detachment. These non-ideal factors severely compromise the accuracy of continuous motion recognition and the reliability of clinical applications. To tackle this challenge, this paper develops a multi-task parallel learning framework for continuous motion estimation with incomplete sEMG signals. Concretely, a residual network is incorporated into a recurrent neural network to integrate the information flow of hidden states and reconstruct random and consecutive missing sEMG signals. The attention mechanism is applied for redistributing the distribution of weights. A jointly optimized loss function is devised to enable training the model for simultaneously dealing with signal anomalies/absences and multi-joint continuous motion estimation. The proposed model is implemented for estimating hip, knee, and ankle joint angles of physically competent individuals and patients during diverse exercises. Experimental results indicate that the estimation root-mean-square errors with 60% missing sEMG signals steadily converges to below 5 degrees. Even with multi-channel electrode sheet shedding, our model still demonstrates cutting-edge estimation performance, errors only marginally increase 1 degree.
利用递归神经网络,从不完整的 sEMG 信号估算下肢关节的连续运动情况
提前从表面肌电图(sEMG)中解码连续的人体运动对于提高外骨骼机器人的智能至关重要。然而,由于数据传输不稳定、传感器故障和电极片脱落等原因,不完整的 sEMG 信号十分普遍。这些非理想因素严重影响了连续运动识别的准确性和临床应用的可靠性。为了应对这一挑战,本文开发了一种多任务并行学习框架,用于不完整 sEMG 信号下的连续运动估计。具体来说,在递归神经网络中加入残差网络,以整合隐藏状态的信息流,重建随机和连续缺失的 sEMG 信号。注意力机制用于重新分配权重。设计了一个联合优化的损失函数,以训练模型同时处理信号异常/缺失和多关节连续运动估计。所提出的模型可用于估计体能良好的个人和病人在各种运动中的髋关节、膝关节和踝关节角度。实验结果表明,在 sEMG 信号缺失率为 60% 的情况下,估算的均方根误差稳定收敛到 5 度以下。即使在多通道电极片脱落的情况下,我们的模型仍然表现出最先进的估计性能,误差仅略微增加 1 度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
8.60
自引率
8.20%
发文量
479
审稿时长
6-12 weeks
期刊介绍: Rehabilitative and neural aspects of biomedical engineering, including functional electrical stimulation, acoustic dynamics, human performance measurement and analysis, nerve stimulation, electromyography, motor control and stimulation; and hardware and software applications for rehabilitation engineering and assistive devices.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信