基于emg的实时人机交互手势识别的联邦学习增强边缘深度学习模型

IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Muhammad Hamza Zafar;Syed Kumayl Raza Moosavi;Filippo Sanfilippo
{"title":"基于emg的实时人机交互手势识别的联邦学习增强边缘深度学习模型","authors":"Muhammad Hamza Zafar;Syed Kumayl Raza Moosavi;Filippo Sanfilippo","doi":"10.1109/JSEN.2025.3529841","DOIUrl":null,"url":null,"abstract":"Electromyography (EMG)-based gesture detection plays a crucial role in human-robot interaction (HRI), providing a seamless interface for controlling robotic systems through muscle activity. Despite its potential, EMG systems face significant challenges related to the security and privacy of sensitive biometric data, as well as the computational limitations of deploying deep learning (DL) models on edge devices. To address these issues, we propose a federated learning (FL)-based DL model for EMG gesture recognition, specifically designed for edge devices. Our model utilizes a custom dataset collected using a Mindrove eight-channel EMG armband, capturing eight distinct hand gestures—rest, move left, move right, move down, move up, open fingers, close fist, and twist hand—from ten subjects with seven repetitions each, ensuring diverse and robust data for training. During preprocessing, a bandpass filter (50–450 Hz) was applied to remove noise and enhance signal quality, followed by a short-term frequency transform (STFT) with a 200-ms sample time and 50% overlap to extract relevant features from the EMG signals. The dataset was segmented into training and testing sets with a 70/30 split for evaluation. We evaluate several FL techniques, including FedAvg, FedProx, and FedSGD, demonstrating that FedAvg achieves the highest accuracy of 96.92% without quantization with Scenario 9 (15 epochs, 20 rounds) with minimal communication overhead. Additionally, our model is quantized, resulting in an 89% reduction in size and a high accuracy of 95.99%, representing a minimal loss of 0.93%, making it ideal for edge deployment without compromising performance. A comparative analysis with other DL models, such as multiconvolutional residual networks (MCRNs), multiconvolutional neural networks (MCNNs), temporal convolutional networks (TCNs), and InceptionNet, shows that our approach outperforms these models in both accuracy and efficiency. Experimental results validate the high accuracy of our model in both training/testing and real-time disaster scenario simulations using the Spot robot. The proposed solution provides a secure, efficient, and highly accurate framework for EMG-based gesture recognition on edge devices, ideal for HRI and assistive technologies such as in search and rescue operations.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 5","pages":"9139-9151"},"PeriodicalIF":4.3000,"publicationDate":"2025-01-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Federated Learning-Enhanced Edge Deep Learning Model for EMG-Based Gesture Recognition in Real-Time Human–Robot Interaction\",\"authors\":\"Muhammad Hamza Zafar;Syed Kumayl Raza Moosavi;Filippo Sanfilippo\",\"doi\":\"10.1109/JSEN.2025.3529841\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Electromyography (EMG)-based gesture detection plays a crucial role in human-robot interaction (HRI), providing a seamless interface for controlling robotic systems through muscle activity. Despite its potential, EMG systems face significant challenges related to the security and privacy of sensitive biometric data, as well as the computational limitations of deploying deep learning (DL) models on edge devices. To address these issues, we propose a federated learning (FL)-based DL model for EMG gesture recognition, specifically designed for edge devices. Our model utilizes a custom dataset collected using a Mindrove eight-channel EMG armband, capturing eight distinct hand gestures—rest, move left, move right, move down, move up, open fingers, close fist, and twist hand—from ten subjects with seven repetitions each, ensuring diverse and robust data for training. During preprocessing, a bandpass filter (50–450 Hz) was applied to remove noise and enhance signal quality, followed by a short-term frequency transform (STFT) with a 200-ms sample time and 50% overlap to extract relevant features from the EMG signals. The dataset was segmented into training and testing sets with a 70/30 split for evaluation. We evaluate several FL techniques, including FedAvg, FedProx, and FedSGD, demonstrating that FedAvg achieves the highest accuracy of 96.92% without quantization with Scenario 9 (15 epochs, 20 rounds) with minimal communication overhead. Additionally, our model is quantized, resulting in an 89% reduction in size and a high accuracy of 95.99%, representing a minimal loss of 0.93%, making it ideal for edge deployment without compromising performance. A comparative analysis with other DL models, such as multiconvolutional residual networks (MCRNs), multiconvolutional neural networks (MCNNs), temporal convolutional networks (TCNs), and InceptionNet, shows that our approach outperforms these models in both accuracy and efficiency. Experimental results validate the high accuracy of our model in both training/testing and real-time disaster scenario simulations using the Spot robot. The proposed solution provides a secure, efficient, and highly accurate framework for EMG-based gesture recognition on edge devices, ideal for HRI and assistive technologies such as in search and rescue operations.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 5\",\"pages\":\"9139-9151\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-01-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10847750/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10847750/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

基于肌电图(EMG)的手势检测在人机交互(HRI)中起着至关重要的作用,为通过肌肉活动控制机器人系统提供了无缝接口。尽管具有潜力,但肌电图系统面临着与敏感生物特征数据的安全性和隐私性相关的重大挑战,以及在边缘设备上部署深度学习(DL)模型的计算限制。为了解决这些问题,我们提出了一种专门为边缘设备设计的基于联邦学习(FL)的肌电信号手势识别深度学习模型。我们的模型使用mindrive八通道肌电信号臂带收集的自定义数据集,捕获八个不同的手势-休息,向左移动,向右移动,向下移动,向上移动,张开手指,握紧拳头和扭曲手-来自10个受试者,每个受试者重复7次,确保训练数据的多样性和鲁棒性。在预处理过程中,采用带通滤波器(50-450 Hz)去除噪声,增强信号质量,然后采用200 ms采样时间和50%重叠的短期频率变换(STFT)从肌电信号中提取相关特征。数据集被分割成训练集和测试集,以70/30的分割进行评估。我们评估了几种FL技术,包括FedAvg, FedProx和FedSGD,证明FedAvg在场景9(15个epoch, 20轮)以最小的通信开销实现了96.92%的最高准确率,而没有量化。此外,我们的模型是量化的,导致尺寸减少89%,准确率高达95.99%,代表最小损失0.93%,使其成为边缘部署的理想选择,而不会影响性能。与其他深度学习模型(如多卷积残差网络(MCRNs)、多卷积神经网络(mcnn)、时间卷积网络(TCNs)和InceptionNet)的比较分析表明,我们的方法在准确性和效率方面都优于这些模型。实验结果验证了我们的模型在Spot机器人的训练/测试和实时灾难场景模拟中的高准确性。提出的解决方案为边缘设备上基于肌电图的手势识别提供了一个安全、高效和高度准确的框架,非常适合HRI和辅助技术,如搜索和救援行动。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Federated Learning-Enhanced Edge Deep Learning Model for EMG-Based Gesture Recognition in Real-Time Human–Robot Interaction
Electromyography (EMG)-based gesture detection plays a crucial role in human-robot interaction (HRI), providing a seamless interface for controlling robotic systems through muscle activity. Despite its potential, EMG systems face significant challenges related to the security and privacy of sensitive biometric data, as well as the computational limitations of deploying deep learning (DL) models on edge devices. To address these issues, we propose a federated learning (FL)-based DL model for EMG gesture recognition, specifically designed for edge devices. Our model utilizes a custom dataset collected using a Mindrove eight-channel EMG armband, capturing eight distinct hand gestures—rest, move left, move right, move down, move up, open fingers, close fist, and twist hand—from ten subjects with seven repetitions each, ensuring diverse and robust data for training. During preprocessing, a bandpass filter (50–450 Hz) was applied to remove noise and enhance signal quality, followed by a short-term frequency transform (STFT) with a 200-ms sample time and 50% overlap to extract relevant features from the EMG signals. The dataset was segmented into training and testing sets with a 70/30 split for evaluation. We evaluate several FL techniques, including FedAvg, FedProx, and FedSGD, demonstrating that FedAvg achieves the highest accuracy of 96.92% without quantization with Scenario 9 (15 epochs, 20 rounds) with minimal communication overhead. Additionally, our model is quantized, resulting in an 89% reduction in size and a high accuracy of 95.99%, representing a minimal loss of 0.93%, making it ideal for edge deployment without compromising performance. A comparative analysis with other DL models, such as multiconvolutional residual networks (MCRNs), multiconvolutional neural networks (MCNNs), temporal convolutional networks (TCNs), and InceptionNet, shows that our approach outperforms these models in both accuracy and efficiency. Experimental results validate the high accuracy of our model in both training/testing and real-time disaster scenario simulations using the Spot robot. The proposed solution provides a secure, efficient, and highly accurate framework for EMG-based gesture recognition on edge devices, ideal for HRI and assistive technologies such as in search and rescue operations.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Sensors Journal
IEEE Sensors Journal 工程技术-工程:电子与电气
CiteScore
7.70
自引率
14.00%
发文量
2058
审稿时长
5.2 months
期刊介绍: The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following: -Sensor Phenomenology, Modelling, and Evaluation -Sensor Materials, Processing, and Fabrication -Chemical and Gas Sensors -Microfluidics and Biosensors -Optical Sensors -Physical Sensors: Temperature, Mechanical, Magnetic, and others -Acoustic and Ultrasonic Sensors -Sensor Packaging -Sensor Networks -Sensor Applications -Sensor Systems: Signals, Processing, and Interfaces -Actuators and Sensor Power Systems -Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting -Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data) -Sensors in Industrial Practice
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信