Zhenyu Lin, Philip Liang, Xiaorong Zhang, Zhuwei Qin
{"title":"Toward Robust High-Density EMG Pattern Recognition using Generative Adversarial Network and Convolutional Neural Network","authors":"Zhenyu Lin, Philip Liang, Xiaorong Zhang, Zhuwei Qin","doi":"10.1109/NER52421.2023.10123910","DOIUrl":null,"url":null,"abstract":"High-density electromyography (HD EMG)-based Pattern Recognition (PR) has attracted increasing interest in real-time Neural-Machine Interface (NMI) applications because HD EMG can capture neuromuscular information from one temporal and two spatial dimensions, and it does not require anatomically targeted electrode placements. In recent years, deep learning methods such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and hybrid CNN-RNN methods have shown great potential in HD EMG PR. Due to the high-density and multi-channel characteristics of HD EMG, the use of HD EMG-based NMIs in practice may be challenged by the unreliability of HD EMG recordings over time. So far, few studies have investigated the robustness of deep learning methods on HD EMG PR when noises and disturbances such as motion artifacts and bad contacts are present in the HD EMG signals. In this paper, we have developed RoHDE - a Robust deep learning-based HD EMG PR framework by introducing a Generative Adversarial Network (GAN) that can generate synthetic HD EMG signals to simulate recording conditions affected by disturbances. The generated synthetic HD EMG signals can be utilized to train robust deep learning models against real HD EMG signal disturbances. Experimental results have shown that our proposed RoHDE framework can improve the classification accuracy against disturbances such as contact artifacts and loose contacts from 64% to 99%. To the best of our knowledge, this work is the first to address the intrinsic robustness issue of deep learning-based HD EMG PR.","PeriodicalId":201841,"journal":{"name":"2023 11th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"232 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 11th International IEEE/EMBS Conference on Neural Engineering (NER)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NER52421.2023.10123910","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
High-density electromyography (HD EMG)-based Pattern Recognition (PR) has attracted increasing interest in real-time Neural-Machine Interface (NMI) applications because HD EMG can capture neuromuscular information from one temporal and two spatial dimensions, and it does not require anatomically targeted electrode placements. In recent years, deep learning methods such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and hybrid CNN-RNN methods have shown great potential in HD EMG PR. Due to the high-density and multi-channel characteristics of HD EMG, the use of HD EMG-based NMIs in practice may be challenged by the unreliability of HD EMG recordings over time. So far, few studies have investigated the robustness of deep learning methods on HD EMG PR when noises and disturbances such as motion artifacts and bad contacts are present in the HD EMG signals. In this paper, we have developed RoHDE - a Robust deep learning-based HD EMG PR framework by introducing a Generative Adversarial Network (GAN) that can generate synthetic HD EMG signals to simulate recording conditions affected by disturbances. The generated synthetic HD EMG signals can be utilized to train robust deep learning models against real HD EMG signal disturbances. Experimental results have shown that our proposed RoHDE framework can improve the classification accuracy against disturbances such as contact artifacts and loose contacts from 64% to 99%. To the best of our knowledge, this work is the first to address the intrinsic robustness issue of deep learning-based HD EMG PR.