{"title":"Cross-domain prediction approach of human lower limb voluntary movement intention for exoskeleton robot based on EEG signals.","authors":"Runlin Dong, Xiaodong Zhang, Hanzhe Li, Zhufeng Lu, Cunxin Li, Aibin Zhu","doi":"10.3389/fbioe.2024.1448903","DOIUrl":null,"url":null,"abstract":"<p><strong>Background and objective: </strong>Exoskeleton robot control should ideally be based on human voluntary movement intention. The readiness potential (RP) component of the motion-related cortical potential is observed before movement in the electroencephalogram and can be used for intention prediction. However, its single-trial features are weak and highly variable, and existing methods cannot achieve high cross-temporal and cross-subject accuracies in practical online applications. Therefore, this work aimed to combine a deep convolutional neural network (CNN) framework with a transfer learning (TL) strategy to predict the lower limb voluntary movement intention, thereby improving the accuracy while enhancing the model generalization capability; this would also provide sufficient processing time for the response of the exoskeleton robotic system and help realize robot control based on the intention of the human body.</p><p><strong>Methods: </strong>The signal characteristics of the RP for lower limb movement were analyzed, and a parameter TL strategy based on CNN was proposed to predict the intention of voluntary lower limb movements. We recruited 10 subjects for offline and online experiments. Multivariate empirical-mode decomposition was used to remove the artifacts, and the moment of onset of voluntary movement was labeled using lower limb electromyography signals during network training.</p><p><strong>Results: </strong>The RP features can be observed from multiple data overlays before the onset of voluntary lower limb movements, and these features have long latency periods. The offline experimental results showed that the average movement intention prediction accuracy was 95.23% ± 1.25% for the right leg and 91.21% ± 1.48% for the left leg, which showed good cross-temporal and cross-subject generalization while greatly reducing the training time. Online movement intention prediction can predict results about 483.9 ± 11.9 ms before movement onset with an average accuracy of 82.75%.</p><p><strong>Conclusion: </strong>The proposed method has a higher prediction accuracy with a lower training time, has good generalization performance for cross-temporal and cross-subject aspects, and is well-prioritized in terms of the temporal responses; these features are expected to lay the foundation for further investigations on exoskeleton robot control.</p>","PeriodicalId":12444,"journal":{"name":"Frontiers in Bioengineering and Biotechnology","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11377221/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Bioengineering and Biotechnology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.3389/fbioe.2024.1448903","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"BIOTECHNOLOGY & APPLIED MICROBIOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background and objective: Exoskeleton robot control should ideally be based on human voluntary movement intention. The readiness potential (RP) component of the motion-related cortical potential is observed before movement in the electroencephalogram and can be used for intention prediction. However, its single-trial features are weak and highly variable, and existing methods cannot achieve high cross-temporal and cross-subject accuracies in practical online applications. Therefore, this work aimed to combine a deep convolutional neural network (CNN) framework with a transfer learning (TL) strategy to predict the lower limb voluntary movement intention, thereby improving the accuracy while enhancing the model generalization capability; this would also provide sufficient processing time for the response of the exoskeleton robotic system and help realize robot control based on the intention of the human body.
Methods: The signal characteristics of the RP for lower limb movement were analyzed, and a parameter TL strategy based on CNN was proposed to predict the intention of voluntary lower limb movements. We recruited 10 subjects for offline and online experiments. Multivariate empirical-mode decomposition was used to remove the artifacts, and the moment of onset of voluntary movement was labeled using lower limb electromyography signals during network training.
Results: The RP features can be observed from multiple data overlays before the onset of voluntary lower limb movements, and these features have long latency periods. The offline experimental results showed that the average movement intention prediction accuracy was 95.23% ± 1.25% for the right leg and 91.21% ± 1.48% for the left leg, which showed good cross-temporal and cross-subject generalization while greatly reducing the training time. Online movement intention prediction can predict results about 483.9 ± 11.9 ms before movement onset with an average accuracy of 82.75%.
Conclusion: The proposed method has a higher prediction accuracy with a lower training time, has good generalization performance for cross-temporal and cross-subject aspects, and is well-prioritized in terms of the temporal responses; these features are expected to lay the foundation for further investigations on exoskeleton robot control.
期刊介绍:
The translation of new discoveries in medicine to clinical routine has never been easy. During the second half of the last century, thanks to the progress in chemistry, biochemistry and pharmacology, we have seen the development and the application of a large number of drugs and devices aimed at the treatment of symptoms, blocking unwanted pathways and, in the case of infectious diseases, fighting the micro-organisms responsible. However, we are facing, today, a dramatic change in the therapeutic approach to pathologies and diseases. Indeed, the challenge of the present and the next decade is to fully restore the physiological status of the diseased organism and to completely regenerate tissue and organs when they are so seriously affected that treatments cannot be limited to the repression of symptoms or to the repair of damage. This is being made possible thanks to the major developments made in basic cell and molecular biology, including stem cell science, growth factor delivery, gene isolation and transfection, the advances in bioengineering and nanotechnology, including development of new biomaterials, biofabrication technologies and use of bioreactors, and the big improvements in diagnostic tools and imaging of cells, tissues and organs.
In today`s world, an enhancement of communication between multidisciplinary experts, together with the promotion of joint projects and close collaborations among scientists, engineers, industry people, regulatory agencies and physicians are absolute requirements for the success of any attempt to develop and clinically apply a new biological therapy or an innovative device involving the collective use of biomaterials, cells and/or bioactive molecules. “Frontiers in Bioengineering and Biotechnology” aspires to be a forum for all people involved in the process by bridging the gap too often existing between a discovery in the basic sciences and its clinical application.