ECA-FusionNet: a hybrid EEG-fNIRS signals network for MI classification.

Yuxin Qin, Baojiang Li, Wenlong Wang, Xingbin Shi, Cheng Peng, Xichao Wang, Haiyan Wang
{"title":"ECA-FusionNet: a hybrid EEG-fNIRS signals network for MI classification.","authors":"Yuxin Qin, Baojiang Li, Wenlong Wang, Xingbin Shi, Cheng Peng, Xichao Wang, Haiyan Wang","doi":"10.1088/1741-2552/adaf58","DOIUrl":null,"url":null,"abstract":"<p><p><i>Objective</i>. Among all BCI paradigms, motion imagery (MI) has gained favor among researchers because it allows users to control external devices by imagining movements rather than actually performing actions. This property holds important promise for clinical applications, especially in areas such as stroke rehabilitation. Electroencephalogram (EEG) signals and functional near-infrared spectroscopy (fNIRS) signals are two of the more popular neuroimaging techniques for obtaining MI signals from the brain. However, the performance of MI-based unimodal classification methods is low due to the limitations of EEG or fNIRS.<i>Approach</i>. In this paper, we propose a new multimodal fusion classification method capable of combining the potential complementary advantages of EEG and fNIRS. First, we propose a feature extraction network capable of extracting spatio-temporal features from EEG-based and fNIRS-based MI signals. Then, we successively fused the EEG and fNIRS at the feature-level and the decision-level to improve the adaptability and robustness of the model.<i>Main results</i>. We validate the performance of ECA-FusionNet on a publicly available EEG-fNIRS dataset. The results show that ECA-FusionNet outperforms unimodal classification methods, as well as existing fusion classification methods, in terms of classification accuracy for MI.<i>Significance</i>. ECA-FusionNet may provide a useful reference for the field of multimodal fusion classification.</p>","PeriodicalId":94096,"journal":{"name":"Journal of neural engineering","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of neural engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1088/1741-2552/adaf58","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Objective. Among all BCI paradigms, motion imagery (MI) has gained favor among researchers because it allows users to control external devices by imagining movements rather than actually performing actions. This property holds important promise for clinical applications, especially in areas such as stroke rehabilitation. Electroencephalogram (EEG) signals and functional near-infrared spectroscopy (fNIRS) signals are two of the more popular neuroimaging techniques for obtaining MI signals from the brain. However, the performance of MI-based unimodal classification methods is low due to the limitations of EEG or fNIRS.Approach. In this paper, we propose a new multimodal fusion classification method capable of combining the potential complementary advantages of EEG and fNIRS. First, we propose a feature extraction network capable of extracting spatio-temporal features from EEG-based and fNIRS-based MI signals. Then, we successively fused the EEG and fNIRS at the feature-level and the decision-level to improve the adaptability and robustness of the model.Main results. We validate the performance of ECA-FusionNet on a publicly available EEG-fNIRS dataset. The results show that ECA-FusionNet outperforms unimodal classification methods, as well as existing fusion classification methods, in terms of classification accuracy for MI.Significance. ECA-FusionNet may provide a useful reference for the field of multimodal fusion classification.

求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信