幼稚脑机接口用户迁移学习研究

Ruofan Liu, Satyam Kumar, Hussein Alawieh, E. Carnahan, J. Millán
{"title":"幼稚脑机接口用户迁移学习研究","authors":"Ruofan Liu, Satyam Kumar, Hussein Alawieh, E. Carnahan, J. Millán","doi":"10.1109/NER52421.2023.10123866","DOIUrl":null,"url":null,"abstract":"Motor Imagery (MI) based Brain-Computer Interfaces (BCI) typically require the collection of subject-specific calibration data to build a classifier of motor intent. The BCI users are then trained over multiple online sessions with real-time feedback using the calibrated decoder to acquire MI skills. The subject-specific calibration session is thought to be necessary for accurate MI decoding due to the wide variability in electroencephalogram (EEG) signals across the population. The process of acquiring calibration data is long and tedious and includes training individualized decoding models for each subject. Transfer Learning setups can help circumvent this individualized calibration and decoder training phase by using data acquired from previous subjects. This paper first proposes a geometry-aware deep learning architecture that exploits the spatial similarity of MI neural activity between BCI users. We show the efficacy of the proposed approach by classifying the motor intentions of 18 naive BCI subjects. In a subject-specific setting, our proposed method significantly outperforms classical decoding algorithms. Next, we train the proposed network and skip the subject-specific calibration data to mimic a transfer learning setting. We show that our model architecture achieves similar performance to subject-specific decoders in the transfer learning setting. This finding opens the door to robust BCIs that are readily transferable across subjects without the need for subject-specific calibration and individualized decoding models.","PeriodicalId":201841,"journal":{"name":"2023 11th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"85 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"On Transfer Learning for Naive Brain Computer Interface Users\",\"authors\":\"Ruofan Liu, Satyam Kumar, Hussein Alawieh, E. Carnahan, J. Millán\",\"doi\":\"10.1109/NER52421.2023.10123866\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Motor Imagery (MI) based Brain-Computer Interfaces (BCI) typically require the collection of subject-specific calibration data to build a classifier of motor intent. The BCI users are then trained over multiple online sessions with real-time feedback using the calibrated decoder to acquire MI skills. The subject-specific calibration session is thought to be necessary for accurate MI decoding due to the wide variability in electroencephalogram (EEG) signals across the population. The process of acquiring calibration data is long and tedious and includes training individualized decoding models for each subject. Transfer Learning setups can help circumvent this individualized calibration and decoder training phase by using data acquired from previous subjects. This paper first proposes a geometry-aware deep learning architecture that exploits the spatial similarity of MI neural activity between BCI users. We show the efficacy of the proposed approach by classifying the motor intentions of 18 naive BCI subjects. In a subject-specific setting, our proposed method significantly outperforms classical decoding algorithms. Next, we train the proposed network and skip the subject-specific calibration data to mimic a transfer learning setting. We show that our model architecture achieves similar performance to subject-specific decoders in the transfer learning setting. This finding opens the door to robust BCIs that are readily transferable across subjects without the need for subject-specific calibration and individualized decoding models.\",\"PeriodicalId\":201841,\"journal\":{\"name\":\"2023 11th International IEEE/EMBS Conference on Neural Engineering (NER)\",\"volume\":\"85 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 11th International IEEE/EMBS Conference on Neural Engineering (NER)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/NER52421.2023.10123866\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 11th International IEEE/EMBS Conference on Neural Engineering (NER)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NER52421.2023.10123866","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

基于运动意象(MI)的脑机接口(BCI)通常需要收集受试者特定的校准数据来构建运动意图分类器。脑机接口用户随后接受多个在线课程的培训,并使用校准的解码器进行实时反馈,以获得脑机接口技能。由于脑电图(EEG)信号在人群中的广泛变化,被试特定的校准会话被认为是准确解码MI的必要条件。获取校准数据的过程漫长而繁琐,并且需要为每个科目训练个性化的解码模型。迁移学习设置可以通过使用从以前的受试者获得的数据来帮助规避这种个性化的校准和解码器训练阶段。本文首先提出了一种几何感知深度学习架构,该架构利用脑机接口用户之间MI神经活动的空间相似性。我们通过对18个幼稚脑机接口被试的运动意图进行分类来证明该方法的有效性。在特定主题的设置中,我们提出的方法明显优于经典解码算法。接下来,我们训练所提出的网络并跳过特定主题的校准数据来模拟迁移学习设置。我们表明,我们的模型架构在迁移学习设置中实现了与特定主题解码器相似的性能。这一发现为鲁棒性脑机接口打开了大门,这种接口可以很容易地在不同受试者之间转移,而不需要针对特定受试者的校准和个性化解码模型。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
On Transfer Learning for Naive Brain Computer Interface Users
Motor Imagery (MI) based Brain-Computer Interfaces (BCI) typically require the collection of subject-specific calibration data to build a classifier of motor intent. The BCI users are then trained over multiple online sessions with real-time feedback using the calibrated decoder to acquire MI skills. The subject-specific calibration session is thought to be necessary for accurate MI decoding due to the wide variability in electroencephalogram (EEG) signals across the population. The process of acquiring calibration data is long and tedious and includes training individualized decoding models for each subject. Transfer Learning setups can help circumvent this individualized calibration and decoder training phase by using data acquired from previous subjects. This paper first proposes a geometry-aware deep learning architecture that exploits the spatial similarity of MI neural activity between BCI users. We show the efficacy of the proposed approach by classifying the motor intentions of 18 naive BCI subjects. In a subject-specific setting, our proposed method significantly outperforms classical decoding algorithms. Next, we train the proposed network and skip the subject-specific calibration data to mimic a transfer learning setting. We show that our model architecture achieves similar performance to subject-specific decoders in the transfer learning setting. This finding opens the door to robust BCIs that are readily transferable across subjects without the need for subject-specific calibration and individualized decoding models.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信