Ruofan Liu, Satyam Kumar, Hussein Alawieh, E. Carnahan, J. Millán
{"title":"幼稚脑机接口用户迁移学习研究","authors":"Ruofan Liu, Satyam Kumar, Hussein Alawieh, E. Carnahan, J. Millán","doi":"10.1109/NER52421.2023.10123866","DOIUrl":null,"url":null,"abstract":"Motor Imagery (MI) based Brain-Computer Interfaces (BCI) typically require the collection of subject-specific calibration data to build a classifier of motor intent. The BCI users are then trained over multiple online sessions with real-time feedback using the calibrated decoder to acquire MI skills. The subject-specific calibration session is thought to be necessary for accurate MI decoding due to the wide variability in electroencephalogram (EEG) signals across the population. The process of acquiring calibration data is long and tedious and includes training individualized decoding models for each subject. Transfer Learning setups can help circumvent this individualized calibration and decoder training phase by using data acquired from previous subjects. This paper first proposes a geometry-aware deep learning architecture that exploits the spatial similarity of MI neural activity between BCI users. We show the efficacy of the proposed approach by classifying the motor intentions of 18 naive BCI subjects. In a subject-specific setting, our proposed method significantly outperforms classical decoding algorithms. Next, we train the proposed network and skip the subject-specific calibration data to mimic a transfer learning setting. We show that our model architecture achieves similar performance to subject-specific decoders in the transfer learning setting. This finding opens the door to robust BCIs that are readily transferable across subjects without the need for subject-specific calibration and individualized decoding models.","PeriodicalId":201841,"journal":{"name":"2023 11th International IEEE/EMBS Conference on Neural Engineering (NER)","volume":"85 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"On Transfer Learning for Naive Brain Computer Interface Users\",\"authors\":\"Ruofan Liu, Satyam Kumar, Hussein Alawieh, E. Carnahan, J. Millán\",\"doi\":\"10.1109/NER52421.2023.10123866\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Motor Imagery (MI) based Brain-Computer Interfaces (BCI) typically require the collection of subject-specific calibration data to build a classifier of motor intent. The BCI users are then trained over multiple online sessions with real-time feedback using the calibrated decoder to acquire MI skills. The subject-specific calibration session is thought to be necessary for accurate MI decoding due to the wide variability in electroencephalogram (EEG) signals across the population. The process of acquiring calibration data is long and tedious and includes training individualized decoding models for each subject. Transfer Learning setups can help circumvent this individualized calibration and decoder training phase by using data acquired from previous subjects. This paper first proposes a geometry-aware deep learning architecture that exploits the spatial similarity of MI neural activity between BCI users. We show the efficacy of the proposed approach by classifying the motor intentions of 18 naive BCI subjects. In a subject-specific setting, our proposed method significantly outperforms classical decoding algorithms. Next, we train the proposed network and skip the subject-specific calibration data to mimic a transfer learning setting. We show that our model architecture achieves similar performance to subject-specific decoders in the transfer learning setting. This finding opens the door to robust BCIs that are readily transferable across subjects without the need for subject-specific calibration and individualized decoding models.\",\"PeriodicalId\":201841,\"journal\":{\"name\":\"2023 11th International IEEE/EMBS Conference on Neural Engineering (NER)\",\"volume\":\"85 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 11th International IEEE/EMBS Conference on Neural Engineering (NER)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/NER52421.2023.10123866\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 11th International IEEE/EMBS Conference on Neural Engineering (NER)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NER52421.2023.10123866","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
On Transfer Learning for Naive Brain Computer Interface Users
Motor Imagery (MI) based Brain-Computer Interfaces (BCI) typically require the collection of subject-specific calibration data to build a classifier of motor intent. The BCI users are then trained over multiple online sessions with real-time feedback using the calibrated decoder to acquire MI skills. The subject-specific calibration session is thought to be necessary for accurate MI decoding due to the wide variability in electroencephalogram (EEG) signals across the population. The process of acquiring calibration data is long and tedious and includes training individualized decoding models for each subject. Transfer Learning setups can help circumvent this individualized calibration and decoder training phase by using data acquired from previous subjects. This paper first proposes a geometry-aware deep learning architecture that exploits the spatial similarity of MI neural activity between BCI users. We show the efficacy of the proposed approach by classifying the motor intentions of 18 naive BCI subjects. In a subject-specific setting, our proposed method significantly outperforms classical decoding algorithms. Next, we train the proposed network and skip the subject-specific calibration data to mimic a transfer learning setting. We show that our model architecture achieves similar performance to subject-specific decoders in the transfer learning setting. This finding opens the door to robust BCIs that are readily transferable across subjects without the need for subject-specific calibration and individualized decoding models.