基于卷积神经网络和度量学习的与主体无关的可穿戴 P300 脑机接口

IF 4.8 2区 医学 Q2 ENGINEERING, BIOMEDICAL
Li Hu;Wei Gao;Zilin Lu;Chun Shan;Haiwei Ma;Wenyu Zhang;Yuanqing Li
{"title":"基于卷积神经网络和度量学习的与主体无关的可穿戴 P300 脑机接口","authors":"Li Hu;Wei Gao;Zilin Lu;Chun Shan;Haiwei Ma;Wenyu Zhang;Yuanqing Li","doi":"10.1109/TNSRE.2024.3457502","DOIUrl":null,"url":null,"abstract":"The calibration procedure for a wearable P300 brain-computer interface (BCI) greatly impact the user experience of the system. Each user needs to spend additional time establishing a decoder adapted to their own brainwaves. Therefore, achieving subject independent is an urgent issue for wearable P300 BCI needs to be addressed. A dataset of electroencephalogram (EEG) signals was constructed from 100 individuals by conducting a P300 speller task with a wearable EEG amplifier. A framework is proposed that initially improves cross- subject consistency of EEG features through a common feature extractor. Subsequently, a simple and compact convolutional neural network (CNN) architecture is employed to learn an embedding sub-space, where the mapped EEG features are maximally separated, while pursuing the minimum distance within the same class and the maximum distance between different classes. Finally, the model’s generalization capability was further optimized through fine-tuning. Results: The proposed method significantly boosts the average accuracy of wearable P300 BCI to \n<inline-formula> <tex-math>$73.23\\pm 7.62$ </tex-math></inline-formula>\n% without calibration and \n<inline-formula> <tex-math>$78.75\\pm 6.37$ </tex-math></inline-formula>\n% with fine-tuning. The results demonstrate the feasibility and excellent performance of our dataset and framework. A calibration-free wearable P300 BCI system is feasible, suggesting significant potential for practical applications of the wearable P300 BCI system.","PeriodicalId":13419,"journal":{"name":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","volume":"32 ","pages":"3543-3553"},"PeriodicalIF":4.8000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10672519","citationCount":"0","resultStr":"{\"title\":\"Subject-Independent Wearable P300 Brain–Computer Interface Based on Convolutional Neural Network and Metric Learning\",\"authors\":\"Li Hu;Wei Gao;Zilin Lu;Chun Shan;Haiwei Ma;Wenyu Zhang;Yuanqing Li\",\"doi\":\"10.1109/TNSRE.2024.3457502\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The calibration procedure for a wearable P300 brain-computer interface (BCI) greatly impact the user experience of the system. Each user needs to spend additional time establishing a decoder adapted to their own brainwaves. Therefore, achieving subject independent is an urgent issue for wearable P300 BCI needs to be addressed. A dataset of electroencephalogram (EEG) signals was constructed from 100 individuals by conducting a P300 speller task with a wearable EEG amplifier. A framework is proposed that initially improves cross- subject consistency of EEG features through a common feature extractor. Subsequently, a simple and compact convolutional neural network (CNN) architecture is employed to learn an embedding sub-space, where the mapped EEG features are maximally separated, while pursuing the minimum distance within the same class and the maximum distance between different classes. Finally, the model’s generalization capability was further optimized through fine-tuning. Results: The proposed method significantly boosts the average accuracy of wearable P300 BCI to \\n<inline-formula> <tex-math>$73.23\\\\pm 7.62$ </tex-math></inline-formula>\\n% without calibration and \\n<inline-formula> <tex-math>$78.75\\\\pm 6.37$ </tex-math></inline-formula>\\n% with fine-tuning. The results demonstrate the feasibility and excellent performance of our dataset and framework. A calibration-free wearable P300 BCI system is feasible, suggesting significant potential for practical applications of the wearable P300 BCI system.\",\"PeriodicalId\":13419,\"journal\":{\"name\":\"IEEE Transactions on Neural Systems and Rehabilitation Engineering\",\"volume\":\"32 \",\"pages\":\"3543-3553\"},\"PeriodicalIF\":4.8000,\"publicationDate\":\"2024-09-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10672519\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Neural Systems and Rehabilitation Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10672519/\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Neural Systems and Rehabilitation Engineering","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10672519/","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

摘要

可穿戴 P300 脑机接口(BCI)的校准程序极大地影响了系统的用户体验。每个用户都需要花费额外的时间来建立适合自己脑电波的解码器。因此,实现主体独立是可穿戴 P300 脑机接口亟待解决的问题。通过使用可穿戴脑电图放大器进行 P300 拼写任务,构建了 100 人的脑电图(EEG)信号数据集。本文提出了一个框架,首先通过一个通用的特征提取器提高脑电图特征的跨受试者一致性。随后,采用简单紧凑的卷积神经网络(CNN)架构来学习嵌入子空间,在该子空间中,映射的脑电图特征被最大程度地分离,同时追求同一类别内的最小距离和不同类别间的最大距离。最后,通过微调进一步优化了模型的泛化能力。结果所提出的方法大大提高了可穿戴 P300 BCI 的平均准确率,在没有校准的情况下达到 73.23 /pm 7.62$ %,在微调的情况下达到 78.75 /pm 6.37$ %。这些结果证明了我们的数据集和框架的可行性和卓越性能。无需校准的可穿戴 P300 BCI 系统是可行的,这表明可穿戴 P300 BCI 系统的实际应用潜力巨大。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Subject-Independent Wearable P300 Brain–Computer Interface Based on Convolutional Neural Network and Metric Learning
The calibration procedure for a wearable P300 brain-computer interface (BCI) greatly impact the user experience of the system. Each user needs to spend additional time establishing a decoder adapted to their own brainwaves. Therefore, achieving subject independent is an urgent issue for wearable P300 BCI needs to be addressed. A dataset of electroencephalogram (EEG) signals was constructed from 100 individuals by conducting a P300 speller task with a wearable EEG amplifier. A framework is proposed that initially improves cross- subject consistency of EEG features through a common feature extractor. Subsequently, a simple and compact convolutional neural network (CNN) architecture is employed to learn an embedding sub-space, where the mapped EEG features are maximally separated, while pursuing the minimum distance within the same class and the maximum distance between different classes. Finally, the model’s generalization capability was further optimized through fine-tuning. Results: The proposed method significantly boosts the average accuracy of wearable P300 BCI to $73.23\pm 7.62$ % without calibration and $78.75\pm 6.37$ % with fine-tuning. The results demonstrate the feasibility and excellent performance of our dataset and framework. A calibration-free wearable P300 BCI system is feasible, suggesting significant potential for practical applications of the wearable P300 BCI system.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
8.60
自引率
8.20%
发文量
479
审稿时长
6-12 weeks
期刊介绍: Rehabilitative and neural aspects of biomedical engineering, including functional electrical stimulation, acoustic dynamics, human performance measurement and analysis, nerve stimulation, electromyography, motor control and stimulation; and hardware and software applications for rehabilitation engineering and assistive devices.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信