用于提高 SSVEP-EEG 分类性能的高阶时空卷积网络

IF 5.6 4区 医学 Q1 ENGINEERING, BIOMEDICAL
Irbm Pub Date : 2024-03-09 DOI:10.1016/j.irbm.2024.100830
Jianli Yang, Songlei Zhao, Wei Zhang, Xiuling Liu
{"title":"用于提高 SSVEP-EEG 分类性能的高阶时空卷积网络","authors":"Jianli Yang,&nbsp;Songlei Zhao,&nbsp;Wei Zhang,&nbsp;Xiuling Liu","doi":"10.1016/j.irbm.2024.100830","DOIUrl":null,"url":null,"abstract":"<div><h3>Background and objective</h3><p>Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) aim to detect target frequencies corresponding to specific commands in electroencephalographic (EEG) signals by classification algorithms to achieve the desired control. However, SSVEP signals suffer from low signal-to-noise ratio and large differences in brain activity. Moreover, the existing CNN models have small receptive fields, which make it difficult to receive large range of feature information and limit the effectiveness of classification algorithms.</p></div><div><h3>Methods</h3><p>To this end, we proposed a high-order temporal convolutional neural network (HOT-CNN) model for enhancing the performance of SSVEP target recognition. Specifically, the SSVEP-EEG signals was divided into equal-length time segments and a time-slice attention module was designed to capture the correlation between time slices. The module improves the local characterization of signals and reduces biological noise interference by automatically assigning high weights to locally relevant temporal sampling cues and lower weights to other temporal cues. Moreover, for global features, a temporal convolutional network module was designed to increases the receptive field of the network and to extract more comprehensive time domain features by using dilated causal convolution. Finally, the fusion and analysis of local and global features are achieved by designing a feature fusion and classification module to accomplish accurate classification of SSVEP signals.</p></div><div><h3>Results</h3><p>Our method was evaluated on large publicly available datasets containing 35 subjects and 40 categories. Experimental results indicated that HOT-CNN achieved encouraging performance compared with other advanced methods: the highest information transfer rate of 241.01bits/min was obtained using 0.5s stimuli, and the highest average accuracy of 96.39% was obtained using 1.0s stimuli.</p></div><div><h3>Conclusions</h3><p>The method effectively reinforced the global and local time-domain information and improved the classification performance of SSVEP, which has wide application prospects.</p></div>","PeriodicalId":14605,"journal":{"name":"Irbm","volume":"45 2","pages":"Article 100830"},"PeriodicalIF":5.6000,"publicationDate":"2024-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"High-Order Temporal Convolutional Network for Improving Classification Performance of SSVEP-EEG\",\"authors\":\"Jianli Yang,&nbsp;Songlei Zhao,&nbsp;Wei Zhang,&nbsp;Xiuling Liu\",\"doi\":\"10.1016/j.irbm.2024.100830\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Background and objective</h3><p>Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) aim to detect target frequencies corresponding to specific commands in electroencephalographic (EEG) signals by classification algorithms to achieve the desired control. However, SSVEP signals suffer from low signal-to-noise ratio and large differences in brain activity. Moreover, the existing CNN models have small receptive fields, which make it difficult to receive large range of feature information and limit the effectiveness of classification algorithms.</p></div><div><h3>Methods</h3><p>To this end, we proposed a high-order temporal convolutional neural network (HOT-CNN) model for enhancing the performance of SSVEP target recognition. Specifically, the SSVEP-EEG signals was divided into equal-length time segments and a time-slice attention module was designed to capture the correlation between time slices. The module improves the local characterization of signals and reduces biological noise interference by automatically assigning high weights to locally relevant temporal sampling cues and lower weights to other temporal cues. Moreover, for global features, a temporal convolutional network module was designed to increases the receptive field of the network and to extract more comprehensive time domain features by using dilated causal convolution. Finally, the fusion and analysis of local and global features are achieved by designing a feature fusion and classification module to accomplish accurate classification of SSVEP signals.</p></div><div><h3>Results</h3><p>Our method was evaluated on large publicly available datasets containing 35 subjects and 40 categories. Experimental results indicated that HOT-CNN achieved encouraging performance compared with other advanced methods: the highest information transfer rate of 241.01bits/min was obtained using 0.5s stimuli, and the highest average accuracy of 96.39% was obtained using 1.0s stimuli.</p></div><div><h3>Conclusions</h3><p>The method effectively reinforced the global and local time-domain information and improved the classification performance of SSVEP, which has wide application prospects.</p></div>\",\"PeriodicalId\":14605,\"journal\":{\"name\":\"Irbm\",\"volume\":\"45 2\",\"pages\":\"Article 100830\"},\"PeriodicalIF\":5.6000,\"publicationDate\":\"2024-03-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Irbm\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1959031824000113\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Irbm","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1959031824000113","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

摘要

基于稳态视觉诱发电位(SSVEP)的脑机接口(BCI)旨在通过分类算法检测脑电信号中与特定指令相对应的目标频率,从而实现所需的控制。然而,SSVEP 信号存在信噪比低和大脑活动差异大的问题。此外,现有 CNN 模型的感受野较小,难以接收大范围的特征信息,限制了分类算法的有效性。为此,我们提出了一种高阶时空卷积神经网络(HOT-CNN)模型,以提高 SSVEP 目标识别的性能。具体来说,我们将 SSVEP-EEG 信号划分为等长的时间片段,并设计了一个时间片关注模块来捕捉时间片段之间的相关性。该模块通过自动为与局部相关的时间采样线索分配高权重,为其他时间线索分配低权重,从而改善信号的局部特征,减少生物噪声干扰。此外,针对全局特征,还设计了一个时间卷积网络模块,以增加网络的感受野,并通过使用扩张因果卷积提取更全面的时域特征。最后,通过设计一个特征融合和分类模块,实现了局部和全局特征的融合与分析,从而完成了对 SSVEP 信号的精确分类。我们的方法在包含 35 个受试者和 40 个类别的大型公开数据集上进行了评估。实验结果表明,与其他先进方法相比,HOT-CNN 取得了令人鼓舞的性能:使用 0.5 秒刺激时,信息传输率最高,达到 241.01bits/min;使用 1.0 秒刺激时,平均准确率最高,达到 96.39%。该方法有效地强化了全局和局部时域信息,提高了 SSVEP 的分类性能,具有广泛的应用前景。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

High-Order Temporal Convolutional Network for Improving Classification Performance of SSVEP-EEG

High-Order Temporal Convolutional Network for Improving Classification Performance of SSVEP-EEG

Background and objective

Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) aim to detect target frequencies corresponding to specific commands in electroencephalographic (EEG) signals by classification algorithms to achieve the desired control. However, SSVEP signals suffer from low signal-to-noise ratio and large differences in brain activity. Moreover, the existing CNN models have small receptive fields, which make it difficult to receive large range of feature information and limit the effectiveness of classification algorithms.

Methods

To this end, we proposed a high-order temporal convolutional neural network (HOT-CNN) model for enhancing the performance of SSVEP target recognition. Specifically, the SSVEP-EEG signals was divided into equal-length time segments and a time-slice attention module was designed to capture the correlation between time slices. The module improves the local characterization of signals and reduces biological noise interference by automatically assigning high weights to locally relevant temporal sampling cues and lower weights to other temporal cues. Moreover, for global features, a temporal convolutional network module was designed to increases the receptive field of the network and to extract more comprehensive time domain features by using dilated causal convolution. Finally, the fusion and analysis of local and global features are achieved by designing a feature fusion and classification module to accomplish accurate classification of SSVEP signals.

Results

Our method was evaluated on large publicly available datasets containing 35 subjects and 40 categories. Experimental results indicated that HOT-CNN achieved encouraging performance compared with other advanced methods: the highest information transfer rate of 241.01bits/min was obtained using 0.5s stimuli, and the highest average accuracy of 96.39% was obtained using 1.0s stimuli.

Conclusions

The method effectively reinforced the global and local time-domain information and improved the classification performance of SSVEP, which has wide application prospects.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Irbm
Irbm ENGINEERING, BIOMEDICAL-
CiteScore
10.30
自引率
4.20%
发文量
81
审稿时长
57 days
期刊介绍: IRBM is the journal of the AGBM (Alliance for engineering in Biology an Medicine / Alliance pour le génie biologique et médical) and the SFGBM (BioMedical Engineering French Society / Société française de génie biologique médical) and the AFIB (French Association of Biomedical Engineers / Association française des ingénieurs biomédicaux). As a vehicle of information and knowledge in the field of biomedical technologies, IRBM is devoted to fundamental as well as clinical research. Biomedical engineering and use of new technologies are the cornerstones of IRBM, providing authors and users with the latest information. Its six issues per year propose reviews (state-of-the-art and current knowledge), original articles directed at fundamental research and articles focusing on biomedical engineering. All articles are submitted to peer reviewers acting as guarantors for IRBM''s scientific and medical content. The field covered by IRBM includes all the discipline of Biomedical engineering. Thereby, the type of papers published include those that cover the technological and methodological development in: -Physiological and Biological Signal processing (EEG, MEG, ECG…)- Medical Image processing- Biomechanics- Biomaterials- Medical Physics- Biophysics- Physiological and Biological Sensors- Information technologies in healthcare- Disability research- Computational physiology- …
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信