EEG-Based Speech Imagery Classification via Neural Architecture Search

Taveena Lotey;Aman Verma;Rajkumar Saini;Partha Pratim Roy
{"title":"EEG-Based Speech Imagery Classification via Neural Architecture Search","authors":"Taveena Lotey;Aman Verma;Rajkumar Saini;Partha Pratim Roy","doi":"10.1109/TAI.2026.3700595","DOIUrl":null,"url":null,"abstract":"Speech imagery (SI) has emerged as a promising paradigm for brain–computer interfaces (BCIs) that enable hands-free communication without external stimuli. Classification of electroencephalography-based SI electroencephalography signals (SI-EEG) remains challenging due to limited data and high inter- and intra-subject variability. Most existing approaches rely on manually designed architectures, which is a time-consuming and labor-intensive process that requires significant domain expertise. To address these challenges, we propose a novel neural architecture search (NAS) framework for SI-EEG signal classification with bilevel optimization and path-level binarization to automatically and adaptively discover optimal model architectures. Furthermore, we propose <italic>Deformable ConvNeXt block</i>, a novel convolutional neural network-based operation that integrates transformer-inspired design principles and EEG-specific priors. This block enables each neuron to adaptively control the size of the EEG signal’s receptive field. It allows the model to more effectively capture temporal variations in mental activity in inter- and intra-subject classification settings. Evaluated across three SI-EEG datasets, our approach achieves classification accuracies of 68.30%, 68.49%, and 72.32%, surpassing the state of the art. These results demonstrate the effectiveness and scalability of our NAS-based framework for next-generation real-time BCI systems.","PeriodicalId":73305,"journal":{"name":"IEEE transactions on artificial intelligence","volume":"7 10","pages":"5790-5802"},"PeriodicalIF":0.0000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on artificial intelligence","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/11551579/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/6/4 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Speech imagery (SI) has emerged as a promising paradigm for brain–computer interfaces (BCIs) that enable hands-free communication without external stimuli. Classification of electroencephalography-based SI electroencephalography signals (SI-EEG) remains challenging due to limited data and high inter- and intra-subject variability. Most existing approaches rely on manually designed architectures, which is a time-consuming and labor-intensive process that requires significant domain expertise. To address these challenges, we propose a novel neural architecture search (NAS) framework for SI-EEG signal classification with bilevel optimization and path-level binarization to automatically and adaptively discover optimal model architectures. Furthermore, we propose Deformable ConvNeXt block, a novel convolutional neural network-based operation that integrates transformer-inspired design principles and EEG-specific priors. This block enables each neuron to adaptively control the size of the EEG signal’s receptive field. It allows the model to more effectively capture temporal variations in mental activity in inter- and intra-subject classification settings. Evaluated across three SI-EEG datasets, our approach achieves classification accuracies of 68.30%, 68.49%, and 72.32%, surpassing the state of the art. These results demonstrate the effectiveness and scalability of our NAS-based framework for next-generation real-time BCI systems.
基于脑电图的神经结构搜索语音图像分类
语音图像(SI)已经成为脑机接口(bci)的一个有前途的范例,它可以在没有外部刺激的情况下实现免提通信。基于脑电图的SI脑电图信号(SI- eeg)的分类仍然具有挑战性,因为数据有限,受试者之间和受试者内部的变异性很高。大多数现有的方法依赖于手动设计的体系结构,这是一个耗时和劳动密集型的过程,需要大量的领域专业知识。为了解决这些挑战,我们提出了一种新的神经结构搜索(NAS)框架,用于SI-EEG信号分类,该框架采用双层优化和路径级二值化来自动自适应地发现最优模型结构。此外,我们提出了transformable ConvNeXt块,这是一种新的基于卷积神经网络的操作,集成了变压器启发的设计原则和脑电图特定的先验。该块使每个神经元能够自适应地控制脑电图信号接受野的大小。它允许模型更有效地捕捉在主体间和主体内分类设置中心理活动的时间变化。通过对三个SI-EEG数据集的评估,我们的方法达到了68.30%,68.49%和72.32%的分类准确率,超过了目前的水平。这些结果证明了我们基于nas的下一代实时BCI系统框架的有效性和可扩展性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
7.70
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书