AutoEER: automatic EEG-based emotion recognition with neural architecture search.

IF 3.7 3区 医学 Q2 ENGINEERING, BIOMEDICAL
Yixiao Wu, Huan Liu, Dalin Zhang, Yuzhe Zhang, Tianyu Lou, Qinghua Zheng
{"title":"AutoEER: automatic EEG-based emotion recognition with neural architecture search.","authors":"Yixiao Wu,&nbsp;Huan Liu,&nbsp;Dalin Zhang,&nbsp;Yuzhe Zhang,&nbsp;Tianyu Lou,&nbsp;Qinghua Zheng","doi":"10.1088/1741-2552/aced22","DOIUrl":null,"url":null,"abstract":"<p><p><i>Objective.</i>Emotion recognition based on electroencephalography (EEG) is garnering increasing attention among researchers due to its wide-ranging applications and the rise of portable devices. Deep learning-based models have demonstrated impressive progress in EEG-based emotion recognition, thanks to their exceptional feature extraction capabilities. However, the manual design of deep networks is time-consuming and labour-intensive. Moreover, the inherent variability of EEG signals necessitates extensive customization of models, exacerbating these challenges. Neural architecture search (NAS) methods can alleviate the need for excessive manual involvement by automatically discovering the optimal network structure for EEG-based emotion recognition.<i>Approach.</i>In this regard, we propose AutoEER (<b>Auto</b>matic<b>E</b>EG-based<b>E</b>motion<b>R</b>ecognition), a framework that leverages tailored NAS to automatically discover the optimal network structure for EEG-based emotion recognition. We carefully design a customized search space specifically for EEG signals, incorporating operators that effectively capture both temporal and spatial properties of EEG. Additionally, we employ a novel parameterization strategy to derive the optimal network structure from the proposed search space.<i>Main results.</i>Extensive experimentation on emotion classification tasks using two benchmark datasets, DEAP and SEED, has demonstrated that AutoEER outperforms state-of-the-art manual deep and NAS models. Specifically, compared to the optimal model WangNAS on the accuracy (ACC) metric, AutoEER improves its average accuracy on all datasets by 0.93%. Similarly, compared to the optimal model LiNAS on the F1 Ssore (F1) metric, AutoEER improves its average F1 score on all datasets by 4.51%. Furthermore, the architectures generated by AutoEER exhibit superior transferability compared to alternative methods.<i>Significance.</i>AutoEER represents a novel approach to EEG analysis, utilizing a specialized search space to design models tailored to individual subjects. This approach significantly reduces the labour and time costs associated with manual model construction in EEG research, holding great promise for advancing the field and streamlining research practices.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":"20 4","pages":""},"PeriodicalIF":3.7000,"publicationDate":"2023-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of neural engineering","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1088/1741-2552/aced22","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Objective.Emotion recognition based on electroencephalography (EEG) is garnering increasing attention among researchers due to its wide-ranging applications and the rise of portable devices. Deep learning-based models have demonstrated impressive progress in EEG-based emotion recognition, thanks to their exceptional feature extraction capabilities. However, the manual design of deep networks is time-consuming and labour-intensive. Moreover, the inherent variability of EEG signals necessitates extensive customization of models, exacerbating these challenges. Neural architecture search (NAS) methods can alleviate the need for excessive manual involvement by automatically discovering the optimal network structure for EEG-based emotion recognition.Approach.In this regard, we propose AutoEER (AutomaticEEG-basedEmotionRecognition), a framework that leverages tailored NAS to automatically discover the optimal network structure for EEG-based emotion recognition. We carefully design a customized search space specifically for EEG signals, incorporating operators that effectively capture both temporal and spatial properties of EEG. Additionally, we employ a novel parameterization strategy to derive the optimal network structure from the proposed search space.Main results.Extensive experimentation on emotion classification tasks using two benchmark datasets, DEAP and SEED, has demonstrated that AutoEER outperforms state-of-the-art manual deep and NAS models. Specifically, compared to the optimal model WangNAS on the accuracy (ACC) metric, AutoEER improves its average accuracy on all datasets by 0.93%. Similarly, compared to the optimal model LiNAS on the F1 Ssore (F1) metric, AutoEER improves its average F1 score on all datasets by 4.51%. Furthermore, the architectures generated by AutoEER exhibit superior transferability compared to alternative methods.Significance.AutoEER represents a novel approach to EEG analysis, utilizing a specialized search space to design models tailored to individual subjects. This approach significantly reduces the labour and time costs associated with manual model construction in EEG research, holding great promise for advancing the field and streamlining research practices.

AutoEER:自动基于脑电图的情感识别与神经结构搜索。
目标。基于脑电图(EEG)的情绪识别由于其广泛的应用和便携式设备的兴起而越来越受到研究人员的关注。基于深度学习的模型在基于脑电图的情感识别方面取得了令人印象深刻的进展,这要归功于它们出色的特征提取能力。然而,人工设计深度网络是费时费力的。此外,脑电图信号固有的可变性需要大量定制模型,这加剧了这些挑战。神经结构搜索(NAS)方法可以通过自动发现基于脑电图的情感识别的最佳网络结构来减轻对过度人工参与的需要。在这方面,我们提出了AutoEER (automaticeeg -based demotionrecognition)框架,该框架利用定制的NAS来自动发现基于脑电图的情感识别的最佳网络结构。我们精心设计了一个专门针对脑电图信号的定制搜索空间,并结合了有效捕获脑电图时间和空间特性的算子。此外,我们采用了一种新的参数化策略,从提出的搜索空间中推导出最优的网络结构。主要的结果。使用两个基准数据集(DEAP和SEED)对情绪分类任务进行的大量实验表明,AutoEER优于最先进的手动深度和NAS模型。具体来说,在精度(ACC)指标上,与最优模型WangNAS相比,AutoEER在所有数据集上的平均精度提高了0.93%。同样,与F1赛车(F1)指标上的最优模型LiNAS相比,AutoEER在所有数据集上的平均F1分数提高了4.51%。此外,与其他方法相比,AutoEER生成的体系结构具有优越的可移植性。意义:AutoEER代表了一种新的EEG分析方法,利用专门的搜索空间来设计适合个体受试者的模型。这种方法大大减少了脑电图研究中手工模型构建的劳动和时间成本,对推进该领域和简化研究实践具有很大的希望。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of neural engineering
Journal of neural engineering 工程技术-工程:生物医学
CiteScore
7.80
自引率
12.50%
发文量
319
审稿时长
4.2 months
期刊介绍: The goal of Journal of Neural Engineering (JNE) is to act as a forum for the interdisciplinary field of neural engineering where neuroscientists, neurobiologists and engineers can publish their work in one periodical that bridges the gap between neuroscience and engineering. The journal publishes articles in the field of neural engineering at the molecular, cellular and systems levels. The scope of the journal encompasses experimental, computational, theoretical, clinical and applied aspects of: Innovative neurotechnology; Brain-machine (computer) interface; Neural interfacing; Bioelectronic medicines; Neuromodulation; Neural prostheses; Neural control; Neuro-rehabilitation; Neurorobotics; Optical neural engineering; Neural circuits: artificial & biological; Neuromorphic engineering; Neural tissue regeneration; Neural signal processing; Theoretical and computational neuroscience; Systems neuroscience; Translational neuroscience; Neuroimaging.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信