Towards imagined speech: Identification of brain states from EEG signals for BCI-based communication systems

IF 2.6 3区 心理学 Q2 BEHAVIORAL SCIENCES
{"title":"Towards imagined speech: Identification of brain states from EEG signals for BCI-based communication systems","authors":"","doi":"10.1016/j.bbr.2024.115295","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>The electroencephalogram (EEG) based brain-computer interface (BCI) system employing imagined speech serves as a mechanism for decoding EEG signals to facilitate control over external devices or communication with the external world at the moment the user desires. To effectively deploy such BCIs, it is imperative to accurately discern various brain states from continuous EEG signals when users initiate word imagination.</div></div><div><h3>New method</h3><div>This study involved the acquisition of EEG signals from 15 subjects engaged in four states: resting, listening, imagined speech, and actual speech, each involving a predefined set of 10 words. The EEG signals underwent preprocessing, segmentation, spatio-temporal and spectral analysis of each state, and functional connectivity analysis using the phase locking value (PLV) method. Subsequently, five features were extracted from the frequency and time-frequency domains. Classification tasks were performed using four machine learning algorithms in both pair-wise and multiclass scenarios, considering subject-dependent and subject-independent data.</div></div><div><h3>Results</h3><div>In the subject-dependent scenario, the random forest (RF) classifier achieved a maximum accuracy of 94.60 % for pairwise classification, while the artificial neural network (ANN) classifier achieved a maximum accuracy of 66.92 % for multiclass classification. In the subject-independent scenario, the random forest (RF) classifier achieved maximum accuracies of 81.02 % for pairwise classification and 55.58 % for multiclass classification. Moreover, EEG signals were classified based on frequency bands and brain lobes, revealing that the theta (<em>θ</em>) and delta (<em>δ</em>) bands, as well as the frontal and temporal lobes, are sufficient for distinguishing between brain states.</div></div><div><h3>Conclusion</h3><div>The findings promise to develop a system capable of automatically segmenting imagined speech segments from continuous EEG signals.</div></div>","PeriodicalId":8823,"journal":{"name":"Behavioural Brain Research","volume":null,"pages":null},"PeriodicalIF":2.6000,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Behavioural Brain Research","FirstCategoryId":"102","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0166432824004510","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"BEHAVIORAL SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Background

The electroencephalogram (EEG) based brain-computer interface (BCI) system employing imagined speech serves as a mechanism for decoding EEG signals to facilitate control over external devices or communication with the external world at the moment the user desires. To effectively deploy such BCIs, it is imperative to accurately discern various brain states from continuous EEG signals when users initiate word imagination.

New method

This study involved the acquisition of EEG signals from 15 subjects engaged in four states: resting, listening, imagined speech, and actual speech, each involving a predefined set of 10 words. The EEG signals underwent preprocessing, segmentation, spatio-temporal and spectral analysis of each state, and functional connectivity analysis using the phase locking value (PLV) method. Subsequently, five features were extracted from the frequency and time-frequency domains. Classification tasks were performed using four machine learning algorithms in both pair-wise and multiclass scenarios, considering subject-dependent and subject-independent data.

Results

In the subject-dependent scenario, the random forest (RF) classifier achieved a maximum accuracy of 94.60 % for pairwise classification, while the artificial neural network (ANN) classifier achieved a maximum accuracy of 66.92 % for multiclass classification. In the subject-independent scenario, the random forest (RF) classifier achieved maximum accuracies of 81.02 % for pairwise classification and 55.58 % for multiclass classification. Moreover, EEG signals were classified based on frequency bands and brain lobes, revealing that the theta (θ) and delta (δ) bands, as well as the frontal and temporal lobes, are sufficient for distinguishing between brain states.

Conclusion

The findings promise to develop a system capable of automatically segmenting imagined speech segments from continuous EEG signals.
迈向想象中的语音:从脑电图信号中识别大脑状态,用于基于 BCI 的通信系统。
背景:基于脑电图(EEG)的脑机接口(BCI)系统采用想象语音作为解码脑电信号的机制,以便在用户希望的时刻控制外部设备或与外部世界交流。为了有效地部署此类 BCI,必须从连续脑电信号中准确分辨出用户发起词语想象时的各种大脑状态:本研究采集了 15 名受试者在四种状态下的脑电信号:静止、聆听、想象言语和实际言语,每种状态都涉及一组预定义的 10 个单词。脑电信号经过预处理、分割、每种状态的时空和频谱分析,以及使用锁相值(PLV)方法进行功能连接分析。随后,从频域和时频域提取了五个特征。使用四种机器学习算法在成对和多类情景下执行分类任务,同时考虑与受试者相关和与受试者无关的数据:在与主体相关的场景中,随机森林(RF)分类器的成对分类准确率最高达 94.60%,而人工神经网络(ANN)分类器的多分类准确率最高达 66.92%。在与受试者无关的情况下,随机森林(RF)分类器的成对分类准确率最高为 81.02%,多分类准确率最高为 55.58%。此外,还根据频带和脑叶对脑电图信号进行了分类,发现θ和δ频带以及额叶和颞叶足以区分大脑状态:这些研究结果有望开发出一种能够从连续脑电信号中自动分割想象语音片段的系统。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Behavioural Brain Research
Behavioural Brain Research 医学-行为科学
CiteScore
5.60
自引率
0.00%
发文量
383
审稿时长
61 days
期刊介绍: Behavioural Brain Research is an international, interdisciplinary journal dedicated to the publication of articles in the field of behavioural neuroscience, broadly defined. Contributions from the entire range of disciplines that comprise the neurosciences, behavioural sciences or cognitive sciences are appropriate, as long as the goal is to delineate the neural mechanisms underlying behaviour. Thus, studies may range from neurophysiological, neuroanatomical, neurochemical or neuropharmacological analysis of brain-behaviour relations, including the use of molecular genetic or behavioural genetic approaches, to studies that involve the use of brain imaging techniques, to neuroethological studies. Reports of original research, of major methodological advances, or of novel conceptual approaches are all encouraged. The journal will also consider critical reviews on selected topics.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信