Raw Electroencephalogram-Based Cognitive Workload Classification Using Directed and Nondirected Functional Connectivity Analysis and Deep Learning.

IF 2.6 4区 计算机科学 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Big Data Pub Date : 2023-08-01 Epub Date: 2023-02-27 DOI:10.1089/big.2021.0204
Anmol Gupta, Ronnie Daniel, Akash Rao, Partha Pratim Roy, Sushil Chandra, Byung-Gyu Kim
{"title":"Raw Electroencephalogram-Based Cognitive Workload Classification Using Directed and Nondirected Functional Connectivity Analysis and Deep Learning.","authors":"Anmol Gupta,&nbsp;Ronnie Daniel,&nbsp;Akash Rao,&nbsp;Partha Pratim Roy,&nbsp;Sushil Chandra,&nbsp;Byung-Gyu Kim","doi":"10.1089/big.2021.0204","DOIUrl":null,"url":null,"abstract":"<p><p>With the phenomenal rise in internet-of-things devices, the use of electroencephalogram (EEG) based brain-computer interfaces (BCIs) can empower individuals to control equipment with thoughts. These allow BCI to be used and pave the way for pro-active health management and the development of internet-of-medical-things architecture. However, EEG-based BCIs have low fidelity, high variance, and EEG signals are very noisy. These challenges compel researchers to design algorithms that can process big data in real-time while being robust to temporal variations and other variations in the data. Another issue in designing a passive BCI is the regular change in user's cognitive state (measured through cognitive workload). Though considerable amount of research has been conducted on this front, methods that could withstand high variability in EEG data and still reflect the neuronal dynamics of cognitive state variations are lacking and much needed in literature. In this research, we evaluate the efficacy of a combination of functional connectivity algorithms and state-of-the-art deep learning algorithms for the classification of three different levels of cognitive workload. We acquire 64-channel EEG data from 23 participants executing the n-back task at three different levels; 1-back (low-workload condition), 2-back (medium-workload condition), and 3-back (high-workload condition). We compared two different functional connectivity algorithms, namely phase transfer entropy (PTE) and mutual information (MI). PTE is a directed functional connectivity algorithm, whereas MI is non-directed. Both methods are suitable for extracting functional connectivity matrices in real-time, which could eventually be used for rapid, robust, and efficient classification. For classification, we use the recently proposed BrainNetCNN deep learning model, designed specifically to classify functional connectivity matrices. Results reveal a classification accuracy of 92.81% with MI and BrainNetCNN and a staggering 99.50% with PTE and BrainNetCNN on test data. PTE can yield a higher classification accuracy due to its robustness to linear mixing of the data and its ability to detect functional connectivity across a range of analysis lags.</p>","PeriodicalId":51314,"journal":{"name":"Big Data","volume":"11 4","pages":"307-319"},"PeriodicalIF":2.6000,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Big Data","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1089/big.2021.0204","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/2/27 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 3

Abstract

With the phenomenal rise in internet-of-things devices, the use of electroencephalogram (EEG) based brain-computer interfaces (BCIs) can empower individuals to control equipment with thoughts. These allow BCI to be used and pave the way for pro-active health management and the development of internet-of-medical-things architecture. However, EEG-based BCIs have low fidelity, high variance, and EEG signals are very noisy. These challenges compel researchers to design algorithms that can process big data in real-time while being robust to temporal variations and other variations in the data. Another issue in designing a passive BCI is the regular change in user's cognitive state (measured through cognitive workload). Though considerable amount of research has been conducted on this front, methods that could withstand high variability in EEG data and still reflect the neuronal dynamics of cognitive state variations are lacking and much needed in literature. In this research, we evaluate the efficacy of a combination of functional connectivity algorithms and state-of-the-art deep learning algorithms for the classification of three different levels of cognitive workload. We acquire 64-channel EEG data from 23 participants executing the n-back task at three different levels; 1-back (low-workload condition), 2-back (medium-workload condition), and 3-back (high-workload condition). We compared two different functional connectivity algorithms, namely phase transfer entropy (PTE) and mutual information (MI). PTE is a directed functional connectivity algorithm, whereas MI is non-directed. Both methods are suitable for extracting functional connectivity matrices in real-time, which could eventually be used for rapid, robust, and efficient classification. For classification, we use the recently proposed BrainNetCNN deep learning model, designed specifically to classify functional connectivity matrices. Results reveal a classification accuracy of 92.81% with MI and BrainNetCNN and a staggering 99.50% with PTE and BrainNetCNN on test data. PTE can yield a higher classification accuracy due to its robustness to linear mixing of the data and its ability to detect functional connectivity across a range of analysis lags.

使用定向和非定向功能连接分析和深度学习的基于原始脑电图的认知工作量分类。
随着物联网设备的显著兴起,基于脑电图(EEG)的脑机接口(BCI)的使用可以使个人能够用思想控制设备。这些使脑机接口得以使用,并为积极的健康管理和医疗物联网架构的发展铺平了道路。然而,基于脑电的脑机接口保真度低、方差大,并且脑电信号噪声很大。这些挑战迫使研究人员设计能够实时处理大数据的算法,同时对数据的时间变化和其他变化具有鲁棒性。设计被动脑机接口的另一个问题是用户认知状态的定期变化(通过认知工作量来衡量)。尽管在这方面已经进行了大量的研究,但在文献中,能够承受EEG数据的高度可变性并仍然反映认知状态变化的神经元动力学的方法是缺乏的,也是非常需要的。在这项研究中,我们评估了功能连接算法和最先进的深度学习算法相结合对三种不同水平的认知工作量进行分类的有效性。我们从23名在三个不同级别执行n-back任务的参与者中获取64通道脑电图数据;1个备份(低工作负载条件)、2个备份(中等工作负载情况)和3个备份(高工作负载条件下)。我们比较了两种不同的函数连通性算法,即相位转移熵(PTE)和互信息(MI)。PTE是一种有向函数连通性算法,而MI是非有向的。这两种方法都适用于实时提取函数连通性矩阵,最终可以用于快速、稳健和高效的分类。对于分类,我们使用最近提出的BrainNetNN深度学习模型,该模型专门用于对函数连通性矩阵进行分类。结果显示,在测试数据中,MI和BrainIntNN的分类准确率为92.81%,PTE和BrainNTNN的分类正确率为惊人的99.50%。PTE由于其对数据的线性混合的鲁棒性以及其在一系列分析滞后中检测功能连接的能力,可以产生更高的分类精度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Big Data
Big Data COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS-COMPUTER SCIENCE, THEORY & METHODS
CiteScore
9.10
自引率
2.20%
发文量
60
期刊介绍: Big Data is the leading peer-reviewed journal covering the challenges and opportunities in collecting, analyzing, and disseminating vast amounts of data. The Journal addresses questions surrounding this powerful and growing field of data science and facilitates the efforts of researchers, business managers, analysts, developers, data scientists, physicists, statisticians, infrastructure developers, academics, and policymakers to improve operations, profitability, and communications within their businesses and institutions. Spanning a broad array of disciplines focusing on novel big data technologies, policies, and innovations, the Journal brings together the community to address current challenges and enforce effective efforts to organize, store, disseminate, protect, manipulate, and, most importantly, find the most effective strategies to make this incredible amount of information work to benefit society, industry, academia, and government. Big Data coverage includes: Big data industry standards, New technologies being developed specifically for big data, Data acquisition, cleaning, distribution, and best practices, Data protection, privacy, and policy, Business interests from research to product, The changing role of business intelligence, Visualization and design principles of big data infrastructures, Physical interfaces and robotics, Social networking advantages for Facebook, Twitter, Amazon, Google, etc, Opportunities around big data and how companies can harness it to their advantage.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信