Cognitive Neurodynamics最新文献

筛选
英文 中文
Identifying optimal channels and features for multi-participant motor imagery experiments across a participant's multi-day multi-class EEG data. 通过参与者的多日多类脑电图数据识别多参与者运动图像实验的最佳通道和特征
IF 3.7 3区 工程技术
Cognitive Neurodynamics Pub Date : 2024-06-01 Epub Date: 2023-03-27 DOI: 10.1007/s11571-023-09957-9
Esra Kaya, Ismail Saritas
{"title":"Identifying optimal channels and features for multi-participant motor imagery experiments across a participant's multi-day multi-class EEG data.","authors":"Esra Kaya, Ismail Saritas","doi":"10.1007/s11571-023-09957-9","DOIUrl":"10.1007/s11571-023-09957-9","url":null,"abstract":"<p><p>The concept of the brain-computer interface (BCI) has become one of the popular research topics of recent times because it allows people to express their thoughts and control different applications and devices without actual movement. The communication between the brain and the computer or a machine is generally provided through Electroencephalogram (EEG) signals because they are cost-effective and easy to implement in normal life, not just in healthcare facilities. On the other hand, they are hard to process efficiently due to their nonlinearity and noisy nature. Thus, the field of BCI and EEG needs constant work and improvement. This paper focuses on generalizing the most efficient EEG channels and the most significant features of motor imagery (MI) signals by analyzing the recordings of one participant obtained over 20 different days. Because the classification performance usually decreases with an increasing number of class labels, we have realized the study by analyzing the signals through a new paradigm consisting of multi-class directional labels: right, left, forward, and backward. Afterward, the results are tested on EEG data obtained from 5 participants to see if the results are consistent with each other. The average accuracy of binary and multi-class classification using the Ensemble Subspace Discriminant classifier was found as 87.39 and 61.44%, respectively, with the most efficient 3-channel combination for daily BCI evaluation of one participant. On the other hand, the average accuracy of binary and multi-class classification was found as 71.84 and 50.42%, respectively, for 5 participants, with the most efficient channel combination of 4, where the first three are the same as the daily performance of one participant. During signal processing, the outliers of the signals were discarded by considering the channels separately. An algorithm was developed to dismiss the inconsistent samples within the classes. A novel adaptive filtering approach, correlation-based adaptive variational mode decomposition (CBAVMD), was proposed. The feature selection was realized based on the standard deviation values of the features between the classes. The paradigm based on the direction movements was found to be most effective, especially for binary classification of right and left directions. The generalization of effective channels and features was found to be generally successful.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":null,"pages":null},"PeriodicalIF":3.7,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11143128/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46869982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dynamic causal modeling analysis reveals the modulation of motor cortex and integration in superior temporal gyrus during multisensory speech perception. 动态因果模型分析揭示了多感觉语言知觉过程中运动皮层的调节和颞上回的整合
IF 3.7 3区 工程技术
Cognitive Neurodynamics Pub Date : 2024-06-01 Epub Date: 2023-03-04 DOI: 10.1007/s11571-023-09945-z
Ting Zou, Liyuan Li, Xinju Huang, Chijun Deng, Xuyang Wang, Qing Gao, Huafu Chen, Rong Li
{"title":"Dynamic causal modeling analysis reveals the modulation of motor cortex and integration in superior temporal gyrus during multisensory speech perception.","authors":"Ting Zou, Liyuan Li, Xinju Huang, Chijun Deng, Xuyang Wang, Qing Gao, Huafu Chen, Rong Li","doi":"10.1007/s11571-023-09945-z","DOIUrl":"10.1007/s11571-023-09945-z","url":null,"abstract":"<p><p>The processing of speech information from various sensory modalities is crucial for human communication. Both left posterior superior temporal gyrus (pSTG) and motor cortex importantly involve in the multisensory speech perception. However, the dynamic integration of primary sensory regions to pSTG and the motor cortex remain unclear. Here, we implemented a behavioral experiment of classical McGurk effect paradigm and acquired the task functional magnetic resonance imaging (fMRI) data during synchronized audiovisual syllabic perception from 63 normal adults. We conducted dynamic causal modeling (DCM) analysis to explore the cross-modal interactions among the left pSTG, left precentral gyrus (PrG), left middle superior temporal gyrus (mSTG), and left fusiform gyrus (FuG). Bayesian model selection favored a winning model that included modulations of connections to PrG (mSTG → PrG, FuG → PrG), from PrG (PrG → mSTG, PrG → FuG), and to pSTG (mSTG → pSTG, FuG → pSTG). Moreover, the coupling strength of the above connections correlated with behavioral McGurk susceptibility. In addition, significant differences were found in the coupling strength of these connections between strong and weak McGurk perceivers. Strong perceivers modulated less inhibitory visual influence, allowed less excitatory auditory information flowing into PrG, but integrated more audiovisual information in pSTG. Taken together, our findings show that the PrG and pSTG interact dynamically with primary cortices during audiovisual speech, and support the motor cortex plays a specifically functional role in modulating the gain and salience between auditory and visual modalities.</p><p><strong>Supplementary information: </strong>The online version contains supplementary material available at 10.1007/s11571-023-09945-z.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":null,"pages":null},"PeriodicalIF":3.7,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11143173/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43947873","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multimodal and hemispheric graph-theoretical brain network predictors of learning efficacy for frontal alpha asymmetry neurofeedback. 额叶α不对称神经反馈学习效能的多模式和半球图理论脑网络预测因子
IF 3.7 3区 工程技术
Cognitive Neurodynamics Pub Date : 2024-06-01 Epub Date: 2023-02-19 DOI: 10.1007/s11571-023-09939-x
Linling Li, Yutong Li, Zhaoxun Li, Gan Huang, Zhen Liang, Li Zhang, Feng Wan, Manjun Shen, Xue Han, Zhiguo Zhang
{"title":"Multimodal and hemispheric graph-theoretical brain network predictors of learning efficacy for frontal alpha asymmetry neurofeedback.","authors":"Linling Li, Yutong Li, Zhaoxun Li, Gan Huang, Zhen Liang, Li Zhang, Feng Wan, Manjun Shen, Xue Han, Zhiguo Zhang","doi":"10.1007/s11571-023-09939-x","DOIUrl":"10.1007/s11571-023-09939-x","url":null,"abstract":"<p><p>EEG neurofeedback using frontal alpha asymmetry (FAA) has been widely used for emotion regulation, but its effectiveness is controversial. Studies indicated that individual differences in neurofeedback training can be traced to neuroanatomical and neurofunctional features. However, they only focused on regional brain structure or function and overlooked possible neural correlates of the brain network. Besides, no neuroimaging predictors for FAA neurofeedback protocol have been reported so far. We designed a single-blind pseudo-controlled FAA neurofeedback experiment and collected multimodal neuroimaging data from healthy participants before training. We assessed the learning performance for evoked EEG modulations during training (L1) and at rest (L2), and investigated performance-related predictors based on a combined analysis of multimodal brain networks and graph-theoretical features. The main findings of this study are described below. First, both real and sham groups could increase their FAA during training, but only the real group showed a significant increase in FAA at rest. Second, the predictors during training blocks and at rests were different: L1 was correlated with the graph-theoretical metrics (clustering coefficient and local efficiency) of the right hemispheric gray matter and functional networks, while L2 was correlated with the graph-theoretical metrics (local and global efficiency) of the whole-brain and left the hemispheric functional network. Therefore, the individual differences in FAA neurofeedback learning could be explained by individual variations in structural/functional architecture, and the correlated graph-theoretical metrics of learning performance indices showed different laterality of hemispheric networks. These results provided insight into the neural correlates of inter-individual differences in neurofeedback learning.</p><p><strong>Supplementary information: </strong>The online version contains supplementary material available at 10.1007/s11571-023-09939-x.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":null,"pages":null},"PeriodicalIF":3.7,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11143167/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46010742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effectual seizure detection using MBBF-GPSO with CNN network. 基于CNN网络的MBBF-GPSO有效检测癫痫发作
IF 3.7 3区 工程技术
Cognitive Neurodynamics Pub Date : 2024-06-01 Epub Date: 2023-02-27 DOI: 10.1007/s11571-023-09943-1
Dinesh Kumar Atal, Mukhtiar Singh
{"title":"Effectual seizure detection using MBBF-GPSO with CNN network.","authors":"Dinesh Kumar Atal, Mukhtiar Singh","doi":"10.1007/s11571-023-09943-1","DOIUrl":"10.1007/s11571-023-09943-1","url":null,"abstract":"<p><p>EEG is the most common test for diagnosing a seizure, where it presents information about the electrical activity of the brain. Automatic Seizure detection is one of the challenging tasks due to limitations of conventional methods with regard to inefficient feature selection, increased computational complexity and time and less accuracy. The situation calls for a practical framework to achieve better performance for detecting the seizure effectively. Hence, this study proposes modified Blackman bandpass filter-greedy particle swarm optimization (MBBF-GPSO) with convolutional neural network (CNN) for effective seizure detection. In this case, unwanted signals (noise) is eliminated by MBBF as it possess better ability in stopband attenuation, and, only the optimized features are selected using GPSO. For enhancing the efficacy of obtaining optimal solutions in GPSO, the time and frequency domain is extracted to complement it. Through this process, an optimized features are attained by MBBF-GPSO. Then, the CNN layer is employed for obtaining the productive classification output using the objective function. Here, CNN is employed due to its ability in automatically learning distinct features for individual class. Such advantages of the proposed system have made it explore better performance in seizure detection that is confirmed through performance and comparative analysis.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":null,"pages":null},"PeriodicalIF":3.7,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11143161/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45996684","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Sex differences of signal complexity at resting-state functional magnetic resonance imaging and their associations with the estrogen-signaling pathway in the brain. 静息状态磁共振成像信号复杂性的性别差异及其与大脑雌激素信号通路的关系
IF 3.7 3区 工程技术
Cognitive Neurodynamics Pub Date : 2024-06-01 Epub Date: 2023-03-23 DOI: 10.1007/s11571-023-09954-y
Cheng-Li Zhao, Wenjie Hou, Yanbing Jia, Barbara J Sahakian, Qiang Luo
{"title":"Sex differences of signal complexity at resting-state functional magnetic resonance imaging and their associations with the estrogen-signaling pathway in the brain.","authors":"Cheng-Li Zhao, Wenjie Hou, Yanbing Jia, Barbara J Sahakian, Qiang Luo","doi":"10.1007/s11571-023-09954-y","DOIUrl":"10.1007/s11571-023-09954-y","url":null,"abstract":"<p><p>Sex differences in the brain have been widely reported and may hold the key to elucidating sex differences in many medical conditions and drug response. However, the molecular correlates of these sex differences in structural and functional brain measures in the human brain remain unclear. Herein, we used sample entropy (SampEn) to quantify the signal complexity of resting-state functional magnetic resonance imaging (rsfMRI) in a large neuroimaging cohort (N = 1,642). The frontoparietal control network and the cingulo-opercular network had high signal complexity while the cerebellar and sensory motor networks had low signal complexity in both men and women. Compared with those in male brains, we found greater signal complexity in all functional brain networks in female brains with the default mode network exhibiting the largest sex difference. Using the gene expression data in brain tissues, we identified genes that were significantly associated with sex differences in brain signal complexity. The significant genes were enriched in the gene sets that were differentially expressed between the brain cortex and other tissues, the estrogen-signaling pathway, and the biological function of neural plasticity. In particular, the G-protein-coupled estrogen receptor 1 gene in the estrogen-signaling pathway was expressed more in brain regions with greater sex differences in SampEn. In conclusion, greater complexity in female brains may reflect the interactions between sex hormone fluctuations and neuromodulation of estrogen in women.</p><p><strong>Supplementary information: </strong>The online version contains supplementary material available at 10.1007/s11571-023-09954-y.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":null,"pages":null},"PeriodicalIF":3.7,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11143120/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46022889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Diagnosis of neurodegenerative diseases with a refined Lempel-Ziv complexity. 用改良Lempel-Ziv复杂性诊断神经退行性疾病
IF 3.7 3区 工程技术
Cognitive Neurodynamics Pub Date : 2024-06-01 Epub Date: 2023-05-05 DOI: 10.1007/s11571-023-09973-9
Huan Zhao, Junxiao Xie, Yangquan Chen, Junyi Cao, Wei-Hsin Liao, Hongmei Cao
{"title":"Diagnosis of neurodegenerative diseases with a refined Lempel-Ziv complexity.","authors":"Huan Zhao, Junxiao Xie, Yangquan Chen, Junyi Cao, Wei-Hsin Liao, Hongmei Cao","doi":"10.1007/s11571-023-09973-9","DOIUrl":"10.1007/s11571-023-09973-9","url":null,"abstract":"<p><p>The investigation into the distinctive difference of gait is of significance for the clinical diagnosis of neurodegenerative diseases. However, human gait is affected by many factors like behavior, occupation and so on, and they may confuse the gait differences among Parkinson's disease, amyotrophic lateral sclerosis, and Huntington's disease. For the purpose of examining distinctive gait differences of neurodegenerative diseases, this study extracts various features from both vertical ground reaction force and time intervals. Moreover, refined Lempel-Ziv complexity is proposed considering the detailed distribution of signals based on the median and quartiles. Basic features (mean, coefficient of variance, and the asymmetry index), nonlinear dynamic features (Hurst exponent, correlation dimension, largest Lyapunov exponent), and refined Lempel-Ziv complexity of different neurodegenerative diseases are compared statistically by violin plot and Kruskal-Wallis test to reveal distinction and regularities. The comparative analysis results illustrate the gait differences across these neurodegenerative diseases by basic features and nonlinear dynamic features. Classification results by random forest indicate that the refined Lempel-Ziv complexity can robustly enhance the diagnosis accuracy when combined with basic features.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":null,"pages":null},"PeriodicalIF":3.7,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11143150/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49490536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Short-length SSVEP data extension by a novel generative adversarial networks based framework 通过基于生成式对抗网络的新型框架扩展短时长 SSVEP 数据
IF 3.7 3区 工程技术
Cognitive Neurodynamics Pub Date : 2024-05-31 DOI: 10.1007/s11571-024-10134-9
Yudong Pan, Ning Li, Yangsong Zhang, Peng Xu, Dezhong Yao
{"title":"Short-length SSVEP data extension by a novel generative adversarial networks based framework","authors":"Yudong Pan, Ning Li, Yangsong Zhang, Peng Xu, Dezhong Yao","doi":"10.1007/s11571-024-10134-9","DOIUrl":"https://doi.org/10.1007/s11571-024-10134-9","url":null,"abstract":"<p>Steady-state visual evoked potentials (SSVEPs) based brain–computer interface (BCI) has received considerable attention due to its high information transfer rate (ITR) and available quantity of targets. However, the performance of frequency identification methods heavily hinges on the amount of user calibration data and data length, which hinders the deployment in real-world applications. Recently, generative adversarial networks (GANs)-based data generation methods have been widely adopted to create synthetic electroencephalography data, holds promise to address these issues. In this paper, we proposed a GAN-based end-to-end signal transformation network for Time-window length Extension, termed as TEGAN. TEGAN transforms short-length SSVEP signals into long-length artificial SSVEP signals. Additionally, we introduced a two-stage training strategy and the LeCam-divergence regularization term to regularize the training process of GAN during the network implementation. The proposed TEGAN was evaluated on two public SSVEP datasets (a 4-class and 12-class dataset). With the assistance of TEGAN, the performance of traditional frequency recognition methods and deep learning-based methods have been significantly improved under limited calibration data. And the classification performance gap of various frequency recognition methods has been narrowed. This study substantiates the feasibility of the proposed method to extend the data length for short-time SSVEP signals for developing a high-performance BCI system. The proposed GAN-based methods have the great potential of shortening the calibration time and cutting down the budget for various real-world BCI-based applications.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":null,"pages":null},"PeriodicalIF":3.7,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141190568","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Break-up and recovery of harmony between direct and indirect pathways in the basal ganglia: Huntington’s disease and treatment 基底神经节直接和间接通路之间和谐关系的打破和恢复:亨廷顿氏病与治疗
IF 3.7 3区 工程技术
Cognitive Neurodynamics Pub Date : 2024-05-30 DOI: 10.1007/s11571-024-10125-w
Sang-Yoon Kim, Woochang Lim
{"title":"Break-up and recovery of harmony between direct and indirect pathways in the basal ganglia: Huntington’s disease and treatment","authors":"Sang-Yoon Kim, Woochang Lim","doi":"10.1007/s11571-024-10125-w","DOIUrl":"https://doi.org/10.1007/s11571-024-10125-w","url":null,"abstract":"<p>The basal ganglia (BG) in the brain exhibit diverse functions for motor, cognition, and emotion. Such BG functions could be made via competitive harmony between the two competing pathways, direct pathway (DP) (facilitating movement) and indirect pathway (IP) (suppressing movement). As a result of break-up of harmony between DP and IP, there appear pathological states with disorder for movement, cognition, and psychiatry. In this paper, we are concerned about the Huntington’s disease (HD), which is a genetic neurodegenerative disorder causing involuntary movement and severe cognitive and psychiatric symptoms. For the HD, the number of D2 SPNs (<span>(N_{rm D2})</span>) is decreased due to degenerative loss, and hence, by decreasing <span>(x_{rm D2})</span> (fraction of <span>(N_{rm D2})</span>), we investigate break-up of harmony between DP and IP in terms of their competition degree <span>(mathcal{C}_d)</span>, given by the ratio of strength of DP (<span>(mathcal{S}_{DP})</span>) to strength of IP (<span>(mathcal{S}_{IP})</span>) (i.e., <span>(mathcal{C}_d = mathcal{S}_{DP} / mathcal{S}_{IP})</span>). In the case of HD, the IP is under-active, in contrast to the case of Parkinson’s disease with over-active IP, which results in increase in <span>(mathcal{C}_d)</span> (from the normal value). Thus, hyperkinetic dyskinesia such as chorea (involuntary jerky movement) occurs. We also investigate treatment of HD, based on optogenetics and GP ablation, by increasing strength of IP, resulting in recovery of harmony between DP and IP. Finally, we study effect of loss of healthy synapses of all the BG cells on HD. Due to loss of healthy synapses, disharmony between DP and IP increases, leading to worsen symptoms of the HD.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":null,"pages":null},"PeriodicalIF":3.7,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141190676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Affective EEG-based cross-session person identification using hierarchical graph embedding 利用分层图嵌入进行基于情感脑电图的跨会期人员识别
IF 3.7 3区 工程技术
Cognitive Neurodynamics Pub Date : 2024-05-29 DOI: 10.1007/s11571-024-10132-x
Honggang Liu, Xuanyu Jin, Dongjun Liu, Wanzeng Kong, Jiajia Tang, Yong Peng
{"title":"Affective EEG-based cross-session person identification using hierarchical graph embedding","authors":"Honggang Liu, Xuanyu Jin, Dongjun Liu, Wanzeng Kong, Jiajia Tang, Yong Peng","doi":"10.1007/s11571-024-10132-x","DOIUrl":"https://doi.org/10.1007/s11571-024-10132-x","url":null,"abstract":"<p>The electroencephalogram (EEG) signal is being investigated as a more confidential biometric for person identification. Despite recent advancements, a persistent challenge lies in the influence of variations in affective states. Affective states consistently exist during data collection, regardless of the protocol used. Additionally, the inherently non-stationary nature of EEG makes it susceptible to fluctuations in affective states over time. Therefore, it would be highly crucial to perform precise EEG-based person identification under varying affective states. This paper employed an integrated Multi-scale Convolution and Graph Pooling network (MCGP) to mitigate the impact of affective state variations. MCGP utilized multiple 1D convolutions at different scales to dynamically extract and fuse features. Additionally, a graph pooling layer with an attention mechanism was incorporated to generate hierarchical graph embeddings. These embeddings were concatenated as inputs for a fully connected classification layer. Experiments were conducted on the SEED and SEED-V dataset, revealing that MCGP achieved an average accuracy of 85.51% for SEED and 88.69% for SEED-V in cross-session conditions involving mixed affective states. Under single affective state cross-session scenario, MCGP achieved an average accuracy of 85.75% for SEED and 88.06% for SEED-V for the same affective states, while obtaining 79.57% for SEED and 84.52% for SEED-V for different affective states. Results indicated that, compared to the baseline methods, MCGP effectively mitigated the impact of variations in affective states across different sessions. In single affective state cross-session scenario, identification performance for the same affective states was slightly higher than that for different affective states.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":null,"pages":null},"PeriodicalIF":3.7,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141190677","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
PSPN: Pseudo-Siamese Pyramid Network for multimodal emotion analysis PSPN:用于多模态情感分析的伪暹罗金字塔网络
IF 3.7 3区 工程技术
Cognitive Neurodynamics Pub Date : 2024-05-28 DOI: 10.1007/s11571-024-10123-y
Yanyan Yin, Wanzeng Kong, Jiajia Tang, Jinghao Li, Fabio Babiloni
{"title":"PSPN: Pseudo-Siamese Pyramid Network for multimodal emotion analysis","authors":"Yanyan Yin, Wanzeng Kong, Jiajia Tang, Jinghao Li, Fabio Babiloni","doi":"10.1007/s11571-024-10123-y","DOIUrl":"https://doi.org/10.1007/s11571-024-10123-y","url":null,"abstract":"<p>Emotion recognition plays an important role in human life and healthcare. The EEG has been extensively researched as an objective indicator of intense emotions. However, current existing methods lack sufficient analysis of shallow and deep EEG features. In addition, human emotions are complex and variable, making it difficult to comprehensively represent emotions using a single-modal signal. As a signal associated with gaze tracking and eye movement detection, Eye-related signals provide various forms of supplementary information for multimodal emotion analysis. Therefore, we propose a Pseudo-Siamese Pyramid Network (PSPN) for multimodal emotion analysis. The PSPN model employs a Depthwise Separable Convolutional Pyramid (DSCP) to extract and integrate intrinsic emotional features at various levels and scales from EEG signals. Simultaneously, we utilize a fully connected subnetwork to extract the external emotional features from eye-related signals. Finally, we introduce a Pseudo-Siamese network that integrates a flexible cross-modal dual-branch subnetwork to collaboratively utilize EEG emotional features and eye-related behavioral features, achieving consistency and complementarity in multimodal emotion recognition. For evaluation, we conducted experiments on the DEAP and SEED-IV public datasets. The experimental results demonstrate that multimodal fusion significantly improves the accuracy of emotion recognition compared to single-modal approaches. Our PSPN model achieved the best accuracy of 96.02% and 96.45% on the valence and arousal dimensions of the DEAP dataset, and 77.81% on the SEED-IV dataset, respectively. Our code link is: https://github.com/Yinyanyan003/PSPN.git.</p>","PeriodicalId":10500,"journal":{"name":"Cognitive Neurodynamics","volume":null,"pages":null},"PeriodicalIF":3.7,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141169350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信