A Progressive Multi-Domain Adaptation Network With Reinforced Self-Constructed Graphs for Cross-Subject EEG-Based Emotion and Consciousness Recognition

Abstract

Electroencephalogram (EEG)-based emotion recognition is a vital component in brain-computer interface applications. However, it faces two significant challenges: 1) extracting domain-invariant features while effectively preserving emotion-related information, and 2) aligning the joint probability distributions of data across different individuals. To address these challenges, we propose a progressive multi-domain adaptation network with reinforced self-constructed graphs. Specifically, we introduce EEG-CutMix to construct unlabeled mixed-domain data, facilitating the transition between source and target domains. Additionally, a reinforced self-constructed graphs module is employed to extract domain-invariant features. Finally, a progressive multi-domain adaptation framework is constructed to smoothly align the data distributions across individuals. Experiments on cross-subject datasets demonstrate that our model achieves state-of-the-art performance on the SEED and SEED-IV datasets, with accuracies of 97.03% $\pm ~1.65$ % and 88.18% $\pm ~4.55$ %, respectively. Furthermore, tests on a self-recorded dataset, comprising ten healthy subjects and twelve patients with disorders of consciousness (DOC), show that our model achieves a mean accuracy of 86.65% $\pm ~2.28$ % in healthy subjects. Notably, it successfully applies to DOC patients, with four subjects achieving emotion recognition accuracy exceeding 70%. These results validate the effectiveness of our model in EEG emotion recognition and highlight its potential for assessing consciousness levels in DOC patients. The source code for the proposed model is available at GitHub-seizeall/mycode.