Deep learning-based multi-brain capsule network for Next-Gen Clinical Emotion recognition using EEG signals

Abstract

Deep learning techniques are crucial for next-generation clinical applications, particularly in Next-Gen Clinical Emotion recognition. To enhance classification accuracy, we propose an Attention mechanism based Capsule Network Model (At-CapNet) for Multi-Brain Region. EEG-tNIRS signals were collected using Next-Gen Clinical Emotion-inducing visual stimuli to construct the TYUT3.0 dataset, from which EEG and tNIRS features were extracted and mapped into matrices. A multi-brain region attention mechanism was applied to integrate EEG and tNIRS features, assigning different weights to features from distinct brain regions to obtain high-quality primary capsules. Additionally, a capsule network module was introduced to optimize the number of capsules entering the dynamic routing mechanism, improving computational efficiency. Experimental validation on the TYUT3.0 Next-Gen Clinical Emotion dataset demonstrates that integrating EEG and tNIRS improves recognition accuracy by 1.53% and 14.35% compared to single-modality signals. Moreover, the At-CapNet model achieves an average accuracy improvement of 4.98% over the original CapsNet model and outperforms existing CapsNet-based Next-Gen Clinical Emotion recognition models by 1% to 5%. This research contributes to the advancement of non-invasive neurotechnology for precise Next-Gen Clinical Emotion recognition, with potential implications for next-generation clinical diagnostics and interventions.