Unveiling complex brain dynamics during movie viewing via deep recurrent autoencoder model

Abstract

Naturalistic stimuli have become an effective tool to uncover the dynamic functional brain networks triggered by cognitive and emotional real-life experiences through multimodal and dynamic stimuli. However, current research predominantly focused on exploring dynamic functional connectivity generated via chosen templates under resting-state paradigm, with relatively limited investigation into the dynamic functional interactions among large-scale brain networks. Moreover, these studies might overlook the longer time-scale adaptability and information transmission that occur over extended periods during naturalistic stimuli. In this study, we introduced an unsupervised deep recurrent autoencoder (DRAE) model combined with a sliding window approach, effectively capturing the brain's long-term temporal dependencies, as measured in functional magnetic resonance imaging (fMRI), when subjects viewing a long-duration and emotional film. The experimental results revealed that naturalistic stimuli can induce dynamic large-scale brain networks, of which functional interactions covary with the development of the film's narrative. Furthermore, the dynamic interactions among brain networks were temporally synchronized with specific features of the movie, especially with the emotional arousal and valence. Our study provided novel insight to the underlying neural mechanisms of dynamic functional interactions among brain regions in an ecologically valid sensory experience.