Unraveling the interplay of emotions in art and music: An event-related potential investigation

Abstract

The study examined the impact of music’s emotional content on the aesthetic experience of visual artworks during combined stimulation. The hypothesis posited that incongruity of emotional states induced by music would impede accurate comprehension of emotional aspect of artworks. A total of 18 university students were presented with 192 paintings and 20 emotionally congruent or incongruent musical excerpts. Both paintings and music were validated as belonging to four emotional categories with different valence (positive vs negative) and arousal (high vs low). ERP data showed that visual N170 and auditory N400 were modulated by stimuli emotional valence and that negative visual stimuli attracted more attention than positive ones (larger P300). The multimodal LP was modulated by the stimulus emotional congruence, with larger responses to positive than negative congruent pairs. During multimodal artistic simulation, the most active brain areas were the left middle frontal gyrus, superior frontal gyrus, right precuneus, and right middle temporal gyrus. Taken together, these results suggest that visual stimuli with negative valence attract more attention than positive ones and that congruent pairs are more pleasant than incongruent. Also, these findings suggest that the neural basis of the emergence of aesthetic sensations may be similar for both auditory and visual emotional processing.