Exploring relations between cognitive style and multimodal expression of emotion in a TV series corpus

Abstract

In order for virtual characters to be believable when expressing emotion, researchers are trying to endow them with a personality focusing mostly on lexical approaches from Psychology. Whereas multimodal corpora are developing to inform the definition of models relating emotion and their expression in different modalities, they seldom enable to study the impact of personality on the way individuals appraise various emotional situations. In this paper we explain how we collected a TV series corpus which is relevant for the study of cognitive styles. We describe how subjects perceive multimodal expressions of emotion and personality and if there are links between personality and emotional expressions.