Assessment of users' interests in multimodal dialog based on exchange unit

Abstract

A person is more likely to enjoy long-term conversations with a robot if it has the capability to infer the topics that interest the person. In this paper, we propose a method of deducing the specific topics that interest a user by sequentially assessing each exchange in a chat-oriented dialog session. We use multimodal information such as facial expressions and prosodic information obtained from the user's utterances for assessing interest as these parameters are independent of linguistic information that varies widely in chat-oriented dialogs. The results show that the accuracy of the assessment of the user's interest is better when we use both features.