Important Nonverbal Attributes for Spontaneous Speech Recognition

Abstract

Understanding human emotions and their nonverbal messages is one of the most necessary and important abilities for making the next generation of human-computer interfaces (HCI) easier, more natural and effective. The main goal of this paper is to compare different methods to combine the results of both classifiers – both paralanguage and facial expressions. A prototype of the dialog system was developed in the Department of Computer Science . The proposed system is fully automatic, user-independent and real-time working. Several experiments show that the speech recognition quality is increased by using nonverbal information. The work presented in this paper was supported by the project number 2C06009.