Multi-modal emotional processing for SCOUT: Beyond the HCI Psychometrics methods

Abstract

Human-Computer Interaction (HCI) research groups have recently attracted to the issue of emotion or affect especially in the examination of interaction and design. With recent technological advances, human users are able to interact with computers in ways which are almost impossible. New modalities for computer interaction with human emotion such as skin conductivity, heart rate, brain signals and physiological signals are emerging. It shows that emotion plays an important role in human communication and interaction, therefore allow people to express emotion beyond the verbal domain. This issue motivates the investigation of two modals of emotional processing in the application of HCI and User Interface Design (UID) areas. The result of this study is directed to the development of an affective interaction design storyboard tool called SCOUT. The paper addresses significant roles of Multi-modal Emotional Processing methods for SCOUT, which includes different types of Psychometric usability methods and Physiological emotional processing methods. The application of Psychometrics and Multi-modal Emotional Processing are then, analyzed. The results of the analysis revealed that the use of both processing methods would enrich the evaluation of emotion in human-computer interaction study.