Intertwining cognitive and affective intelligence into digital artifacts: An infrastructural approach

Designing and developing digital technological systems and their interactive interfaces as better companion with hominine characteristics is an active research hot-spot. Exploring the domain of facilitating machines with affective and cognitive intelligence and understanding the users is increasingly attracting the interest of researchers who are working in the field of human-computer interaction. If the interactive interfaces of digital system are enriched with human-like characteristics and such systems have an understanding of user's affective state (personality, mood and emotions) along with the ability to respond accordingly during interaction then definitely these intelligent hominine interfaces will be more natural, enjoyable, friendly and believable. The key challenge is to determine most appropriate techniques and models for generating these futuristic harmonious intelligent affective interfaces and services which may be quite different from their present GUI counterparts. This paper presents an infrastructural approach for machines to first realize the user's affective space and then creating its own cognitive and affective space to respond appropriately and harmoniously to the user. The proposed work suggests the methods and models to identify/determine user's personality (through AN-ECHO model), emotions (through facial expression recognition method) and mood (through computational model). The proposed approach uses personality along with user-profiling method to understand user's interests, preferences, characteristics, expectations etc. in order to incorporate cognitive intelligence. In this way, the proposed approach facilitates the machine to assess personality, mood and emotions of the user to express personalized and adaptive behavior to the user.