{"title":"Visualization of social emotional appraisal process of an agent","authors":"Motoaki Sato, K. Terada, J. Gratch","doi":"10.1109/aciiw52867.2021.9666329","DOIUrl":"https://doi.org/10.1109/aciiw52867.2021.9666329","url":null,"abstract":"Emotion expressions show the results of appraising sensory inputs that reflect both the physical and social environment. The observer of the emotion expressions should decode how sensory input appraised in the actor, i.e., reverse appraisal. However, the reverse appraisal is an ill-posed inverse problem because the same emotional expression is produced in different situations and emotion expressions in the same situation vary depending on individual differences. To overcome this difficulty, individuals must have an appropriate appraisal model. Our final goal is to build a social skill training system that trains people who have difficulties in understanding the mental states of others. In the present paper, we show an emotional interactive agent with a transparent appraisal process. It is a future issue to investigate whether social skills can be acquired through our system.","PeriodicalId":105376,"journal":{"name":"2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)","volume":"301 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128656934","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Kotov, N. Arinkin, Alexander Filatov, L. Zaidelman, A. Zinina, Kirill Kivva
{"title":"Event Representation and Semantics Processing System for F-2 Companion Robot","authors":"A. Kotov, N. Arinkin, Alexander Filatov, L. Zaidelman, A. Zinina, Kirill Kivva","doi":"10.1109/aciiw52867.2021.9666303","DOIUrl":"https://doi.org/10.1109/aciiw52867.2021.9666303","url":null,"abstract":"F-2 companion robot is designed to implement and test various cognitive functions linked with text comprehension, as well as verbal and nonverbal communication strategies. F-2 has a syntactic parser and text comprehension engine, based on productions, where each incoming sentence meaning, or a computer vision event is associated with the most relevant scripts. The script engine is designed to simulate communicative reactions, emotional dynamics, and rational inferences. Scripts are activated, depending on the state of the emotion model, and provide output behavioral packages in Behavior markup language (BML), executed by the robot. We demonstrate simultaneous responses of the robot to the incoming phrases, human gazes, and events in the Tangram puzzle game, where the robot guides the player and emotionally reacts to the game events.","PeriodicalId":105376,"journal":{"name":"2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114309688","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Theodoros Galanos, Antonios Liapis, Georgios N. Yannakakis
{"title":"AffectGAN: Affect-Based Generative Art Driven by Semantics","authors":"Theodoros Galanos, Antonios Liapis, Georgios N. Yannakakis","doi":"10.1109/aciiw52867.2021.9666317","DOIUrl":"https://doi.org/10.1109/aciiw52867.2021.9666317","url":null,"abstract":"This paper introduces a novel method for generating artistic images that express particular affective states. Leveraging state-of-the-art deep learning methods for visual generation (through generative adversarial networks), semantic models from OpenAI, and the annotated dataset of the visual art encyclopedia WikiArt, our AffectGAN model is able to generate images based on specific or broad semantic prompts and intended affective outcomes. A small dataset of 32 images generated by AffectGAN is annotated by 50 participants in terms of the particular emotion they elicit, as well as their quality and novelty. Results show that for most instances the intended emotion used as a prompt for image generation matches the participants' responses. This small-scale study brings forth a new vision towards blending affective computing with computational creativity, enabling generative systems with intentionality in terms of the emotions they wish their output to elicit.","PeriodicalId":105376,"journal":{"name":"2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123128585","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Therapeutic Dialogue Agent for Polish Language","authors":"Artur Zygadło","doi":"10.1109/aciiw52867.2021.9666281","DOIUrl":"https://doi.org/10.1109/aciiw52867.2021.9666281","url":null,"abstract":"Mental disorders affect large numbers of people worldwide. Computer-aided therapies have been designed and successfully applied in the context of mental health, including solutions based on artificial intelligence (AI). Application of AI in mental disorder therapies frequently has the form of dialogue systems. The long-term goal of this research is to develop a therapeutic chatbot capable of having a conversation in Polish. The initial work was focused on literature review and choosing the software framework for the dialogue system. As a next step, we have prepared a dataset of emotionally grounded dialogue turns in Polish, by applying machine translation to an existing resource for English. The resulting dataset was used for training an emotion recognition model which will be incorporated into the dialogue system. Next, the chatbot will be exposed to a group of test users, and its language understanding capabilities will be further developed. In future, the system will be equipped with a speech interface to also enable verbal communication. We plan to conduct experiments with the help of therapists and patients, followed by thorough analyses of their interactions with the chatbot.","PeriodicalId":105376,"journal":{"name":"2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134110731","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lara Chehayeb, Dimitra Tsovaltzi, Rhythm Arora, Patrick Gebhard
{"title":"Individual Differences and the Function of Emotions in Socio-Emotional and Cognitive Conflict: If an Agent Shames you, will you still be Bored?","authors":"Lara Chehayeb, Dimitra Tsovaltzi, Rhythm Arora, Patrick Gebhard","doi":"10.1109/aciiw52867.2021.9666343","DOIUrl":"https://doi.org/10.1109/aciiw52867.2021.9666343","url":null,"abstract":"Employers seek to support their employees to increase their well-being and long-term performance. Boredom is considered as a main unpleasant emotional state at the workplace, which could lead to stress, depression and decreased well-being. Boredom is related to the situation at hand and may lead to decreased performance. We frame the situation by connecting socio-emotional and cognitive conflict and individual differences to shed light onto the function of boredom. We look at the relation of boredom to theoretically connected emotions and their regulation. We conducted an online experiment in a virtual workplace setting (N = 57). We induced a socio-emotional and cognitive conflict situation by using a socially interactive agent which shames participants. Individual differences were operationalised through social identity and self-consciousness. We tested how social identity (predictor) and self-consciousness (moderator) influence cognitive appraisal of threat (mediator) and boredom (outcome). The results revealed that self-consciousness moderates the effect of social identity on cognitive appraisal of threat which then mediates the effect of social identity on boredom.","PeriodicalId":105376,"journal":{"name":"2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132467161","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Thomas Kiderle, Hannes Ritschel, Kathrin Janowski, Silvan Mertes, F. Lingenfelser, E. André
{"title":"Socially-Aware Personality Adaptation","authors":"Thomas Kiderle, Hannes Ritschel, Kathrin Janowski, Silvan Mertes, F. Lingenfelser, E. André","doi":"10.1109/aciiw52867.2021.9666197","DOIUrl":"https://doi.org/10.1109/aciiw52867.2021.9666197","url":null,"abstract":"Emotion and personality are interrelated. A social agent's perceived personality profile influences its affective behavior and vice versa. Having a clear idea and understanding of personality, both from a theoretical perspective and in the context of social agents, is essential for designing intelligent and affective agents. This also includes adaptation to the individual user's needs and preferences, which can be driven by explicit or implicit user feedback to create engaging interactions in the long run. This paper provides a literature overview on how to implement personality for an embodied agent. After presenting personality and personality attraction related theories, we show how personality is conveyed multimodally in current implementations of social agents. Furthermore, adaptation approaches are surveyed, which are used to shape the behavior according to the user preferences.","PeriodicalId":105376,"journal":{"name":"2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128813614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Affect as Interaction Approach for Stress Management Among Paramedics","authors":"Akiri Surely","doi":"10.1109/aciiw52867.2021.9666402","DOIUrl":"https://doi.org/10.1109/aciiw52867.2021.9666402","url":null,"abstract":"Stress is a leading cause of errors and mental health issues for Emergency Medical Service providers, and most mitigation strategies have not always been successful. We describe our planned research to engage affect as interaction to design a system that promotes reflection and awareness to build resilience towards stress and negative emotions among paramedics. Also, although successfully implemented, affect as interaction has received far less attention in research. Therefore, we propose an affect as interaction mobile application that leverages the camaraderie nature of paramedics and the Alcoholic Anonymous (AA) framework to present paramedics and sponsors with paramedic's electrodermal activity data and users proffered contextual information for an individual or team review, discussion, and interpretation.","PeriodicalId":105376,"journal":{"name":"2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)","volume":"251 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121883342","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Barthet, Antonios Liapis, Georgios N. Yannakakis
{"title":"Go-Blend Behavior and Affect","authors":"M. Barthet, Antonios Liapis, Georgios N. Yannakakis","doi":"10.1109/aciiw52867.2021.9666376","DOIUrl":"https://doi.org/10.1109/aciiw52867.2021.9666376","url":null,"abstract":"This paper proposes a paradigm shift for affective computing by viewing the affect modeling task as a reinforcement learning process. According to our proposed framework the context (environment) and the actions of an agent define the common representation that interweaves behavior and affect. To realise this framework we build on recent advances in reinforcement learning and use a modified version of the Go-Explore algorithm which has showcased supreme performance in hard exploration tasks. In this initial study, we test our framework in an arcade game by training Go-Explore agents to both play optimally and attempt to mimic human demonstrations of arousal. We vary the degree of importance between optimal play and arousal imitation and create agents that can effectively display a palette of affect and behavioral patterns. Our Go-Explore implementation not only introduces a new paradigm for affect modeling; it empowers believable AI-based game testing by providing agents that can blend and express a multitude of behavioral and affective patterns.","PeriodicalId":105376,"journal":{"name":"2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126872592","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"AffRankNet+: Ranking Affect Using Privileged Information","authors":"Konstantinos Makantasis","doi":"10.1109/aciiw52867.2021.9666328","DOIUrl":"https://doi.org/10.1109/aciiw52867.2021.9666328","url":null,"abstract":"Many of the affect modelling tasks present an asymmetric distribution of information between training and test time; additional information is given about the training data, which is not available at test time. Learning under this setting is called Learning Under Privileged Information (LUPI). At the same time, due to the ordinal nature of affect annotations, formulating affect modelling tasks as supervised learning ranking problems is gaining ground within the Affective Computing research community. Motivated by the two facts above, in this study, we introduce a ranking model that treats additional information about the training data as privileged information to accurately rank affect states. Our ranking model extends the well-known RankNet model to the LUPI paradigm, hence its name Af-fRankNet+. To the best of our knowledge, it is the first time that a ranking model based on neural networks exploits privileged information. We evaluate the performance of the proposed model on the public available Afew-VA dataset and compare it against the RankNet model, which does not use privileged information. Experimental evaluation indicates that the AffRankNet+ model can yield significantly better performance.","PeriodicalId":105376,"journal":{"name":"2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131914935","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Anubha Bhatti, Behnam Behinaein, D. Rodenburg, P. Hungler, A. Etemad
{"title":"Attentive Cross-modal Connections for Deep Multimodal Wearable-based Emotion Recognition","authors":"Anubha Bhatti, Behnam Behinaein, D. Rodenburg, P. Hungler, A. Etemad","doi":"10.1109/aciiw52867.2021.9666360","DOIUrl":"https://doi.org/10.1109/aciiw52867.2021.9666360","url":null,"abstract":"Classification of human emotions can play an essential role in the design and improvement of human-machine systems. While individual biological signals such as Electrocardiogram (ECG) and Electrodermal Activity (EDA) have been widely used for emotion recognition with machine learning methods, multimodal approaches generally fuse extracted features or final classification/regression results to boost performance. To enhance multimodal learning, we present a novel attentive cross-modal connection to share information between convolutional neural networks responsible for learning individual modalities. Specifically, these connections improve emotion classification by sharing intermediate representations among EDA and ECG and apply attention weights to the shared information, thus learning more effective multimodal embeddings. We perform experiments on the WESAD dataset to identify the best configuration of the proposed method for emotion classification. Our experiments show that the proposed approach is capable of learning strong multimodal representations and outperforms a number of baselines methods.","PeriodicalId":105376,"journal":{"name":"2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)","volume":"99 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133441345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}