2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)最新文献

筛选
英文 中文
A Dual-Complementary Acoustic Embedding Network Learned from Raw Waveform for Speech Emotion Recognition 基于原始波形学习的双互补声学嵌入网络用于语音情感识别
Tzu-Yun Huang, Jeng-Lin Li, Chun-Min Chang, Chi-Chun Lee
{"title":"A Dual-Complementary Acoustic Embedding Network Learned from Raw Waveform for Speech Emotion Recognition","authors":"Tzu-Yun Huang, Jeng-Lin Li, Chun-Min Chang, Chi-Chun Lee","doi":"10.1109/ACII.2019.8925496","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925496","url":null,"abstract":"Speech emotion recognition (SER) technology has recently become a trend in a broader field and has achieved remarkable recognition performances using deep learning technique. However, the recognition performances obtained using end-to-end learning directly from raw audio waveform still hardly exceed those based on hand-crafted acoustic descriptors. Instead of solely rely on raw waveform or acoustic descriptors for SER, we propose an acoustic space augmentation network, termed as Dual-Complementary Acoustic Embedding Network (DCaEN), that combines knowledge-based features with raw waveform embedding learned with a novel complementary constraint. DCaEN includes representations from eGeMAPS acoustic feature and raw waveform by specifying a negative cosine distance loss to explicitly constrain the raw waveform embedding to be different from eGeMAPS. Our experimental results demonstrate an improved emotion discriminative power on the IEMOCAP database, which achieves 59.31% in a four class emotion recognition. Our analysis also demonstrates that the learned raw waveform embedding of DCaEN converges close to reverse mirroring of the original eGeMAPS space.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"208 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114924914","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Touch Media: Investigating the Effects of Remote Touch on Music-based Emotion Elicitation 触摸媒介:研究远程触摸对基于音乐的情感激发的影响
Angela Chan, Niloofar Zarei, T. Yamauchi, J. Seo, Francis K. H. Quek
{"title":"Touch Media: Investigating the Effects of Remote Touch on Music-based Emotion Elicitation","authors":"Angela Chan, Niloofar Zarei, T. Yamauchi, J. Seo, Francis K. H. Quek","doi":"10.1109/ACII.2019.8925469","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925469","url":null,"abstract":"Touch is a contextual medium for affect conveyance. It is difficult to assign specific meanings to each instance of touch in isolation. However, when engaged within context, touch becomes a powerful and indispensable means for humans to convey feelings of love, concern, and sympathy. This paper explores how remote touch may influence one's affective experience of music, and how this experience is dependent on the relationship between the originator and recipient of the touch. For our study, we designed: (1) A mediated touch system that provides kinesthetic touches through an armband device that is controlled by changes in force applied to an input device, and (2) A touch-media system by which one can record and playback a co-temporal stream of touches with a track of music. We examined: (1) How remote touch may influence a touch recipient's experience of the music, and (2) how the recipients' affective experiences may depend on whether the touch is believed to be generated by intimates (familiar touch) versus by a music performer as part of a performance (unfamiliar touch)? Our study's results revealed that there is a significant correlation between the conditions (familiar, unfamiliar, and no touches) and song types (happy, sad) in both positive and negative affective experiences.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129476622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
A Computational Model for Managing Impressions of an Embodied Conversational Agent in Real-Time 实时管理具身会话代理印象的计算模型
Béatrice Biancardi, Chen Wang, M. Mancini, Angelo Cafaro, G. Chanel, C. Pelachaud
{"title":"A Computational Model for Managing Impressions of an Embodied Conversational Agent in Real-Time","authors":"Béatrice Biancardi, Chen Wang, M. Mancini, Angelo Cafaro, G. Chanel, C. Pelachaud","doi":"10.1109/ACII.2019.8925495","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925495","url":null,"abstract":"This paper presents a computational model for managing an Embodied Conversational Agent's first impressions of warmth and competence towards the user. These impressions are important to manage because they can impact users' perception of the agent and their willingness to continue the interaction with the agent. The model aims at detecting user's impression of the agent and producing appropriate agent's verbal and nonverbal behaviours in order to maintain a positive impression of warmth and competence. User's impressions are recognized using a machine learning approach with facial expressions (action units) which are important indicators of users' affective states and intentions. The agent adapts in real-time its verbal and nonverbal behaviour, with a reinforcement learning algorithm that takes user's impressions as reward to select the most appropriate combination of verbal and non-verbal behaviour to perform. A user study to test the model in a contextualized interaction with users is also presented. Our hypotheses are that users' ratings differs when the agents adapts its behaviour according to our reinforcement learning algorithm, compared to when the agent does not adapt its behaviour to user's reactions (i.e., when it randomly selects its behaviours). The study shows a general tendency for the agent to perform better when using our model than in the random condition. Significant results shows that user's ratings about agent's warmth are influenced by their a-priori about virtual characters, as well as that users' judged the agent as more competent when it adapted its behaviour compared to random condition.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"104 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121398868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
Automatic Recognition of Multiple Affective States in Virtual Rehabilitation by Exploiting the Dependency Relationships 基于依赖关系的虚拟康复多情感状态自动识别
J. Rivas, F. Orihuela-Espina, L. Sucar, A. Williams, N. Bianchi-Berthouze
{"title":"Automatic Recognition of Multiple Affective States in Virtual Rehabilitation by Exploiting the Dependency Relationships","authors":"J. Rivas, F. Orihuela-Espina, L. Sucar, A. Williams, N. Bianchi-Berthouze","doi":"10.1109/ACII.2019.8925508","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925508","url":null,"abstract":"The automatic recognition of multiple affective states can be enhanced if the underpinning computational models explicitly consider the interactions between the states. This work proposes a computational model that incorporates the dependencies between four states (tiredness, anxiety, pain, and engagement)known to appear in virtual rehabilitation sessions of post-stroke patients, to improve the automatic recognition of the patients' states. A dataset of five stroke patients which includes their fingers' pressure (PRE), hand movements (MOV)and facial expressions (FAE)during ten sessions of virtual rehabilitation was used. Our computational proposal uses the Semi-Naive Bayesian classifier (SNBC)as base classifier in a multiresolution approach to create a multimodal model with the three sensors (PRE, MOV, and FAE)with late fusion using SNBC (FSNB classifier). There is a FSNB classifier for each state, and they are linked in a circular classifier chain (CCC)to exploit the dependency relationships between the states. Results of CCC are over 90% of ROC AUC for the four states. Relationships of mutual exclusion between engagement and all the other states and some co-occurrences between pain and anxiety for the five patients were detected. Virtual rehabilitation platforms that incorporate the automatic recognition of multiple patient's states could leverage intelligent and empathic interactions to promote adherence to rehabilitation exercises.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121707337","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Automatic Neonatal Pain Estimation: An Acute Pain in Neonates Database 新生儿疼痛自动估计:新生儿急性疼痛数据库
Joy O. Egede, M. Valstar, M. Torres, D. Sharkey
{"title":"Automatic Neonatal Pain Estimation: An Acute Pain in Neonates Database","authors":"Joy O. Egede, M. Valstar, M. Torres, D. Sharkey","doi":"10.1109/ACII.2019.8925480","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925480","url":null,"abstract":"Pain assessment is a vital part of newborn treatment in Intensive Care Units. However, clinical pain assessment is highly subjective and does not support continual pain monitoring. Automated tools have been introduced to address this problem, but their performance is limited by inadequate training data and unsuitable pain annotations. In addition, current automated tools focus on pain detection rather than severity estimation, which is the unmet need in medical treatment. In this paper, we present: a) the Acute Pain in Neonates (APN-db) database, a public dataset to support research in this field and allow for benchmarking of new automated tools; b) a novel L1-point Neonatal Face and Limb Acute Pain Scale (NFLAPS), a visual behaviour-centric pain measurement tool, which is an adaptation of the Neonatal Infant Pain Scale (NIPS) and the Neonatal Facial Coding System (NFCS); and c) a system for neonatal pain assessment which encodes pain indicative-features using handcrafted algorithms and deep-learned features. Experiments show that our system performs well with an RMSE of 1.9 compared to human error of 1.65 on the same dataset, demonstrating its potential application to newborn health care.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121943403","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Understanding Chromaesthesia by Strengthening Auditory -Visual-Emotional Associations 通过加强听觉-视觉-情感联系来理解色觉
Patrick O'Toole, D. Glowinski, M. Mancini
{"title":"Understanding Chromaesthesia by Strengthening Auditory -Visual-Emotional Associations","authors":"Patrick O'Toole, D. Glowinski, M. Mancini","doi":"10.1109/ACII.2019.8925465","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925465","url":null,"abstract":"Can cross-modal associations between notes and colours and between notes and emotions be strengthened by using an ad-hoc designed computer program? In this paper we present an experiment that we conducted to see (H1) if participants' associations between the auditory and visual senses could be strengthened through immersion in a multi-sensory program and (H2) if there was any correlation between auditory-visual and the auditory-emotion associations. In our experiment, participants were asked to use the SoundStrokes program, an application that translates notes played on an analog music instrument (i.e., a guitar) into coloured graphical shapes (i.e., rectangles). Between several training sessions with the program, participants were asked to associate single music notes to colours and emotions. Applications of our work may vary from entertainment, to enrich in a systematic manner the user emotional experience in, for example, videogames or immersive experiences, to digital health, in which relatively simple tools can be developed, for example, to reduce anxiety through music.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131384096","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Generative Adversarial Networks and Simulated+Unsupervised Learning in Affect Recognition from Speech 语音情感识别中的生成对抗网络和模拟+无监督学习
Tilman Krokotsch, Ronald Böck
{"title":"Generative Adversarial Networks and Simulated+Unsupervised Learning in Affect Recognition from Speech","authors":"Tilman Krokotsch, Ronald Böck","doi":"10.1109/ACII.2019.8925504","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925504","url":null,"abstract":"Training classifiers for affective speech relies on high quality, labeled corpora of sufficient size, e.g. EmoDB. Often these corpora are recorded in acoustically clean environments, like recording studios, that do not represent real-life acoustic settings. While some researchers try to expand the catalog of real-life, affective speech, e.g. by re-recording clean corpora in realistic settings, the process remains highly time and resource intensive. We present a novel approach to artificially generate affective speech in real-life domains from existing corpora by using deep neural networks. Specifically, we adapt the Simulated+Unsupervised Learning approach to affective speech and extend it appropriately. The quality of the generated data is evaluated by training a classifier on it and comparing it to one, trained on the real domain-specific data.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131639079","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
A Conversational Agent in Support of Productivity and Wellbeing at Work 支持工作效率和幸福感的对话代理
Everlyne Kimani, Kael Rowan, Daniel J. McDuff, M. Czerwinski, G. Mark
{"title":"A Conversational Agent in Support of Productivity and Wellbeing at Work","authors":"Everlyne Kimani, Kael Rowan, Daniel J. McDuff, M. Czerwinski, G. Mark","doi":"10.1109/ACII.2019.8925488","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925488","url":null,"abstract":"Conversational agents have the potential to support users in many tasks. However, support for productivity and well-being in the workplace has received little attention. We present the first design of a conversational system that supports information workers with multiple work-related goals, informed by a survey of the current and potential use of conversational agents in the workplace. The goals of this research include the evaluation of using an agent for scheduling and prioritizing tasks, switching tasks, providing break reminders, dealing with social media distractions and for end of the day reflection on tasks accomplished. We deployed a chat-based intelligent agent, named Amber, in a field study with 24 information workers over the course of 6 days. We present our preliminary findings from the field study and discuss implications for the design of future workplace conversational agents","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"85 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131422913","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 34
Visual Cues for Disrespectful Conversation Analysis 无礼谈话分析的视觉线索
Samiha Samrose, Wenyi Chu, C. He, Yuebai Gao, Syeda Sarah Shahrin, Zhen Bai, Ehsan Hoque
{"title":"Visual Cues for Disrespectful Conversation Analysis","authors":"Samiha Samrose, Wenyi Chu, C. He, Yuebai Gao, Syeda Sarah Shahrin, Zhen Bai, Ehsan Hoque","doi":"10.1109/ACII.2019.8925440","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925440","url":null,"abstract":"Toxic, abusive, or disrespectful behavior analysis is a non-trivial problem previously addressed mostly from the language perspective. In this paper, we present a novel video dataset containing disrespect and non-disrespect labels, and introduce such behavior analysis by using visual cues. The dataset is collected from YouTube news show videos of two-party conversations, in which a host and a guest interact through teleconferencing. Each video is labeled by three trained raters to identify disrespect expressed through face and gesture, voice, and language. By resolving confounding factors, we generate the corresponding pairwise samples of non-disrespect. To particularly show the influence of visual cues in disrespectful interactions, we present 222 labeled clips (duration=974.41(s), mean duration=4.39(s)). We extract and analyze the facial action units (AVs) prevalent in disrespectful behavior. Our result shows statistically significant differences after Bonferroni correction for Inner Brow raise (AV01), Lip Corner Depressor (AV15), and Chin Raiser (AV17). For prediction, we build two classifiers using logistic regression and linear Support Vector Machine with 62.61 % and 61.48 % accuracy, respectively. For an in-depth analysis of overall face and gesture features, we conduct a qualitative analysis using theme extraction. Our qualitative analysis provides further insights on leveraging synchronous and asynchronous features, along with combining text and audio data with visual cues to better detect disrespect.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"62 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127247622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Robots Expressing Dominance: Effects of Behaviours and Modulation 机器人表达支配:行为和调节的影响
Rifca Peters, J. Broekens, Kangqi Li, Mark Antonius Neerincx
{"title":"Robots Expressing Dominance: Effects of Behaviours and Modulation","authors":"Rifca Peters, J. Broekens, Kangqi Li, Mark Antonius Neerincx","doi":"10.1109/ACII.2019.8925500","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925500","url":null,"abstract":"A mayor challenge in human-robot interaction and collaboration is the synthesis of non-verbal behaviour for the expression of social signals. Appropriate perception and expression of dominance (verticality) in non-verbal behaviour is essential for social interaction. In this paper, we present our work on algorithmic modulation of robot bodily movement to express varying degrees of dominance. We developed a parameter-based model for head tilt and body expansiveness. This model was applied to a variety of behaviours. These behaviours were evaluated by human observers in two different studies with respectively static pictures of key postures (N=772) and realtime gestures (N=31). Overall, specific behaviours proved to communicate different levels of dominance. Further, modulation of body expansiveness and head tilt robustly influenced perceived dominance independent of specific behaviours and observer viewing height and angle. The modulation did not influence perceived valence, but it did influence perceived arousal. Our study shows that dominance can be reliably expressed by both selection of specific behaviours and modulation of behaviours.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114768774","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书