2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)最新文献

筛选
英文 中文
Facial Expression Based Imagination Index and a Transfer Learning Approach to Detect Deception 基于面部表情的想象指数与欺骗检测的迁移学习方法
M. Hasan, Wasifur Rahman, Luke Gerstner, Taylan K. Sen, Sangwu Lee, K. Haut, Ehsan Hoque
{"title":"Facial Expression Based Imagination Index and a Transfer Learning Approach to Detect Deception","authors":"M. Hasan, Wasifur Rahman, Luke Gerstner, Taylan K. Sen, Sangwu Lee, K. Haut, Ehsan Hoque","doi":"10.1109/ACII.2019.8925473","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925473","url":null,"abstract":"In this paper, we introduce a framework to automatically distinguish between facial expression sequences associated with imagining vs. remembering while answering a question. Our experiment includes a baseline and relevant questioning technique in the context of deception with 220 participants (20 hours long). Baseline questioning includes participants being separately asked to remember and imagine an arbitrary experience. During the relevant questioning, participants were prompted to either lie or tell the truth about a certain task. We trained a neural network model on the baseline data and achieved an accuracy of 60% on classifying imagining vs. remembering, whereas human performance for this task is 51%. Relevant questioning included a set of questions, each of which became an independent response segment. Using a transfer learning approach, we use the pretrained model from the baseline to obtain an imagination probability score for each relevant response segment. We define this individual probability per response as the Imagination Index. We apply the imagination indices as a feature vector to classify the whole relevant section as truth vs. bluff with an accuracy of 70%, significantly outperforming the human performance of 52%.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125817490","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Emotion Recognition Using Fused Physiological Signals 基于融合生理信号的情绪识别
D. Fabiano, Shaun J. Canavan
{"title":"Emotion Recognition Using Fused Physiological Signals","authors":"D. Fabiano, Shaun J. Canavan","doi":"10.1109/ACII.2019.8925486","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925486","url":null,"abstract":"In this paper, we propose a new representation of human emotion through the fusion of physiological signals. Using the variance of these signals, the proposed method increases the effect of signals that contribute to the recognition accuracy, while decreasing the effect of those that do not. The new representation is a powerful approach to recognizing emotions. We investigate this by comparing against emotion recognition results from non-fused physiological signals. Both the fused and non-fused signals are used to train feedforward neural networks to recognize a range of emotion. We show that the fused method outperforms each individual signal across all emotions tested. We test the efficacy of the proposed approach on two publicly available datasets, namely BP4D+ and DEAP, showing state-of-the-art results on both. To the best of our knowledge this is the first work to present emotion recognition results using physiological signals on all subjects from BP4D+.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"88 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126196648","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
Generating robotic emotional body language with variational autoencoders 用变分自动编码器生成机器人情感肢体语言
Mina Marmpena, Angelica Lim, T. Dahl, Nikolas J. Hemion
{"title":"Generating robotic emotional body language with variational autoencoders","authors":"Mina Marmpena, Angelica Lim, T. Dahl, Nikolas J. Hemion","doi":"10.1109/ACII.2019.8925459","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925459","url":null,"abstract":"Humanoid robots in social environments can become more engaging by using their embodiment to display emotional body language. For such expressions to be effective in longterm interaction, they need to be characterized by variation and complexity, so that the robot can sustain the user's interest beyond the novelty effect period. Hand-coded, pose-to-pose robotic animations can be of high quality and interpretability, but the demanding process of creating them results in limited sets; therefore, after a while, the user will realize that the behavior is repetitive. This work proposes the application of deep learning methods, and more specifically the variational autoencoder framework, for generating numerous emotional body language animations for the Pepper robot, after being trained with a few examples of hand-coded animations. Interestingly, the latent space of the model exhibits topological features that can be used to modulate the amplitude of the motion; we propose that this can be potentially useful for generating animations of specific arousal according to the dimensional theory of emotion.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"97 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129856197","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
Automatic prediction of Depression and Anxiety from behaviour and personality attributes 从行为和人格属性自动预测抑郁和焦虑
S. Jaiswal, Siyang Song, M. Valstar
{"title":"Automatic prediction of Depression and Anxiety from behaviour and personality attributes","authors":"S. Jaiswal, Siyang Song, M. Valstar","doi":"10.1109/ACII.2019.8925456","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925456","url":null,"abstract":"Current vision based approaches for automatic prediction of mental health conditions like depression and anxiety, rely on models that use behavioural features (usually extracted from faces) only and do not take personality into account. However, there is a considerable amount of evidence that people with certain personality traits are more prone to depression and anxiety disorders. In order to exploit the underlying relationship between personality and these mental health conditions, we propose to use a combination of features consisting of observed facial behaviour and self-reported personality scores. This combination of features is employed for training deep neural networks for predicting depression and anxiety scores. The proposed method was evaluated on a new dataset consisting of personality scores and interview videos from a total of 55 people. The results show that the proposed combination of features significantly improves the prediction performance compared to using the behavioural features alone. This improvement in performance is shown for 2 different kinds of video feature extraction methods and 3 different kinds of interview questionnaires.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128957514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 31
Unintentional affective priming during labeling may bias labels 标签过程中无意识的情感启动可能会使标签产生偏差
J. Shen, Àgata Lapedriza, Rosalind W. Picard
{"title":"Unintentional affective priming during labeling may bias labels","authors":"J. Shen, Àgata Lapedriza, Rosalind W. Picard","doi":"10.1109/ACII.2019.8925466","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925466","url":null,"abstract":"Online platforms displaying long streams of examples are often employed to gather labels from both experts and crowd workers. While previous work in crowdsourcing focused on objective tasks and estimating error parameters of annotators, collecting labels in a subjective setting (e.g. emotion recognition) is more complicated due to different interpretations of examples. These interpretations could be influenced by many factors such as annotator mood and previously seen examples. In this work, we examine two hypotheses of order-dependent biases in sequential labeling tasks: negatively auto-correlated sequential decision making and positively auto-correlated affective priming. Using controlled generation of facial expressions, we find that i) annotators achieve higher agreement when presented examples in the same sequential order, ii) the valence label of the current image positively correlates with the previous labels given. While we also observe a positive correlation between labels and the number of preceding positive and negative images seen, this correlation is highly dependent on example ordering. Our findings demonstrate that randomized examples given to annotators may produce systematic bias in labels. Future data collection should present examples in orderings which mitigate such bias.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"94 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122650497","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Effect on Social Connectedness and Stress Levels by Using a Huggable Interface in Remote Communication 在远程通信中使用拥抱界面对社会联系和压力水平的影响
Eleuda Nuñez, Masakazu Hirokawa, Monica Perusquía-Hernández, Kenji Suzuki
{"title":"Effect on Social Connectedness and Stress Levels by Using a Huggable Interface in Remote Communication","authors":"Eleuda Nuñez, Masakazu Hirokawa, Monica Perusquía-Hernández, Kenji Suzuki","doi":"10.1109/ACII.2019.8925457","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925457","url":null,"abstract":"Affective communication technologies are designed to enhance awareness, social connectedness, and affectivity. Design strategies involve alternative methods to convey affection in computer-mediated scenarios, emphasizing on the importance of mediated physical contact. Therefore, we proposed a huggable interface to mediate social touch by sensing the user's hug gestures, transferring them to a paired device, and delivering them as simple cues. We investigated the effect of the huggable interface as a mediator with a physical embodiment and compared it with a similar communication interface represented by an agent with a virtual embodiment on a touch screen. During the experiments, we set up a scenario in which individuals with a close relationship watched movies and communicated with each other. Results showed the effect of both interfaces in terms of perceived social connectedness and stress levels. The discussion pointed out the potential and limitations of the proposed evaluation method, as well as of each type of interface as affective communication technology.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115146990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Protocol for Eliciting Driver Frustration in an In-vehicle Environment 在车内环境中引发驾驶员沮丧的协议
Ajjen Joshi, Youssef Attia, Taniya Mishra
{"title":"Protocol for Eliciting Driver Frustration in an In-vehicle Environment","authors":"Ajjen Joshi, Youssef Attia, Taniya Mishra","doi":"10.1109/ACII.2019.8925489","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925489","url":null,"abstract":"A state of frustration can impair a driver's ability to make decisions that optimize the safety of the driver as well as that of those around him or her. Equipping a car with the capability of detecting signs of driver frustration and responding with appropriate interventions can be an effective method to improve driver safety. In this paper, we first describe the design and implementation of a novel protocol used to elicit true frustration of varying intensities in participants interacting with an in-car Human Machine Interface (HMI) while driving in a simulator. We detail the instrumentation that was used to capture the participants' interactions with the HMI. We provide a computational analysis of signs of frustration displayed by participants in the facial and vocal modalities and discuss trends that were observed. Finally, we present baseline machine learning methods trained on features computed from facial and vocal modalities to predict the difficulty of the completed task and whether the participant is multitasking, validating the assumptions that informed our protocol design.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134090384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
You'll be Great: Virtual Agent-based Cognitive Restructuring to Reduce Public Speaking Anxiety 你会很棒:基于虚拟代理的认知重构减少公众演讲焦虑
Everlyne Kimani, T. Bickmore, H. Trinh, P. Pedrelli
{"title":"You'll be Great: Virtual Agent-based Cognitive Restructuring to Reduce Public Speaking Anxiety","authors":"Everlyne Kimani, T. Bickmore, H. Trinh, P. Pedrelli","doi":"10.1109/ACII.2019.8925438","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925438","url":null,"abstract":"Public speaking is an essential task for success in many careers, yet fear of public speaking makes this an undesirable activity for most people and negatively affects the quality of many presentations. Cognitive behavioral therapy is an effective tool for helping people overcome social anxieties disorders, including public speaking anxiety. However, most people do not engage in this therapy for public speaking anxiety, due to time constraints and other barriers. We present a virtual coach that uses cognitive behavioral therapy techniques to help presenters restructure irrational thoughts associated with public speaking anxiety. The design of the virtual coach was informed by an analysis of a corpus of cognitive restructuring examples generated by a clinical psychologist. In a between-subjects experiment comparing the virtual coach to a control condition, the virtual coach was shown to be significantly better at reducing thoughts associated with speech anxiety and improving a presentation experience for speakers.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"96 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115929996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 18
Annotation Matters: A Comprehensive Study on Recognizing Intended, Self-reported, and Observed Emotion Labels using Physiology 注释问题:使用生理学识别预期、自我报告和观察到的情绪标签的综合研究
Hao-Chun Yang, Chi-Chun Lee
{"title":"Annotation Matters: A Comprehensive Study on Recognizing Intended, Self-reported, and Observed Emotion Labels using Physiology","authors":"Hao-Chun Yang, Chi-Chun Lee","doi":"10.1109/ACII.2019.8925516","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925516","url":null,"abstract":"Studies have shown that the formation of emotion as self-awareness and cognitive appraisal process is complicated and can lead to idiosyncratic differences. Subject's self emotion evaluation process could be biased due to factors of environment, personal experience, and one's own cognitive ability, and the true affective state may be neglected (un-noticeable) due to an unconscious mental process. In this work, we present a comprehensive study to investigate the emotion recognition accuracy obtained using physiology with respect to different annotation schemes, i.e., intended, self-reported, and observed emotion labels. We found that when performing recognition across these three different labeling schemes using the same physiological parameters, the accuracy of the self-reported emotion labels results in about 10.3% and 3.1% drop when compared to two other annotation schemes. It indicates that self-assessed emotion labels may be noisier and induces a larger mismatch with respect to the affect-stimulated physiological responses. Further analysis shows that the electrodermal activity signal has the highest recognition rate with respect to the intended emotion of the stimuli. Finally, our error analysis reveals that there may exist a bias in the self-annotated label that is conditioned on the intended stimuli's valence polarity.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132579578","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
A TDRL Model for the Emotion of Regret 后悔情绪的TDRL模型
J. Broekens, L. Dai
{"title":"A TDRL Model for the Emotion of Regret","authors":"J. Broekens, L. Dai","doi":"10.1109/ACII.2019.8925441","DOIUrl":"https://doi.org/10.1109/ACII.2019.8925441","url":null,"abstract":"To better understand the nature, function and elicitation conditions of emotion it is important to approach studying emotion from a multidisciplinary perspective involving psychology, neuroscience and affective computing. Recently, the TDRL Theory of Emotion has been proposed. It defines emotions as variations of temporal difference assessments in reinforcement learning. In this paper we present new evidence for this theory. We show that regret - a negative emotion that signifies that an alternative action should have been taken given new outcome evidence - is modelled by a particular form of TD error assessment. In our model regret is attributed to each action in the state-action trace of an agent for which - after new reward evidence - an alternative action becomes the best action in that state (the new argmax) after adjusting the action value of the chosen action in that state. Regret intensity is modeled as the difference between this new best action and the adjusted old best action, reflecting the additional amount of return that could have been received should that alternative have been chose. We show in simulation experiments how regret varies depending on the amount of adjustment as well as the adjustment mechanism, i.e. Q-trace, Sarsa-trace, and Monte Carlo (MC) re-evaluation of action values. Our work shows plausible regret attribution to actions, when this model of regret is coupled with MC action value update. This is important evidence that regret can be seen as a particular variation of TD error assessment involving counterfactual thinking.","PeriodicalId":196007,"journal":{"name":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123529426","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书