{"title":"Dual variational generative model and auxiliary retrieval for empathetic response generation by conversational robot","authors":"Yahui Fu, Koji Inoue, Divesh Lala, Kenta Yamamoto, Chenhui Chu, Tatsuya Kawahara","doi":"10.1080/01691864.2023.2270577","DOIUrl":null,"url":null,"abstract":"Empathy in human-robot conversations aims to endow the robot with the ability to comprehend user emotion and experience, and then respond to it appropriately. Generally, empathy is embodied in the aspects of both contextual understanding and affective expression, which occur when there exist content and emotion consistencies between context and response. However, previous studies only focus on either aspect. In this paper, we propose a dual variational generative model (DVG) for empathetic response generation to achieve both. Specifically, we integrate an emotion classifier and a variational autoencoder (VAE) into a dual response and context generative model to learn the emotion and content consistencies efficiently. DVG utilizes VAE to mimic the process of context/response understanding. In addition to the generative model, our model can effectively switch to another retrieval system as a fallback solution. Automatic and human evaluations on Japanese and English EmpatheticDialogue datasets demonstrate the effectiveness of our method for empathetic response generation. Furthermore, we evaluate our model's ability in general response generation, which is not specific to empathetic but also chitchatting dialogue system. GRAPHICAL ABSTRACT","PeriodicalId":7261,"journal":{"name":"Advanced Robotics","volume":"5 1","pages":"0"},"PeriodicalIF":1.4000,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Robotics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/01691864.2023.2270577","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0
Abstract
Empathy in human-robot conversations aims to endow the robot with the ability to comprehend user emotion and experience, and then respond to it appropriately. Generally, empathy is embodied in the aspects of both contextual understanding and affective expression, which occur when there exist content and emotion consistencies between context and response. However, previous studies only focus on either aspect. In this paper, we propose a dual variational generative model (DVG) for empathetic response generation to achieve both. Specifically, we integrate an emotion classifier and a variational autoencoder (VAE) into a dual response and context generative model to learn the emotion and content consistencies efficiently. DVG utilizes VAE to mimic the process of context/response understanding. In addition to the generative model, our model can effectively switch to another retrieval system as a fallback solution. Automatic and human evaluations on Japanese and English EmpatheticDialogue datasets demonstrate the effectiveness of our method for empathetic response generation. Furthermore, we evaluate our model's ability in general response generation, which is not specific to empathetic but also chitchatting dialogue system. GRAPHICAL ABSTRACT
期刊介绍:
Advanced Robotics (AR) is the international journal of the Robotics Society of Japan and has a history of more than twenty years. It is an interdisciplinary journal which integrates publication of all aspects of research on robotics science and technology. Advanced Robotics publishes original research papers and survey papers from all over the world. Issues contain papers on analysis, theory, design, development, implementation and use of robots and robot technology. The journal covers both fundamental robotics and robotics related to applied fields such as service robotics, field robotics, medical robotics, rescue robotics, space robotics, underwater robotics, agriculture robotics, industrial robotics, and robots in emerging fields. It also covers aspects of social and managerial analysis and policy regarding robots.
Advanced Robotics (AR) is an international, ranked, peer-reviewed journal which publishes original research contributions to scientific knowledge.
All manuscript submissions are subject to initial appraisal by the Editor, and, if found suitable for further consideration, to peer review by independent, anonymous expert referees.