Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI最新文献

Towards Enriching Responses with Crowd-sourced Knowledge for Task-oriented Dialogue 面向任务的对话，用众包知识丰富回应

Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI Pub Date : 2021-11-17 DOI: 10.1145/3475959.3485392

Ying He, Lizi Liao, Zheng Zhang, Tat-Seng Chua

{"title":"Towards Enriching Responses with Crowd-sourced Knowledge for Task-oriented Dialogue","authors":"Ying He, Lizi Liao, Zheng Zhang, Tat-Seng Chua","doi":"10.1145/3475959.3485392","DOIUrl":"https://doi.org/10.1145/3475959.3485392","url":null,"abstract":"Task-oriented dialogue agents are built to assist users in completing various tasks. Generating appropriate responses for satisfactory task completion is the ultimate goal. Hence, as a convenient and straightforward way, metrics such as success rate, inform rate etc., have been widely leveraged to evaluate the generated responses. However, beyond task completion, there are several other factors that largely affect user satisfaction, which remain under-explored. In this work, we focus on analyzing different agent behavior patterns that lead to higher user satisfaction scores. Based on the findings, we design a neural response generation model EnRG. It naturally combines the power of pre-trained GPT-2 in response semantic modeling and the merit of dual attention in making use of the external crowd-sourced knowledge. Equipped with two gates via explicit dialogue act modeling, it effectively controls the usage of external knowledge sources in the form of both text and image. We conduct extensive experiments. Both automatic and human evaluation results demonstrate that, beyond comparable task completion, our proposed method manages to generate responses gaining higher user satisfaction.","PeriodicalId":346594,"journal":{"name":"Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116802958","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 6

The Design of a Trust-based Game as a Conversational Component of Interactive Environment for a Human-agent Negotiation 基于信任的博弈作为人机协商交互环境中的会话组件的设计

Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI Pub Date : 2021-11-17 DOI: 10.1145/3475959.3485393

Andrey V. Vlasov, O. Zinchenko, Zhenjie Zhao, Mansur Bakaev, Arsenjy Karavaev

引用次数: 1

Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction 对人机交互中拟人化感知的实时测量

Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI Pub Date : 2021-11-17 DOI: 10.1145/3475959.3485394

Maria Tsfasman, Avinash Saravanan, Dekel Viner, Daan Goslinga, Sarah de Wolf, Chirag Raman, C. Jonker, Catharine Oertel

{"title":"Towards a Real-time Measure of the Perception of Anthropomorphism in Human-robot Interaction","authors":"Maria Tsfasman, Avinash Saravanan, Dekel Viner, Daan Goslinga, Sarah de Wolf, Chirag Raman, C. Jonker, Catharine Oertel","doi":"10.1145/3475959.3485394","DOIUrl":"https://doi.org/10.1145/3475959.3485394","url":null,"abstract":"How human-like do conversational robots need to look to enable long-term human-robot conversation? One essential aspect of long-term interaction is a human's ability to adapt to the varying degrees of a conversational partner's engagement and emotions. Prosodically, this can be achieved through (dis)entrainment. While speech-synthesis has been a limiting factor for many years, restrictions in this regard are increasingly mitigated. These advancements now emphasise the importance of studying the effect of robot embodiment on human entrainment. In this study, we conducted a between-subjects online human-robot interaction experiment in an educational use-case scenario where a tutor was either embodied through a human or a robot face. 43 English-speaking participants took part in the study for whom we analysed the degree of acoustic-prosodic entrainment to the human or robot face, respectively. We found that the degree of subjective and objective perception of anthropomorphism positively correlates with acoustic-prosodic entrainment.","PeriodicalId":346594,"journal":{"name":"Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI","volume":"134 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133865334","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

iFetch iFetch

Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI Pub Date : 2021-11-17 DOI: 10.1145/3475959.3485395

R. Sousa, Pedro Ferreira, P. Costa, Pedro Azevedo, João Costeira, Carlos Santiago, João Magalhães, David Semedo, Rafael Ferreira, Alexander I. Rudnicky, Alexander Hauptmann

引用次数: 4

Conversational AI Efforts within Facebook AI Applied Research Facebook AI应用研究中的会话AI努力

Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI Pub Date : 2021-11-17 DOI: 10.1145/3475959.3478678

A. Geramifard

引用次数: 0

Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI 第二届ACM多模态会话AI多媒体研讨会论文集

Proceedings of the 2nd ACM Multimedia Workshop on Multimodal Conversational AI Pub Date : 2021-11-17 DOI: 10.1145/3475959

引用次数: 0