{"title":"Ah, Alright, Okay! Communicating Understanding in Conversational Product Search","authors":"A. Papenmeier, E. A. Topp","doi":"10.1145/3571884.3604318","DOIUrl":"https://doi.org/10.1145/3571884.3604318","url":null,"abstract":"When talking about products, people often express their needs in vague terms with vocabulary that does not necessarily overlap with product descriptions written by retailers. This poses a problem for chatbots in online shops, as the vagueness and vocabulary mismatch can lead to misunderstandings. In human-human communication, people intuitively build a common understanding throughout a conversation, e.g., via feedback loops. To inform the design of conversational product search systems, we investigated the effect of different feedback behaviors on users’ perception of a chatbot’s competence and conversational engagement. Our results show that rephrasing the user’s input to express what was understood increases conversational engagement and gives the impression of a competent chatbot. Using a generic feedback acknowledgment (e.g., “right” or “okay”), however, does not increase engagement or perceived competence. Auto-feedback for conversational product search systems therefore needs to be designed with care.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114547221","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
N. Braunschweiler, R. Doddipatla, Simon Keizer, Svetlana Stoyanchev
{"title":"Enabling Semi-Structured Knowledge Access via a Question-Answering Module in Task-oriented Dialogue Systems","authors":"N. Braunschweiler, R. Doddipatla, Simon Keizer, Svetlana Stoyanchev","doi":"10.1145/3571884.3597138","DOIUrl":"https://doi.org/10.1145/3571884.3597138","url":null,"abstract":"Users of task-oriented dialogue systems are often limited to ‘in-schema queries’, i.e., questions constrained by a predefined database structure. Providing access to additional semi- or unstructured knowledge could enable users to enter a wider range of queries answerable by the system. To this end, we have integrated a Question-Answering (QA)-module in an interactive restaurant search system and evaluated its impact using a crowd-sourced user evaluation. The QA-module includes knowledge selection and response generation components, both driven by fine-tuned GPT-2 language models, and a method to prevent responses unrelated to a user question (‘off-topic responses’). The results show that systems with QA-module are significantly preferred over the baseline without QA-module. Moreover, while the off-topic response prevention method was correctly triggered in 98.1% of questions not covered in the knowledge base, users showed more preference to the system that can retrieve information irrespective of whether it is relevant or not.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122048589","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Generative AI Considered Harmful","authors":"J. Fischer","doi":"10.1145/3571884.3603756","DOIUrl":"https://doi.org/10.1145/3571884.3603756","url":null,"abstract":"The recent months have seen an explosion of interest, hype, and concern about generative AI, driven by the release of ChatGPT. In this article I seek to explicate some potential and actual harms of the engineering and use of generative AI such as ChatGPT. With this I also suggest a reframing for researchers with an interest in interaction. With this reframing I seek to provoke researchers to consider studying the settings of ChatGPT development and use as active sites of production. Research should focus on the organisational, technological and interactional practices and contexts in and through which generative AI and its outputs—harmful and otherwise—are produced, by whom, to what end, and with what consequences on societies.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127890198","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Christina Ziying Wei, Young-Ho Kim, Anastasia Kuzminykh
{"title":"The Bot on Speaking Terms: The Effects of Conversation Architecture on Perceptions of Conversational Agents","authors":"Christina Ziying Wei, Young-Ho Kim, Anastasia Kuzminykh","doi":"10.1145/3571884.3597139","DOIUrl":"https://doi.org/10.1145/3571884.3597139","url":null,"abstract":"Conversational agents mimic natural conversation to interact with users. Since the effectiveness of interactions strongly depends on users’ perception of agents, it is crucial to design agents’ behaviors to provide the intended user perceptions. Research on human-agent and human-human communication suggests that speech specifics are associated with perceptions of communicating parties, but there is a lack of systematic understanding of how speech specifics of agents affect users’ perceptions. To address this gap, we present a framework outlining the relationships between elements of agents’ conversation architecture (dialog strategy, content affectiveness, content style and speech format) and aspects of users’ perception (interaction, ability, sociability and humanness). Synthesized based on literature reviewed from the domains of HCI, NLP and linguistics (n=57), this framework demonstrates both the identified relationships and the areas lacking empirical evidence. We discuss the implications of the framework for conversation design and highlight the inconsistencies with terminology and measurements.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132708539","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The User Experience of ChatGPT: Findings from a Questionnaire Study of Early Users","authors":"Marita Skjuve, Asbjørn Følstad, P. B. Brandtzaeg","doi":"10.1145/3571884.3597144","DOIUrl":"https://doi.org/10.1145/3571884.3597144","url":null,"abstract":"The launch of ChatGPT has attracted significant attention and showcased the potentially game-changing capabilities of conversational AI. These capabilities, and lack of user research, highlight the need to investigate how users experience interactions with conversational AIs like ChatGPT. Therefore, we conducted a questionnaire study with ChatGPT users (N=194), inquiring about their good and poor experiences with ChatGPT. The user reports were analyzed by a thematic analysis and systematized through a pragmatic-hedonic framework. Our results demonstrate how user experience is influenced by pragmatic attributes such as ChatGPT providing useful and detailed information and easing work- or school-related tasks. Additionally, user experience is impacted by hedonic attributes, such as entertainment and creative interactions, and interactions leaving the user impressed or surprised. Our study underscores that user experience concerning conversational AI like ChatGPT is assessed by useful and productive interactions even in early phase of uptake, suggesting the importance of pragmatic attributes.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"75 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124423387","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Annalena Aicher, Daniel Kornmüller, W. Minker, Stefan Ultes
{"title":"Self-imposed Filter Bubble Model for Argumentative Dialogues","authors":"Annalena Aicher, Daniel Kornmüller, W. Minker, Stefan Ultes","doi":"10.1145/3571884.3597131","DOIUrl":"https://doi.org/10.1145/3571884.3597131","url":null,"abstract":"During their information seeking people tend to filter out all the parts of the available information that do not fit their existing beliefs or opinions. In this paper we present a model for this “Self-imposed Filter Bubble” (SFB) consisting of four dimensions. Thereby, we aim to 1) estimate the probability of the user being caught in an SFB and consequently, 2) identify suitable clues to reduce this probability in the further course of a dialogue. Using an exemplary implementation in an argumentative dialogue system, we demonstrate the validity and applicability of this model in an online user study with 102 participants. These findings serve as a basis for developing a system strategy to break the user’s SFB and contribute to a sustainable and profound reflection on a topic from all viewpoints.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114953548","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Anna-Maria Meck, Marion Sardone, Jacqueline Cullmann
{"title":"Will the Assistant Become the Driver, and the Driver Become the Assistant?","authors":"Anna-Maria Meck, Marion Sardone, Jacqueline Cullmann","doi":"10.1145/3571884.3603753","DOIUrl":"https://doi.org/10.1145/3571884.3603753","url":null,"abstract":"Current conversational and hierarchical structures between Personal Assistants (PAs) and drivers are clearly and explicitly defined, in that users are either hierarchically superordinate or on par with their PAs. Simultaneously, technological advances around intelligence, personalization and proactivity have gained momentum in the most recent past. The exponential development of intelligence-based technologies will soon enable PAs to take over large parts of the driving process. PAs will convince drivers to trust in their capabilities, by explaining themselves and their decision-making processes. They will consider drivers’ knowledge, experience, and needs to transform interactions into deeply personal experiences. Furthermore, proactive PAs will provide context-sensitive content in adequate situations. These developments may just tip the scale and challenge currently valid PA-driver-relations. We envision roles to undergo a reversal: where conversations are now driven by users and assisted by assistants, intelligent, personalized, and proactive PAs will take over the lead and, figuratively, the driver seat.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"117 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117343127","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Houben, Nena van As, Nitin Sawhney, David Unbehaun, Minha Lee
{"title":"Participatory Design for Whom? Designing Conversational User Interfaces for Sensitive Settings and Vulnerable Populations","authors":"M. Houben, Nena van As, Nitin Sawhney, David Unbehaun, Minha Lee","doi":"10.1145/3571884.3597439","DOIUrl":"https://doi.org/10.1145/3571884.3597439","url":null,"abstract":"Conversational User Interfaces (CUIs) are becoming increasingly applied in a broad range of sensitive settings to address the needs and struggles of vulnerable or marginalized users. Sensitive settings include, for instance, CUIs mediating the communication difficulties of people with dementia or supporting refugees to cope with new cultural practices as a chatbot on a government website. While researchers are increasingly designing CUIs for such sensitive settings, methods and participatory design approaches to address vulnerable user groups’ highly sensitive needs and struggles are sparse in research thus far. This workshop aims to explore how we can design CUIs for and in sensitive settings with vulnerable users in mind through the participatory design process. We aim to establish a working definition of vulnerability, sensitive settings, and how practice-oriented design of CUIs can be inclusive of diverse users.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129157212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Trends, Challenges and Processes in Conversational Agent Design: Exploring Practitioners’ Views through Semi-Structured Interviews","authors":"M. Sadek, R. Calvo, C. Mougenot","doi":"10.1145/3571884.3597143","DOIUrl":"https://doi.org/10.1145/3571884.3597143","url":null,"abstract":"The aim of this study is to explore the challenges and experiences of conversational agent (CA) practitioners in order to highlight their practical needs and bring them into consideration within the scholarly sphere. A range of data scientists, conversational designers, executive managers and researchers shared their opinions and experiences through semi-structured interviews. They were asked about emerging trends, the challenges they face, and the design processes they follow when creating CAs. In terms of trends, findings included mixed feelings regarding no-code solutions and a desire for a separation of roles. The challenges mentioned included a lack of socio-technical tools and conversational archetypes. Finally, practitioners followed different design processes and did not use the design processes described in the academic literature. These findings were analyzed to establish links between practitioners’ insights and discussions in related literature. The goal of this analysis is to highlight research-practice gaps by synthesising five practitioner needs that are not currently being met. By highlighting these research-practice gaps and foregrounding the challenges and experiences of CA practitioners, we can begin to understand the extent to which emerging literature is influencing industrial settings and where more research is needed to better support CA practitioners in their work.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131951082","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Nima Zargham, V. Avanesi, Leon Reicherts, A. Scott, Yvonne Rogers, R. Malaka
{"title":"“Funny How?” A Serious Look at Humor in Conversational Agents","authors":"Nima Zargham, V. Avanesi, Leon Reicherts, A. Scott, Yvonne Rogers, R. Malaka","doi":"10.1145/3571884.3603761","DOIUrl":"https://doi.org/10.1145/3571884.3603761","url":null,"abstract":"Conversational agents are rapidly advancing in terms of their capabilities and human likeness - both of which are intended to enhance the user experience and engagement. One human quality that can potentially increase trust and likeability is humor. However, what is considered humorous and what is not depends on many contextual and personal factors that are not only difficult for machines to detect, but even humans are still struggling to understand them. This makes training AI to be humorous highly challenging. But is this due only to the technical limitations? In this provocation paper, we discuss the hindrances to utilizing humor in commercial conversational agents and propose addressing this topic from a social and political perspective.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"35 6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116598324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}