{"title":"Voicing Suggestions and Enabling Reflection: Results of an Expert Discussion on Proactive Assistants for Time Management","authors":"Jovan Jeromela, Owen Conlan","doi":"10.1145/3571884.3604317","DOIUrl":"https://doi.org/10.1145/3571884.3604317","url":null,"abstract":"While voice-controllable Intelligent Personal Assistants (IPAs) have become widespread in recent years, they remain primarily reactive with rather constrained calendaring capabilities. Anticipating more adaptive and complex assistants in the future, we organised a multidisciplinary expert discussion investigating potential use cases, interaction principles, and user modelling challenges within proactive IPAs for time management. This paper presents the identified themes and deliberations on enticing self-reflection, longitudinal task assistance, interaction modality, dialogue design, perception of the system, usage willingness, onboarding, and explainability. These findings outline a framework of advanced IPAs for time management.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122199397","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
V. Avanesi, Johanna Rockstroh, Thomas Mildner, Nima Zargham, Leon Reicherts, M. A. Friehs, Dimosthenis Kontogiorgos, Nina Wenig, R. Malaka
{"title":"From C-3PO to HAL: Opening The Discourse About The Dark Side of Multi-Modal Social Agents","authors":"V. Avanesi, Johanna Rockstroh, Thomas Mildner, Nima Zargham, Leon Reicherts, M. A. Friehs, Dimosthenis Kontogiorgos, Nina Wenig, R. Malaka","doi":"10.1145/3571884.3597441","DOIUrl":"https://doi.org/10.1145/3571884.3597441","url":null,"abstract":"The increasing prevalence of communicative agents raises questions about human-agent communication and the impact of such interaction on people’s behavior in society and human-human communication. This workshop aims to address three of those questions: (i) How can we identify malicious design strategies – known as dark patterns – in social agents?; (ii) What is the necessity for and the effects of present and future design features, across different modalities and social contexts, in social agents?; (iii) How can we incorporate the findings of the first two questions into the design of social agents? This workshop seeks to conjoin ongoing discourses of the CUI and wider HCI communities, including recent trends focusing on ethical designs. Out of the collaborative discussion, the workshop will produce a document distilling possible research lines and topics encouraging future collaborations.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129486076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Conversations with the News: Co-speculation into Conversational Interactions with News Content","authors":"Oda Elise Nordberg, Frode Guribye","doi":"10.1145/3571884.3597123","DOIUrl":"https://doi.org/10.1145/3571884.3597123","url":null,"abstract":"Conversational agents have limited conversational capabilities and there is a debate as to whether interactions with conversational user interfaces (CUIs) are truly conversational. Currently, most news and journalistic content is presented in a monologic form. Simultaneously, there is an expectation that CUIs can change how we interact with news content. To explore what conversational interactions with the news could look like, two co-speculation workshops were arranged. The design-led inquiries focus on how conversations can be used as a resource for designing interactions with CUIs for news. Three different prototyping techniques were used in the design explorations: storyboarding, scripting and role-playing. Our work offers two main contributions: 1) We identify three dimensions relevant to the design space of CUI for news: the CUIs’ role, conversational capabilities, and locus of control, and 2) a critical reflection on the potential of different techniques for prototyping CUIs.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"102 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122420514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Chatbots as Advisers: the Effects of Response Variability and Reply Suggestion Buttons","authors":"Federico Milana, E. Costanza, J. Fischer","doi":"10.1145/3571884.3597132","DOIUrl":"https://doi.org/10.1145/3571884.3597132","url":null,"abstract":"As chatbots gain popularity across a variety of applications, from investment to health, they employ an increasing number of features that can influence the perception of the system. Since chatbots often provide advice or guidance, we ask: do these aspects affect the user’s decision to follow their advice? We focus on two chatbot features that can influence user perception: 1) response variability in answers and delays and 2) reply suggestion buttons. We report on a between-subject study where participants made investment decisions on a simulated social trading platform by interacting with a chatbot providing advice. Performance-based study incentives made the consequences of following the advice tangible to participants. We measured how often and to what extent participants followed the chatbot’s advice compared to an alternative source of information. Results indicate that both response variability and reply suggestion buttons significantly increased the inclination to follow the advice of the chatbot.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114619136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Sarcar, Cosmin Munteanu, Jaisie Sin, Christina Wei, Sergio Sayago
{"title":"Designing Conversational User Interfaces for Older Adults","authors":"S. Sarcar, Cosmin Munteanu, Jaisie Sin, Christina Wei, Sergio Sayago","doi":"10.1145/3571884.3597438","DOIUrl":"https://doi.org/10.1145/3571884.3597438","url":null,"abstract":"We are concurrently witnessing two significant shifts: voice and chat-based conversational user interfaces (CUIs) are becoming ubiquitous, and older people are becoming a very large demographic group. However, despite the recent increase in research activity within fields such as CUI, older adults continue to be underrepresented as CUI users both in research and in the design of commercial products. Therefore, the overarching aim of this workshop is to increase the momentum for research that centers on older adults as CUI users. For this, we plan to create an interdisciplinary space that brings together researchers, designers, practitioners, and users, to discuss and share challenges, principles, and strategies for designing CUIs for the ageing population. We thus welcome contributions of empirical studies, theories, design, and evaluation of CUIs for older adults. Through this, we aim to grow the community of CUI researchers across disciplinary boundaries (human-computer interaction, voice and language technologies, geronto-technologies, information studies, etc.) that are engaged in the shared goal of ensuring that older adults are not marginalized or excluded from the design of CUIs.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117023464","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Programming by Voice: Exploring User Preferences and Speaking Styles","authors":"Sadia Nowrin, K. Vertanen","doi":"10.1145/3571884.3597130","DOIUrl":"https://doi.org/10.1145/3571884.3597130","url":null,"abstract":"Programming by voice is a potentially useful method for individuals with motor impairments. Spoken programs can be challenging for a standard speech recognizer with a language model trained on written text mined from sources such as web pages. Having an effective language model that captures the variability in spoken programs may be necessary for accurate recognition. In this work, we explore how novice and expert programmers speak code without requiring them to adhere to strict grammar rules. We investigate two approaches to collect data by having programmers speak either highlighted or missing lines of code. We observed that expert programmers spoke more naturally, while novice programmers spoke more syntactically. A commercial speech recognizer had a high error rate on our spoken programs. However, by adapting the recognizer’s language model with our spoken code transcripts, we were able to substantially reduce the error rate by 27% relative to the baseline on unseen spoken code.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134447564","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"“A Painless Way to Learn:” Designing an Interactive Storytelling Voice User Interface to Engage Older Adults in Informal Health Information Learning","authors":"Smit Desai, Morgan Lundy, Jessie Chin","doi":"10.1145/3571884.3597141","DOIUrl":"https://doi.org/10.1145/3571884.3597141","url":null,"abstract":"We present “Mystery Agent,” an interactive storytelling voice user interface (VUI) equipped with self-regulated learning strategies to deliver informal health-related learning to older adults through a murder mystery story. We conducted a mixed methods user study with 10 older adults to evaluate Mystery Agent, using usability and perception-based questionnaires, followed by a semi-structured interview and co-design activity to generate design insights and identify design priorities. We found older adults had a positive experience interacting with Mystery Agent and considered storytelling to be an appropriate and engaging way to learn health information. However, older adults identified credibility, compassion, and control as crucial factors influencing long-term use. To address this, we present design guidelines using Mystery Agent as an example to help practitioners and researchers devise novel solutions to address the informal health information learning needs of older adults.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"224 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127191434","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Heloisa Candello, Gabriel Meneguelli Soella, Cássia S. Sanctos, Marcelo Grave, Adinan Alves De Brito Filho
{"title":"\"This means nothing to me\": Building credibility in conversational systems","authors":"Heloisa Candello, Gabriel Meneguelli Soella, Cássia S. Sanctos, Marcelo Grave, Adinan Alves De Brito Filho","doi":"10.1145/3571884.3603759","DOIUrl":"https://doi.org/10.1145/3571884.3603759","url":null,"abstract":"Small business owners (SBOs) face several challenges when asking for microcredit loans from financial institutions. Usual difficulties include having low credit scores, unbanking situations, outstanding debts, informal employment situations, inability to showcase their payment capability, and lack of financial guarantor. Moreover, SBOs often find it hard to apply for microcredit loans due to bureaucracy, proof documents, and lack of information on how to proceed. For those reasons, banks and non-profit organizations have credit agents and advisors to give SBOs directions, and help them. Moreover, there are plenty of NGOs focused on financial education to teach the basics of business management and planning. The task of asking for a loan is a complex practice, and asymmetric power relationships might emerge from it, what does not benefit micro-entrepreneurs. In this provocation paper, we aim to investigate credibility as a value, and describe how a conversational system based on artificial intelligence might be employed to mitigate perceptions of mistrust, and occasionally, in trying to achieve that, inadvertently amplify those perceptions.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122138121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Risk and Harm: Unpacking Ideologies in the AI Discourse","authors":"G. Ferri, I. Gloerich","doi":"10.1145/3571884.3603751","DOIUrl":"https://doi.org/10.1145/3571884.3603751","url":null,"abstract":"We examine the ideological differences in the debate surrounding large language models (LLMs) and AI regulation, focusing on the contrasting positions of the Future of Life Institute (FLI) and the Distributed AI Research (DAIR) institute. The study employs a humanistic HCI methodology, applying narrative theory to HCI-related topics and analyzing the political differences between FLI and DAIR, as they are brought to bear on research on LLMs. Two conceptual lenses, “existential risk” and “ongoing harm,” are applied to reveal differing perspectives on AI's societal and cultural significance. Adopting a longtermist perspective, FLI prioritizes preventing existential risks, whereas DAIR emphasizes addressing ongoing harm and human rights violations. The analysis further discusses these organizations’ stances on risk priorities, AI regulation, and attribution of responsibility, ultimately revealing the diverse ideological underpinnings of the AI and LLMs debate. Our analysis highlights the need for more studies of longtermism's impact on vulnerable populations, and we urge HCI researchers to consider the subtle yet significant differences in the discourse on LLMs.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":"100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122693495","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Aylett, Andrea Carmantini, Chris Pidcock, Eric Nichols, Randy Gomez
{"title":"A Pilot Evaluation of a Conversational Listener for Conversational User Interfaces","authors":"M. Aylett, Andrea Carmantini, Chris Pidcock, Eric Nichols, Randy Gomez","doi":"10.1145/3571884.3605871","DOIUrl":"https://doi.org/10.1145/3571884.3605871","url":null,"abstract":"Current spoken conversational user interfaces (CUIs) are predominantly implemented using a sequential, utterance based, two-party, speak-wait/speak-wait approach. Human-human conversation 1) is not sequential, with overlap, interruption and back channels; 2) processes utterances before they are complete and 3) are often multi-party. As part of Honda Research Institute’s Haru project a light weight word spotting speech recognition system - A conversational listener - was implemented to allow very fast turn-taking in simple voice interaction conditions. In this paper, we present a pilot evaluation of the conversational listener in a script follower context (which allows a robot to act out a dialog with a user). We compare a disembodied version of the system with expressive synthesis to Alexa with and without fast turn-taking. Qualitative results indicate that users were sensitive to turn-taking delay and characterful speech synthesis.","PeriodicalId":127379,"journal":{"name":"Proceedings of the 5th International Conference on Conversational User Interfaces","volume":" 42","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113952292","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}