Fabrécio Barth, Heloisa Candello, P. Cavalin, Claudio S. Pinhanez
{"title":"Intentions, Meanings, and Whys: Designing Content for Voice-based Conversational Museum Guides","authors":"Fabrécio Barth, Heloisa Candello, P. Cavalin, Claudio S. Pinhanez","doi":"10.1145/3405755.3406128","DOIUrl":"https://doi.org/10.1145/3405755.3406128","url":null,"abstract":"If an artwork could talk, what would visitors ask? This paper explores what types of content voice-based AI conversational systems should have to attend visitors' expectations in a museum. The study analyses 142,463 conversation logs from 5,242 unique sessions of a nine-month long deployment of a voice-based interactive guide in a modern art museum in Brazil. In this experiment, visitors freely asked questions about seven different artworks of different styles. By grouping the visitor utterances into eight types of content, we determined that more than half of the visitors asked about the meanings and intentions behind the artwork, followed by facts about the artwork and author-related questions. We also determined that the types of questions were not affected by each artwork, the artwork style, or its physical location. We also saw some relationships between the visitor's overall evaluation of the experience with the types of questions she asked. Based on those results, we identified implications for designing content for voice-based conversational systems in museums.","PeriodicalId":380130,"journal":{"name":"Proceedings of the 2nd Conference on Conversational User Interfaces","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128092575","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Teresa Castle-Green, S. Reeves, J. Fischer, B. Koleva
{"title":"Decision Trees as Sociotechnical Objects in Chatbot Design","authors":"Teresa Castle-Green, S. Reeves, J. Fischer, B. Koleva","doi":"10.1145/3405755.3406133","DOIUrl":"https://doi.org/10.1145/3405755.3406133","url":null,"abstract":"Designers of dialogue-driven systems and 'conversational' agents like chatbots face huge complexities, both in the rich meanings of language and its sophisticated sequential organisation. To this end designers are starting to work out what it means to treat 'conversation' as a design material. But the elephant in the room is that for the most part, the key way of managing the complexities of chatbot design is the decision tree, or some variant of this. Yet decision trees have received little scrutiny as sociotechnical objects which both provide purchase for---but also simultaneously significantly restrict---design practice. CUI research needs to ramp up its concern for various assumptions built into chatbot design processes, and the various stakeholders which may be at play.","PeriodicalId":380130,"journal":{"name":"Proceedings of the 2nd Conference on Conversational User Interfaces","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132599877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Tired of Wake Words?: Moving Towards Seamless Conversations with Intelligent Personal Assistants","authors":"Shashank Ahire, M. Rohs","doi":"10.1145/3405755.3406141","DOIUrl":"https://doi.org/10.1145/3405755.3406141","url":null,"abstract":"In this paper, we aim to draw attention towards wake words. Wake words are an integral part of every request addressed to Intelligent Personal Assistants (IPAs). Currently, a request made to an IPA is led by wake words, making a conversation with an IPA more tiresome than a conversation with a human being. The main question we pose in this paper is, whether we can eliminate the use of wake words at least in specific contexts. Based on our experience with IPAs we propose three less burdensome alternatives that avoid the need for speaking wake words in some cases. Based on these approaches we discuss how to design seamless conversations with IPAs.","PeriodicalId":380130,"journal":{"name":"Proceedings of the 2nd Conference on Conversational User Interfaces","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131343859","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"HCI Research Challenges for the Next Generation of Conversational Systems","authors":"Claudio S. Pinhanez","doi":"10.1145/3405755.3406153","DOIUrl":"https://doi.org/10.1145/3405755.3406153","url":null,"abstract":"As we move past from the deployment of the first conversational systems, a new generation is shaping up with interaction patterns beyond the question and answer paradigms of today. The next wave is likely to include systems with clearly defined personalities, nuanced and emotional speech, and contexts with multiple bots and users. We propose here that a new set of design and interface challenges will rise in the context of those upcoming systems. Among them, we address five challenges which we believe are going to become relevant for the next generation of conversation systems: handling human-machine pidgins, managing language precision, creating and conveying personality, knowing when to speak, and creating the illusion of a mind.","PeriodicalId":380130,"journal":{"name":"Proceedings of the 2nd Conference on Conversational User Interfaces","volume":"29 9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125695309","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Lord of the (speaking) Rings: An interdisciplinary Fellowship to deal with 7 legal issues","authors":"Gianluigi M. Riva, Marguerite Barry","doi":"10.1145/3405755.3406132","DOIUrl":"https://doi.org/10.1145/3405755.3406132","url":null,"abstract":"One smart speaker to rule them all, one sensor to find them, one device to bring them all and in the Internet of Things bind them. Conversational User Interfaces (CUI) represent an interactive phenomenon that is disrupting social interactions as we knew them. The spectrum of legal issues that arises from these user-device relationships has a wide range of impacts on society. This paper addresses seven legal issues arising from these interactions that affect Privacy and Law concerning consumer protection, profiling, liability, security, neutrality, influence and data protection. It aims to prompt an interdisciplinary discussion between Human-Computer Interaction, legal and Privacy researchers in order to address the lack of regulation around aspects of CUI and stimulate legal, policy and design confrontations.","PeriodicalId":380130,"journal":{"name":"Proceedings of the 2nd Conference on Conversational User Interfaces","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125090136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alexandre Arnold, Gérard Dupont, Catherine Kobus, François Lancelot, Ying-Hsang Liu
{"title":"Perceived Usefulness of Conversational Agents Predicts Search Performance in Aerospace Domain","authors":"Alexandre Arnold, Gérard Dupont, Catherine Kobus, François Lancelot, Ying-Hsang Liu","doi":"10.1145/3405755.3406172","DOIUrl":"https://doi.org/10.1145/3405755.3406172","url":null,"abstract":"This paper presents a user-centered approach to the design and evaluation of conversational search user interfaces to support the pilot in cockpits. Our findings of a controlled user experiment suggest that user perception of the usefulness of the system in completing the search task and the system's responses to the relevance of the topic are good predictors of search performance. User satisfaction with the system's responses may not be a good predictor of search performance in the context of safety of life scenarios such as cockpit procedures for pilots.","PeriodicalId":380130,"journal":{"name":"Proceedings of the 2nd Conference on Conversational User Interfaces","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122346337","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fermin Chavez-Sanchez, Gloria Adriana Mendoza Franco, Gloria Angelica Martínez de la Peña, E. Carrillo
{"title":"Beyond What is Said: Looking for Foundational Principles in VUI Design","authors":"Fermin Chavez-Sanchez, Gloria Adriana Mendoza Franco, Gloria Angelica Martínez de la Peña, E. Carrillo","doi":"10.1145/3405755.3406145","DOIUrl":"https://doi.org/10.1145/3405755.3406145","url":null,"abstract":"As the field of Voice User Interface design continues to grow, more usability issues are found, and efforts made to solve them. We argue that what the field lacks is foundational principles beyond the reach of said efforts, and that the availability of those principles could be closer than we think. If we were to look at interactive sound design overall, could we unlock the potentials of the field by going beyond the current conversational design? Expanding the design scope to include more nonverbal and paralinguistic elements could bring untold developments to the field.","PeriodicalId":380130,"journal":{"name":"Proceedings of the 2nd Conference on Conversational User Interfaces","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134291311","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abraham Glasser, Vaishnavi Mande, Matt Huenerfauth
{"title":"Accessibility for Deaf and Hard of Hearing Users: Sign Language Conversational User Interfaces","authors":"Abraham Glasser, Vaishnavi Mande, Matt Huenerfauth","doi":"10.1145/3405755.3406158","DOIUrl":"https://doi.org/10.1145/3405755.3406158","url":null,"abstract":"With the proliferation of voice-based conversational user interfaces (CUIs) comes accessibility barriers for Deaf and Hard of Hearing (DHH) users. There has not been significant prior research on sign-language conversational interactions with technology. In this paper, we motivate research on this topic and identify open questions and challenges in this space, including DHH users' interests in this technology, the types of commands they may use, and the open design questions in how to structure the conversational interaction in this sign-language modality. We also describe our current research methods for addressing these questions, including how we engage with the DHH community","PeriodicalId":380130,"journal":{"name":"Proceedings of the 2nd Conference on Conversational User Interfaces","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127921121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Reporting Assistant for Railway Security Staff","authors":"Linglong Meng, Stefan Schaffer","doi":"10.1145/3405755.3406164","DOIUrl":"https://doi.org/10.1145/3405755.3406164","url":null,"abstract":"In this paper, we introduce RARSS, a reporting assistant for railway security staff. RARSS is a demonstration application with a multi-modal interface based on the Mobile Multimodal Interaction and Rendering (MMIR) framework. The system should support the security staff at railway premises (stations, trains, etc.) in Germany and inform about security relevant information about the travel of football fans or a group of people on their way to a major event. In the application we leverage multi keyword spotting (KWS) for detecting of the actual context and a grammar with specific voice commands to improve the semantic interpretation. The results of friendly user testing showed that the multimodal conversational interface was positively rated according the simplicity and the efficiency to make security reports by the security staff.","PeriodicalId":380130,"journal":{"name":"Proceedings of the 2nd Conference on Conversational User Interfaces","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128285078","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ernestine Dickhaut, Laura Friederike Thies, Andreas Janson, A. Roßnagel, J. Leimeister
{"title":"Towards a New Methodology to Capture the Legal Compatibility of Conversational Speech Agents","authors":"Ernestine Dickhaut, Laura Friederike Thies, Andreas Janson, A. Roßnagel, J. Leimeister","doi":"10.1145/3405755.3406160","DOIUrl":"https://doi.org/10.1145/3405755.3406160","url":null,"abstract":"Higher legal standards with regards to the data protection of individuals such as the EU General Data Protection Regulation (EU-GDPR) are increasing the pressure on developers of IT artifacts. This is especially prevalent when considering conversational speech agents (CSA), which are collecting data in new ways and thus are oftentimes producing conflicts with existing law regulations. For this purpose, we introduce the law simulation method, which is a well-known evaluation method among law researchers for capturing the legal compatibility of IT artifacts such as CSA. With this rigorous method, we are able to derive actionable guidance for CSA developers to evaluate developer efforts for increasing legal compatibility. To illustrate our methodological approach, we describe in this paper key steps of the method with respect to the evaluation of CSA. We briefly discuss how this procedure can serve as the foundation for a new evaluation method of legally compatible systems in information systems.","PeriodicalId":380130,"journal":{"name":"Proceedings of the 2nd Conference on Conversational User Interfaces","volume":"107 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124145462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}