{"title":"Usability guidelines and evaluation criteria for conversational user interfaces: a heuristic and linguistic approach","authors":"Kyoko Sugisaki, Andreas Bleiker","doi":"10.1145/3404983.3405505","DOIUrl":"https://doi.org/10.1145/3404983.3405505","url":null,"abstract":"Even though conversational user interfaces (CUI) have been studied since the 1950s, it is not yet fully understood what makes them feel natural, intuitive and usable. As a result, their design and evaluation poses major challenges. In this paper, we discuss how CUIs are different from other forms of human computer interaction, and what challenges and opportunities arise from these differences. We provide an overview of relevant linguistic principles for a natural language conversation and look at established high-level usability heuristics to derive a set of 53 technology-agnostic checkpoints specifically for text-based CUIs (a.k.a chatbots). These checkpoints have been evaluated with 15 professionals and academics from the fields of User Experience, Natural Language Processing, Conversation Analysis and linguistics to examine content validity. The resulting list of checkpoints provides both guidelines for the design and criteria for the evaluation of chatbots.","PeriodicalId":298769,"journal":{"name":"Proceedings of Mensch und Computer 2020","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123478512","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Visualization of turnover rate in a warehouse using augmented reality: a demo with the Microsoft Hololens","authors":"Paula Bräuer, Athanasios Mazarakis","doi":"10.1145/3404983.3410422","DOIUrl":"https://doi.org/10.1145/3404983.3410422","url":null,"abstract":"In this submission, a new concept for the application of augmented reality in warehouse management is presented. The new tool offers the possibility to visualize the turnover rate of products in a warehouse and to optimize the location of products according to this key performance indicator. A prototype of the application was developed for the Microsoft HoloLens and subsequently implemented in a warehouse. The HoloLens is connected live to an ERP system, which is designed as a cloud application.","PeriodicalId":298769,"journal":{"name":"Proceedings of Mensch und Computer 2020","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127527649","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fabian Hemmert, Gina Lohkamp, Gürkan Orak, Alexander Salice
{"title":"Feeling scarcity: augmenting human feelings through physicalizations of energy consumption, attention depletion and animal murder","authors":"Fabian Hemmert, Gina Lohkamp, Gürkan Orak, Alexander Salice","doi":"10.1145/3404983.3409998","DOIUrl":"https://doi.org/10.1145/3404983.3409998","url":null,"abstract":"We describe the results of a design project about making scarce resources perceptible: a campfire-inspired lamp, a router, and a knife block. All three are `designed for discomfort' and intended to serve as thought-provoking objects.","PeriodicalId":298769,"journal":{"name":"Proceedings of Mensch und Computer 2020","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134310798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fabian Hemmert, Andreas Bell, Miriam Glöß, Maximilian Klaiß, Katharina Kurm, Ina van der Linde, Kathrin Neumann, Gürkan Orak, Katlin Sommer, Thanh Ta Dui, Paulina Wagner, Becky Weier, Michael Zalesak
{"title":"Designing human-god interfaces","authors":"Fabian Hemmert, Andreas Bell, Miriam Glöß, Maximilian Klaiß, Katharina Kurm, Ina van der Linde, Kathrin Neumann, Gürkan Orak, Katlin Sommer, Thanh Ta Dui, Paulina Wagner, Becky Weier, Michael Zalesak","doi":"10.1145/3404983.3409997","DOIUrl":"https://doi.org/10.1145/3404983.3409997","url":null,"abstract":"In this paper, we report the results from the `Human-God Interfaces' project, which aimed to redesign traditional Catholic rituals, based on the principles of Tangible Interaction. Seven prototypes are presented. We discuss our learnings from the design process, highlighting how all prototypes follow the same recipe of incorporating a Catholic belief into a well-known everyday object and adding an `unknowable' element.","PeriodicalId":298769,"journal":{"name":"Proceedings of Mensch und Computer 2020","volume":"97 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123538253","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"(Non-)Interacting with conversational agents: perceptions and motivations of using chatbots and voice assistants","authors":"Philip Weber, Thomas Ludwig","doi":"10.1145/3404983.3405513","DOIUrl":"https://doi.org/10.1145/3404983.3405513","url":null,"abstract":"Conversational agents (CAs) such as Siri, Alexa, and Google Assistant are increasingly penetrating everyday life. From a Human-Computer Interaction (HCI) perspective, designing CAs that appropriately support the way they are used within daily life is still challenging. While initial design guidelines for human-AI interaction exist, we still know little about how users actually perceive CAs within their daily lives and what aspects motivate their usage of such tools. Within our research, we therefore conducted an interview study with 29 participants to uncover daily positive and negative experiences with CAs. By revealing how users currently perceive CAs, we identify quality criteria that could inform their future design. By evaluating these criteria with respect to existing research discourses about user experience (UX) guidelines for CAs, we contribute to the field by extending these guidelines from an end-user's perspective.","PeriodicalId":298769,"journal":{"name":"Proceedings of Mensch und Computer 2020","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121546650","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A chatbot response generation system","authors":"Jasper Feine, Stefan Morana, A. Maedche","doi":"10.1145/3404983.3405508","DOIUrl":"https://doi.org/10.1145/3404983.3405508","url":null,"abstract":"Developing successful chatbots is a non-trivial endeavor. In particular, the creation of high-quality natural language responses for chatbots remains a challenging and time-consuming task that often depends on high-quality training data and deep domain knowledge. As a consequence, it is essential to engage experts in the chatbot response development process which have the required domain knowledge. However, current tool support to engage domain experts in the response generation process is limited and often does not go beyond the exchange of decoupled prototypes and spreadsheets. In this paper, we present a system that enables chatbot developers to efficiently engage domain experts in the chatbot response generation process. More specifically, we introduce the underlying architecture of a system that connects to existing chatbots via an API, provides two improvement mechanisms for domain experts to improve chatbot responses during their chatbot interaction, and helps chatbot developers to review the collected response improvements with a sentiment supported review dashboard. Overall, the design of the system and its improvement mechanisms are useful extensions for chatbot development systems in order to support chatbot developers and domain experts to collaboratively enhance the natural language responses of a chatbot.","PeriodicalId":298769,"journal":{"name":"Proceedings of Mensch und Computer 2020","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114603418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Speech-based interaction for map editing on mobile devices: a scenario-based study","authors":"Auriol Degbelo, Sulaxan Somaskantharajan","doi":"10.1145/3404983.3409996","DOIUrl":"https://doi.org/10.1145/3404983.3409996","url":null,"abstract":"Speech-based interfaces on mobile phones are growing in popularity, yet mostly limited to helping users retrieve information. There is an untapped potential for using speech to help users contribute new information. This work discusses opportunities and challenges of map editing on mobile devices. It also presents results from a study (N=20) that evaluated 11 speech-based commands for map data enriching and urban fault reporting on mobile devices. Feedback from the users indicated that speech-based information editing is feasible: usability was rated as `good', while user experience ratings produced slightly mitigated results.","PeriodicalId":298769,"journal":{"name":"Proceedings of Mensch und Computer 2020","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127802879","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alexander G. Mirnig, Magdalena Gärtner, Alexander Meschtscherjakov, M. Tscheligi
{"title":"Blinded by novelty: a reflection on participant curiosity and novelty in automated vehicle studies based on experiences from the field","authors":"Alexander G. Mirnig, Magdalena Gärtner, Alexander Meschtscherjakov, M. Tscheligi","doi":"10.1145/3404983.3405593","DOIUrl":"https://doi.org/10.1145/3404983.3405593","url":null,"abstract":"Interacting with a novel technology or a known technology in a novel context can influence a user's interaction with said technology in both a positive or negative way. Research is often primarily interested in capturing interaction under regular conditions, rendering such influences less desirable. Depending on the actual novelty of any given technology, such halo or novelty effects might be weaker or stronger, and thereby more difficult to mitigate. In this paper, we want to share a number of experiences related to participant curiosity and technology novelty in interaction with automated vehicles. We intend to use our experiences from several studies to open the discussion on a potential underestimation of technology novelty and its effects on user research in vehicle automation technology and want to particularly highlight the role, researchers, manufacturers, and media play in shaping such effects.","PeriodicalId":298769,"journal":{"name":"Proceedings of Mensch und Computer 2020","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122021229","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Eliciting tangible and gestural user interactions with and on a cooking pan","authors":"F. Beruscha, Katharina Mueller, Thorsten Sohnke","doi":"10.1145/3404983.3405516","DOIUrl":"https://doi.org/10.1145/3404983.3405516","url":null,"abstract":"Embedding computational capabilities in everyday objects enables novel interaction concepts that are seamlessly integrated in users' everyday tasks. We conducted an elicitation study to investigate how subjects use a pan to control functions related to cooking. The primary focus of the study was to identify whether the elicited proposals tend towards tangible (i.e. moving or rotating the pan) or gestural (i.e. tapping or swiping on the pan handle) interactions. We present an analysis of over 500 interaction proposals from 20 subjects. While priming and used pan handle did not affect the number or type of elicited interactions, we found statistically significant differences for different types of task. While pan interaction is suitable for controlling cook top temperature, subjects have a rejecting attitude towards using a pan to interact with the cooker hood or a digital cookbook. We derive recommendations for when and how to interact with a pan during the cooking process.","PeriodicalId":298769,"journal":{"name":"Proceedings of Mensch und Computer 2020","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117333289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"\"Miss understandable\": a study on how users appropriate voice assistants and deal with misunderstandings","authors":"Dominik Pins, A. Boden, Britta Essing, G. Stevens","doi":"10.1145/3404983.3405511","DOIUrl":"https://doi.org/10.1145/3404983.3405511","url":null,"abstract":"This study examines the appropriation and usage of voice assistants like Google Assistant or Amazon Alexa in private households. Our research is based on 10 in-depth interviews with users of voice assistants and a follow-up evaluation of their interaction histories. Our results illustrate situations in which the voice assistants were used at home, what strategies the users adopted to interact with them, how the interactions were performed, and what difficulties users experienced. A focus of our study is on misunderstandings, situations where interactions failed partially or completely. Our study shows that the full potential of voice assistants is often not utilized, as complex interactions are often subject to failures and users revert to simple use cases. Our participants used their voice assistant mostly for simple commands, often not even trying new functions. An analysis of their appropriation strategies resulted in implications for the design of supportive tools as well as the further development and optimization of voice interfaces.","PeriodicalId":298769,"journal":{"name":"Proceedings of Mensch und Computer 2020","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117138846","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}