Jonas Keppel, Jonathan Liebers, Jonas Auda, Uwe Gruenefeld, Stefan Schneegass
{"title":"ExplAInable Pixels: Investigating One-Pixel Attacks on Deep Learning Models with Explainable Visualizations","authors":"Jonas Keppel, Jonathan Liebers, Jonas Auda, Uwe Gruenefeld, Stefan Schneegass","doi":"10.1145/3568444.3568469","DOIUrl":"https://doi.org/10.1145/3568444.3568469","url":null,"abstract":"Nowadays, deep learning models enable numerous safety-critical applications, such as biometric authentication, medical diagnosis support, and self-driving cars. However, previous studies have frequently demonstrated that these models are attackable through slight modifications of their inputs, so-called adversarial attacks. Hence, researchers proposed investigating examples of these attacks with explainable artificial intelligence to understand them better. In this line, we developed an expert tool to explore adversarial attacks and defenses against them. To demonstrate the capabilities of our visualization tool, we worked with the publicly available CIFAR-10 dataset and generated one-pixel attacks. After that, we conducted an online evaluation with 16 experts. We found that our tool is usable and practical, providing evidence that it can support understanding, explaining, and preventing adversarial examples.","PeriodicalId":310437,"journal":{"name":"Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128876575","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bernardo Marques, S. Silva, Paulo Dias, Beatriz Sousa-Santos
{"title":"Which notification is better? Comparing Visual, Audio and Tactile Cues for Asynchronous Mixed Reality (MR) Remote Collaboration: A User Study","authors":"Bernardo Marques, S. Silva, Paulo Dias, Beatriz Sousa-Santos","doi":"10.1145/3568444.3570587","DOIUrl":"https://doi.org/10.1145/3568444.3570587","url":null,"abstract":"Although Mixed Reality (MR) has been explored to support scenarios of remote collaboration, the majority of studies reported in literature have focused on synchronous use-cases, where all team-members can interact in real-time. Hence, an opportunity exist to explore asynchronous situations, in which collaborative actions take place at different times. Despite the physical distance and different time zones, remote experts can generate MR-instructions to assist with emerging problems, suggesting to on-site collaborators where to act, and what to do. This work explored three distinct notification methods for such scenarios: C1 - visual cue; C2 - audio cue; C3 - tactile cue, aiming to comprehend which one captures the attention of on-site team-members easily. A user study with 12 participants was conducted to evaluate these conditions during an asynchronous scenario of remote maintenance. We report participants insights, suggesting tactile cues represent the predominant condition given the scenario context.","PeriodicalId":310437,"journal":{"name":"Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia","volume":"78 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114260746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rafael Maio, Andreia Santos, Bernardo Marques, Duarte Almeida, Paulo Dias, Beatriz Sousa-Santos
{"title":"Pervasive Augmented Reality (AR) for Assistive Production: Comparing the use of a Head-Mounted Display (HMD) versus a Hand-Held Device (HHD)","authors":"Rafael Maio, Andreia Santos, Bernardo Marques, Duarte Almeida, Paulo Dias, Beatriz Sousa-Santos","doi":"10.1145/3568444.3570591","DOIUrl":"https://doi.org/10.1145/3568444.3570591","url":null,"abstract":"Pervasive Augmented Reality (AR) has been explored to provide experiences that are continuous in space and time, while incorporating layers of contextual information. While most research efforts have been devoted to explore serious games, museums and smart environments, we argue that another interesting area of application is assistive production, in particular training novel workers by displaying instructions throughout the shop floor on what to do. This work describes a user study with 12 participants, aimed at comparing the use of three distinct conditions: C1 - Head-Mounted Display (HMD), C2 - Handheld Device (HHD) and C3 - Paper manual during a set of realistic training tasks, selected based on a collaboration with partners from the industry sector. Results suggest condition C1 was preferred by the majority of participants, being considered more useful to support the worker’s task as it is seems more efficient, hands-free and has a better tracking technology.","PeriodicalId":310437,"journal":{"name":"Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132718231","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Joonas Moilanen, Aku Visuri, Sharadhi Alape Suryanarayana, Andy Alorwu, K. Yatani, S. Hosio
{"title":"Measuring the Effect of Mental Health Chatbot Personality on User Engagement","authors":"Joonas Moilanen, Aku Visuri, Sharadhi Alape Suryanarayana, Andy Alorwu, K. Yatani, S. Hosio","doi":"10.1145/3568444.3568464","DOIUrl":"https://doi.org/10.1145/3568444.3568464","url":null,"abstract":"Artificial Intelligence is seen as humanity’s current best bet to solve the looming crisis in healthcare. Conversational Agents, or chatbots, rely on advances in AI and are increasingly investigated in the context of digital mental health care. Given how they are end-user-facing and interactive communication tools, the user engagement felt when interacting with the bots is a critical consideration. In this work, we examine the effects of chatbot personalities on the experienced user engagement with the bot. We employed personalities that rely on the Big-5 Personality Theory. Among other findings, our quantitative results indicate that a highly conscientious chatbot is likely to foster the highest user engagement. Our qualitative and content analysis also reveals desired and undesired personality features for future mental health chatbots. We discuss our findings in light of digital mental health and propose novel research directions.","PeriodicalId":310437,"journal":{"name":"Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134032214","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Video Interaction on Tablet Computers: Browsing with Pinch Gesture and Pen Tilt","authors":"Diogo Cabral","doi":"10.1145/3568444.3570598","DOIUrl":"https://doi.org/10.1145/3568444.3570598","url":null,"abstract":"Digital video technologies have been changing dramatically in the field of media production but reduced the tangibility of working with film. One interesting approach to get back such tangibility in digital systems is using pen and touch interactions. Pen and touch interactions presented in tablet computers are natural and efficient. Pen additional data, like pressure and tilt, can be used for novel interactions. However, most of the previous research that combines pen and touch inputs discards such additional inputs and limits the interactions to Cartesian coordinates and is applied to data visualization or static media contexts. In this work, we have implemented a prototype running on a tablet that aims to facilitate video browsing through the combination of pinch gestures and pen tilt. It aims to provide more natural and tangible interactions to control dynamic media and, at the same time, promote novel interactions using familiar inputs.","PeriodicalId":310437,"journal":{"name":"Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125224085","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Radiah Rivu, Helena Bayerl, Pascal Knierim, Florian Alt
{"title":"‘Can you Set It Up On Your Own?’ – Investigating Users’ Ability To Participate in Remote-Based Virtual Reality Studies","authors":"Radiah Rivu, Helena Bayerl, Pascal Knierim, Florian Alt","doi":"10.1145/3568444.3568462","DOIUrl":"https://doi.org/10.1145/3568444.3568462","url":null,"abstract":"The availability of consumer-grade virtual reality (VR) devices allows user studies to be conducted remotely, that is in users’ homes. In this way, diverse populations can be reached and studies using virtual reality can be conducted in settings characterized by high ecologic validity. In this study (N=21) we investigate challenges participants face as they are required to set up and calibrate a virtual reality system in their home without assistance from experimenters. This allowed us to identify key reasons why participants struggle with this task. Our findings suggest that providing illustrative instructions and additional assistance on request can notably increase the success rate of setting up a VR environment for participating in a remote study. Interestingly, we also find that it is harder to recruit participants who do not have prior VR experience to participate in remote VR studies. We derive suggestions on how to support this task based on our findings.","PeriodicalId":310437,"journal":{"name":"Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129111324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
C. Hahne, Soňa Königsteinová, Andrea Farády, Robb Mitchell
{"title":"Move It Like Picasso: A Flexible Platform to Combine Movement, Drawing, and Communicative Play","authors":"C. Hahne, Soňa Königsteinová, Andrea Farády, Robb Mitchell","doi":"10.1145/3568444.3570584","DOIUrl":"https://doi.org/10.1145/3568444.3570584","url":null,"abstract":"Tangible and embodied explorations have delivered many designs to rejuvenate many traditional leisure activities such as parlor games, and dancing, and offered ideas on how to bridge inter-generational divides through play, and allow players of different skill levels to compete relatively equally. However there seem to be few examples of designs for non-competitive play which allow participants to take very different roles. Bringing together elements of playing with dance, communication, and drawing, we present the Move It Like Picasso platform. This facilitates a collaboration between a player trying to physically trace flickering lines from an animation which are unpredictably triggered by the second player’s bodily movements. We offer this as an example of how combining simple digital technologies and everyday physical materials may offer a route to rich social play experiences that might simultaneously appeal to a wide range of tastes.","PeriodicalId":310437,"journal":{"name":"Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127554419","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Matilda Kalving, Siiri Paananen, Juha Seppälä, Ashley Colley, Jonna Häkkilä
{"title":"Comparing VR and Desktop 360 Video Museum Tours","authors":"Matilda Kalving, Siiri Paananen, Juha Seppälä, Ashley Colley, Jonna Häkkilä","doi":"10.1145/3568444.3570596","DOIUrl":"https://doi.org/10.1145/3568444.3570596","url":null,"abstract":"We investigate the user experience of taking a remote museum tour with 360 video technologies. We compare the experience of viewing a 360 video feed on a laptop screen vs. a 360 virtual reality (VR) video experienced through a head-mounted display (HMD). Our salient findings from a user study (n = 10) highlight that HMD VR provides a better immersion and sense of control for users. However, the HMD VR user experience suffers from the lack of personal contact, such as eye contact with the guide, discontinuities in the visual presentation, and missing multimodal contextual cues. The research contributes to the design of remote tourism services.","PeriodicalId":310437,"journal":{"name":"Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114418323","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Okrasa, Mikołaj P. Woźniak, Anna Walczak, Natalia Bartłomiejczyk, Heiko Müller, K. Grudzień, A. Romanowski
{"title":"Supporting Self-development of Speech Delivery for Education Professionals","authors":"M. Okrasa, Mikołaj P. Woźniak, Anna Walczak, Natalia Bartłomiejczyk, Heiko Müller, K. Grudzień, A. Romanowski","doi":"10.1145/3568444.3570588","DOIUrl":"https://doi.org/10.1145/3568444.3570588","url":null,"abstract":"A rapid shift towards online education witnessed in recent years, re-shaped the necessary skill set of a modern teacher. Delivery of classes in remote and hybrid format became an integral part of education. However, providing feedback on lecturing technique at scale still remains a challenge. We present the design and implementation of Speecoach – an online tool for lecturers that analyses the audio recordings of lectures and provides feedback concerning their style of speech delivery. Our system analyses the pitch, speech rate and volume dynamics of a recording and compares it against the reference model based on a data set of professional-grade talks. Our tool facilitates teachers’ self-development by providing contextualised feedback on the parameters of their speech and comparing it to different forms of public addresses. Our work contributes a prototype tool facilitating public speaking and envisions future developments and studies in life-long learning of education professionals.","PeriodicalId":310437,"journal":{"name":"Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia","volume":"161 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122296894","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Faltaous, Mark Wittpoth, Yomna Abdelrahman, Stefan Schneegass
{"title":"HeatGoggles: Enabling Ubiquitous Touch Input through Head-Mounted Devices using Thermal Imaging","authors":"S. Faltaous, Mark Wittpoth, Yomna Abdelrahman, Stefan Schneegass","doi":"10.1145/3568444.3570597","DOIUrl":"https://doi.org/10.1145/3568444.3570597","url":null,"abstract":"Displays are a ubiquitous part of our everyday life. Digital, as well as paper-based displays, are used on various occasions to present us with different information. While users cannot interact with many of these displays yet, they could benefit from making them interactive. Research shows that thermal cameras can be exploited to make surfaces interactive by sensing touchpoints based on the heat signature and residue. However, most of the research done uses a stationary setup. This work proposes HeatGoggles, a wearable gadget detecting touch input on arbitrary surfaces using thermal imaging. We report on its design, prototypical implementation, and first evaluation. We show that it can be used on non-touch-enabled displays as well as other traditional information displays.","PeriodicalId":310437,"journal":{"name":"Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116732110","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}