Valentino Artizzu, Kris Luyten, Gustavo Rovelo Ruiz, L. D. Spano
{"title":"ViRgilites: Multilevel Feedforward for Multimodal Interaction in VR","authors":"Valentino Artizzu, Kris Luyten, Gustavo Rovelo Ruiz, L. D. Spano","doi":"10.1145/3658645","DOIUrl":"https://doi.org/10.1145/3658645","url":null,"abstract":"Navigating the interaction landscape of Virtual Reality (VR) and Augmented Reality (AR) presents significant complexities due to the plethora of available input hardware and interaction modalities, compounded by spatially diverse visual interfaces. Such complexities elevate the likelihood of user errors, necessitating frequent backtracking. To address this, we introduce ViRgilites, a virtual guidance framework that delivers multi-level feedforward information covering the available interaction techniques as well as the future possibilities to interact with virtual objects, anticipating the interaction effects and how they fit with the overall user's goal. ViRgilites is engineered to facilitate task execution, empowering users to make informed decisions about action methodologies and alternative courses of action. This paper presents the architecture and functionality of ViRgilites and demonstrates its efficacy through evaluation with a formative user study.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"9 1","pages":"1 - 24"},"PeriodicalIF":0.0,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141335064","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Axel Carayon, C. Martinie, Philippe Palanque, Eric Barboni, Sandra Steere
{"title":"A Systematic Process to Engineer Dependable Integration of Frame-based Input Devices in a Multimodal Input Chain: Application to Rehabilitation in Healthcare","authors":"Axel Carayon, C. Martinie, Philippe Palanque, Eric Barboni, Sandra Steere","doi":"10.1145/3664633","DOIUrl":"https://doi.org/10.1145/3664633","url":null,"abstract":"Designing new input devices and associated interaction techniques is a key contribution in order to increase the bandwidth between users and interactive applications. In the field of Human-Computer Interaction, research and development services in industry and research laboratories in universities have been, since the invention of the mouse and the graphical user interface, proposing multiple contributions including the integration of multiple input devices in multimodal interaction technique. Those contributions, most of the time, are presented as prototypes or demonstrators providing evidence of the bandwidth increase through user studies. Such contributions however, do not provide any support to software developers for integrating them in real-life systems. When done, this integration is performed in a craft manner, outside required software engineering good practice. This paper proposes a systematic process to integrate novel input devices and associated interaction techniques to better support users' work. It exploits most recent interactive systems architectural model and formal model-based approaches for interactive systems supporting verification and validation when required. The paper focusses on Frame-based input devices which support gesture-based interactions and movements recognition but also addresses their multimodal use. This engineering approach is demonstrated on an interactive application in the area of rehabilitation in healthcare where dependability of interactions and applications is as critical as their usability.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"12 36","pages":"1 - 31"},"PeriodicalIF":0.0,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141335099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pascal Kockwelp, Marcel Meyerheim, Dimitar Valkov, Marvin Mergen, Anna Junga, Antonio Krüger, Bernhard Marschall, M. Holling, Benjamin Risse
{"title":"VR-based Competence Training at Scale: Teaching Clinical Skills in the Context of Virtual Brain Death Examination","authors":"Pascal Kockwelp, Marcel Meyerheim, Dimitar Valkov, Marvin Mergen, Anna Junga, Antonio Krüger, Bernhard Marschall, M. Holling, Benjamin Risse","doi":"10.1145/3664635","DOIUrl":"https://doi.org/10.1145/3664635","url":null,"abstract":"Teaching medical practical and soft skills in clinical routines is increasingly difficult, and manikin or actor-based simulations have gained popularity in the last decades. These simulations, however, hardly scale with the demand, are commonly insufficient to train crucial clinical competencies, and cannot portray complex visual and dynamic symptomatologies as required in, for example, brain death examinations. In this paper, we explore the requirements and challenges of integrating a large-scale high-throughput VR setup into a real medical curriculum and describe our approaches and implementation. Therefore we extend and evaluate an interactive virtual reality-based simulation for training brain death diagnostics in a virtual intensive care environment, featuring a fully reactive simulated patient. To enable the required scalability we integrated the simulation into a dedicated hardware and software framework, enabling 12 simultaneous VR trainings which are controlled by a centralized server system. Using this setup we continuously collected feedback on the application's usability and realism from hundreds of students to gain first insights into the applicability of large-scale VR-based learning systems in real course designs. After integrating this feedback, we conducted a controlled curricular study in which we compared the virtual brain death simulation with the classical manikin-based training approach. Our results indicate that the immersive learning experience is perceived to be more realistic and engaging and is overall preferred by the students while also providing the same learning effect as the alternatives.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"16 7","pages":"1 - 31"},"PeriodicalIF":0.0,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141334819","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Benjamin Schnitzer, Umut Can Vural, Bastian Schnitzer, Muhammad Usman Sardar, Oren Fuerst, Oliver Korn
{"title":"Prototyping a Zoomorphic Interactive Robot Companion with Emotion Recognition and Affective Voice Interaction for Elderly People","authors":"Benjamin Schnitzer, Umut Can Vural, Bastian Schnitzer, Muhammad Usman Sardar, Oren Fuerst, Oliver Korn","doi":"10.1145/3660244","DOIUrl":"https://doi.org/10.1145/3660244","url":null,"abstract":"An aging society paired with a skilled labor shortage, particularly in European countries, requires a rethinking of deprecated structures. Intelligent assistive technologies, specifically socially assistive robots, addressing the gap between caretakers and elderly people in need of care have moved into the focus of debate due to their potentials to reduce costs, improve independence, and eventually raise quality of life. In this work, we outline the potentials of zoomorphic robot companions combining intelligent conversational abilities and emotion recognition. We then describe the prototyping of an emotion-sensing zoomorphic interactive robot companion including the development and implementation of a multimodal emotion recognition framework. This framework uses speech emotion recognition, sentiment analysis, and affective voice interaction based on a large language model. The prototyping has been accompanied by two studies on elderly peoples' design preferences regarding the proposed feature set as well as different embodiments to find the appropriate casing for the robot companion. This work provides valuable insights into the prototyping and can thus support future research endeavors in this area.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"2 1","pages":"1 - 32"},"PeriodicalIF":0.0,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141335027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"\"They Don't Come With a Handbook\": Exploring Design Opportunities for Supporting Parent-Child Interaction around Emotions in the Family Context.","authors":"Nikki Theofanopoulou, Alissa N Antle, Petr Slovak","doi":"10.1145/3637409","DOIUrl":"10.1145/3637409","url":null,"abstract":"<p><p>Parenting practices have a profound effect on children's well-being and are a core target of several psychological interventions for child mental health. However, there is only limited understanding in HCI so far about how to design socio-technical systems that could support positive shifts in parent-child social practices in situ. This paper focuses on parental socialisation of emotion as an exemplar context in which to explore this question. We present a two-step study, combining theory-driven identification of plausible design directions with co-design workshops with 22 parents of children aged 6-10 years. Our data suggest the potential for technology-enabled systems that aim to facilitate positive changes in parent-child social practices in situ, and highlight a number of plausible design directions to explore in future work.</p>","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"8 ","pages":"132"},"PeriodicalIF":0.0,"publicationDate":"2024-04-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7616238/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141627952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Michael Madaio, Jingya Chen, Hanna Wallach, Jennifer Wortman Vaughan
{"title":"Tinker, Tailor, Configure, Customize: The Articulation Work of Contextualizing an AI Fairness Checklist","authors":"Michael Madaio, Jingya Chen, Hanna Wallach, Jennifer Wortman Vaughan","doi":"10.1145/3653705","DOIUrl":"https://doi.org/10.1145/3653705","url":null,"abstract":"Many responsible AI resources, such as toolkits, playbooks, and checklists, have been developed to support AI practitioners in identifying, measuring, and mitigating potential fairness-related harms. These resources are often designed to be general purpose in order to be applicable to a variety of use cases, domains, and deployment contexts. However, this can lead to decontextualization, where such resources lack the level of relevance or specificity needed to use them. To understand how AI practitioners might contextualize one such resource, an AI fairness checklist, for their particular use cases, domains, and deployment contexts, we conducted a retrospective contextual inquiry with 13 AI practitioners from seven organizations. We identify how contextualizing this checklist introduces new forms of work for AI practitioners and other stakeholders, as well as opening up new sites for negotiation and contestation of values in AI. We also identify how the contextualization process may help AI practitioners develop a shared language around AI fairness, and we identify tensions related to ownership over this process that suggest larger issues of accountability in responsible AI work.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"8 CSCW1","pages":"1-20"},"PeriodicalIF":0.0,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147905517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Emotion Work in Caregiving: The Role of Technology to Support Informal Caregivers of Persons Living With Dementia","authors":"Diva Smriti, Lu Wang, Jina Huh","doi":"10.1145/3637325","DOIUrl":"https://doi.org/10.1145/3637325","url":null,"abstract":"The CSCW and HCI community has increasingly examined ways to support informal caregivers through technology, given the increasing burden and its consequences on caregivers' emotional and physical health. In this paper, we interviewed 12 informal caregivers of Persons Living With Dementia (PLWD) to understand their needs and current coping strategies for overcoming caregiving burden, specifically around emotion work. The caregivers associated different personal meanings with caregiving. Participants wanted technology to take over some of the utilitarian, mundane caregiving tasks. At the same time, they did not want technology to take over the tasks that fostered personal connections with PLWD. As the disease progressed, caregivers started to lose their perceived bond with PLWD, making it more challenging to juggle between rewarding, positive emotions with negative experiences. We discuss such complexity of emotion work using the notion of Invisible Work to understand when technology should or should not support the emotion work engaged in informal caregiving.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"8 CSCW1","pages":"1-34"},"PeriodicalIF":0.0,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147881778","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Who Should Act? Distancing and Vulnerability in Technology Practitioners' Accounts of Ethical Responsibility","authors":"Kristina Popova, Clàudia Figueras, Kristina Höök, Airi Lampinen","doi":"10.1145/3637434","DOIUrl":"https://doi.org/10.1145/3637434","url":null,"abstract":"Attending to emotion can shed light on why recognizing an ethical issue and taking responsibility for it can be so demanding. To examine emotions related to taking or not taking responsibility for ethical action, we conducted a semi-structured interview study with 23 individuals working in interaction design and developing AI systems in Scandinavian countries. Through a thematic analysis of how participants attribute ethical responsibility, we identify three ethical stances, that is, discursive approaches to answering the question 'who should act': an individualised I-stance (\"the responsibility is mine\"), a collective we-stance (\"the responsibility is ours\"), and a distanced they-stance (\"the responsibility is someone else's\"). Further, we introduce the concepts of distancing and vulnerability to analyze the emotion work that these three ethical stances place on technology practitioners in situations of low- and high-scale technology development, where they have more or less control over the outcomes of their work. We show how the we- and they-stances let technology practitioners distance themselves from the results of their activity, while the I-stance makes them more vulnerable to emotional and material risks. By illustrating the emotional dimensions involved in recognizing ethical issues and embracing responsibility, our study contributes to the field of Ethics in Practice. We argue that emotions play a pivotal role in technology practitioners' decision-making process, influencing their choices to either take action or refrain from doing so.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"8 CSCW1","pages":"1-27"},"PeriodicalIF":0.0,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://dl.acm.org/doi/pdf/10.1145/3637434","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147916079","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Julia C Dunbar, Wanda Pratt, Emily Bascom, Cara Currier, Joseph William Tan Garcia, Jodi Smith, Jaime Snyder, Ari H Pollack
{"title":"It's About the Journey - Capturing Stories of the Fluctuating Experiences of Youth Kidney Transplant Patients.","authors":"Julia C Dunbar, Wanda Pratt, Emily Bascom, Cara Currier, Joseph William Tan Garcia, Jodi Smith, Jaime Snyder, Ari H Pollack","doi":"10.1145/3653704","DOIUrl":"10.1145/3653704","url":null,"abstract":"<p><p>Youth who undergo a kidney transplant can experience a fluctuation of successes and challenges throughout their chronic illness journey. Designing to capture their journey could help youth to reflect on their experiences, collaborate on their care, and be empowered to live their lives to the fullest. We interviewed 11 youth kidney transplant patients and 12 caregivers to elicit their transplant journey experiences. We found that probing participants about specific parts of their transplant journey gave them structure to tell us rich stories about their experiences. Based on our findings, we discuss informing the design of a tool to support the capturing of stories for youth with chronic illnesses. Designing such tool could help youth and their caregivers to identify barriers, support reflection, and promote self-efficacy. Youth with chronic illnesses already have to change so many aspects of their lives to accommodate their illness, however, by giving them a platform to capture their chronic illness journey, it could encourage them to take more control of their lives and better collaborate with others.</p>","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"8 CSCW1","pages":""},"PeriodicalIF":4.9,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11824542/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143415447","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ruipu Hu, Alisha Pradhan, Elizabeth Bonsignore, Amanda Lazar
{"title":"Sustaining the Usefulness and Appeal of an Older Adult-led Makerspace through Developing and Adapting Resources.","authors":"Ruipu Hu, Alisha Pradhan, Elizabeth Bonsignore, Amanda Lazar","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Researchers are studying makerspaces as one way to support older adults in learning about and using new technologies and tools. In this paper, through a long-term (34 months), ethnographic approach, we study the ways that older adults arranged sociotechnical resources to sustain the community use of a makerspace. Our analysis identifies three interconnected resources that were developed: an adaptive staffing approach that could withstand constant personnel shifts and shortages; structured activities to draw interest and overcome challenges associated with learning to use the machines; and reference materials to support individuals in independent usage of the space. We describe the issues that arose as time went on with each of these resource types, and how individuals affiliated with the makerspace adapted the resources to address these issues. In the discussion, we extend best practices by reflecting on strategies that worked well in the makerspace, such as drawing interest through introductory classes, as well as different purposes for reference materials to support technology use.</p>","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"8 ","pages":"1-29"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11404555/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142297496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}