Proceedings of the ACM on Human-Computer Interaction最新文献_第3页

ViRgilites: Multilevel Feedforward for Multimodal Interaction in VR ViRgilites：虚拟现实中多模态交互的多级前馈

Proceedings of the ACM on Human-Computer Interaction Pub Date : 2024-06-17 DOI: 10.1145/3658645

Valentino Artizzu, Kris Luyten, Gustavo Rovelo Ruiz, L. D. Spano

引用次数: 0

A Systematic Process to Engineer Dependable Integration of Frame-based Input Devices in a Multimodal Input Chain: Application to Rehabilitation in Healthcare 将基于框架的输入设备可靠集成到多模态输入链中的系统工程流程：在医疗康复中的应用

Proceedings of the ACM on Human-Computer Interaction Pub Date : 2024-06-17 DOI: 10.1145/3664633

Axel Carayon, C. Martinie, Philippe Palanque, Eric Barboni, Sandra Steere

{"title":"A Systematic Process to Engineer Dependable Integration of Frame-based Input Devices in a Multimodal Input Chain: Application to Rehabilitation in Healthcare","authors":"Axel Carayon, C. Martinie, Philippe Palanque, Eric Barboni, Sandra Steere","doi":"10.1145/3664633","DOIUrl":"https://doi.org/10.1145/3664633","url":null,"abstract":"Designing new input devices and associated interaction techniques is a key contribution in order to increase the bandwidth between users and interactive applications. In the field of Human-Computer Interaction, research and development services in industry and research laboratories in universities have been, since the invention of the mouse and the graphical user interface, proposing multiple contributions including the integration of multiple input devices in multimodal interaction technique. Those contributions, most of the time, are presented as prototypes or demonstrators providing evidence of the bandwidth increase through user studies. Such contributions however, do not provide any support to software developers for integrating them in real-life systems. When done, this integration is performed in a craft manner, outside required software engineering good practice. This paper proposes a systematic process to integrate novel input devices and associated interaction techniques to better support users' work. It exploits most recent interactive systems architectural model and formal model-based approaches for interactive systems supporting verification and validation when required. The paper focusses on Frame-based input devices which support gesture-based interactions and movements recognition but also addresses their multimodal use. This engineering approach is demonstrated on an interactive application in the area of rehabilitation in healthcare where dependability of interactions and applications is as critical as their usability.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"12 36","pages":"1 - 31"},"PeriodicalIF":0.0,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141335099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

VR-based Competence Training at Scale: Teaching Clinical Skills in the Context of Virtual Brain Death Examination 基于虚拟现实的规模化能力培训：虚拟脑死亡检查背景下的临床技能教学

Proceedings of the ACM on Human-Computer Interaction Pub Date : 2024-06-17 DOI: 10.1145/3664635

Pascal Kockwelp, Marcel Meyerheim, Dimitar Valkov, Marvin Mergen, Anna Junga, Antonio Krüger, Bernhard Marschall, M. Holling, Benjamin Risse

{"title":"VR-based Competence Training at Scale: Teaching Clinical Skills in the Context of Virtual Brain Death Examination","authors":"Pascal Kockwelp, Marcel Meyerheim, Dimitar Valkov, Marvin Mergen, Anna Junga, Antonio Krüger, Bernhard Marschall, M. Holling, Benjamin Risse","doi":"10.1145/3664635","DOIUrl":"https://doi.org/10.1145/3664635","url":null,"abstract":"Teaching medical practical and soft skills in clinical routines is increasingly difficult, and manikin or actor-based simulations have gained popularity in the last decades. These simulations, however, hardly scale with the demand, are commonly insufficient to train crucial clinical competencies, and cannot portray complex visual and dynamic symptomatologies as required in, for example, brain death examinations. In this paper, we explore the requirements and challenges of integrating a large-scale high-throughput VR setup into a real medical curriculum and describe our approaches and implementation. Therefore we extend and evaluate an interactive virtual reality-based simulation for training brain death diagnostics in a virtual intensive care environment, featuring a fully reactive simulated patient. To enable the required scalability we integrated the simulation into a dedicated hardware and software framework, enabling 12 simultaneous VR trainings which are controlled by a centralized server system. Using this setup we continuously collected feedback on the application's usability and realism from hundreds of students to gain first insights into the applicability of large-scale VR-based learning systems in real course designs. After integrating this feedback, we conducted a controlled curricular study in which we compared the virtual brain death simulation with the classical manikin-based training approach. Our results indicate that the immersive learning experience is perceived to be more realistic and engaging and is overall preferred by the students while also providing the same learning effect as the alternatives.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"16 7","pages":"1 - 31"},"PeriodicalIF":0.0,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141334819","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Prototyping a Zoomorphic Interactive Robot Companion with Emotion Recognition and Affective Voice Interaction for Elderly People 为老年人设计具有情绪识别和情感语音交互功能的变形交互式机器人伴侣原型

Proceedings of the ACM on Human-Computer Interaction Pub Date : 2024-06-17 DOI: 10.1145/3660244

Benjamin Schnitzer, Umut Can Vural, Bastian Schnitzer, Muhammad Usman Sardar, Oren Fuerst, Oliver Korn

{"title":"Prototyping a Zoomorphic Interactive Robot Companion with Emotion Recognition and Affective Voice Interaction for Elderly People","authors":"Benjamin Schnitzer, Umut Can Vural, Bastian Schnitzer, Muhammad Usman Sardar, Oren Fuerst, Oliver Korn","doi":"10.1145/3660244","DOIUrl":"https://doi.org/10.1145/3660244","url":null,"abstract":"An aging society paired with a skilled labor shortage, particularly in European countries, requires a rethinking of deprecated structures. Intelligent assistive technologies, specifically socially assistive robots, addressing the gap between caretakers and elderly people in need of care have moved into the focus of debate due to their potentials to reduce costs, improve independence, and eventually raise quality of life. In this work, we outline the potentials of zoomorphic robot companions combining intelligent conversational abilities and emotion recognition. We then describe the prototyping of an emotion-sensing zoomorphic interactive robot companion including the development and implementation of a multimodal emotion recognition framework. This framework uses speech emotion recognition, sentiment analysis, and affective voice interaction based on a large language model. The prototyping has been accompanied by two studies on elderly peoples' design preferences regarding the proposed feature set as well as different embodiments to find the appropriate casing for the robot companion. This work provides valuable insights into the prototyping and can thus support future research endeavors in this area.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"2 1","pages":"1 - 32"},"PeriodicalIF":0.0,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141335027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

"They Don't Come With a Handbook": Exploring Design Opportunities for Supporting Parent-Child Interaction around Emotions in the Family Context. "他们没有附带手册"：探索在家庭背景下支持亲子情感互动的设计机会。

Proceedings of the ACM on Human-Computer Interaction Pub Date : 2024-04-26 DOI: 10.1145/3637409

Nikki Theofanopoulou, Alissa N Antle, Petr Slovak

引用次数: 0

It's About the Journey - Capturing Stories of the Fluctuating Experiences of Youth Kidney Transplant Patients.

Proceedings of the ACM on Human-Computer Interaction Pub Date : 2024-04-01 Epub Date: 2024-04-26 DOI: 10.1145/3653704

Julia C Dunbar, Wanda Pratt, Emily Bascom, Cara Currier, Joseph William Tan Garcia, Jodi Smith, Jaime Snyder, Ari H Pollack

{"title":"It's About the Journey - Capturing Stories of the Fluctuating Experiences of Youth Kidney Transplant Patients.","authors":"Julia C Dunbar, Wanda Pratt, Emily Bascom, Cara Currier, Joseph William Tan Garcia, Jodi Smith, Jaime Snyder, Ari H Pollack","doi":"10.1145/3653704","DOIUrl":"10.1145/3653704","url":null,"abstract":"Youth who undergo a kidney transplant can experience a fluctuation of successes and challenges throughout their chronic illness journey. Designing to capture their journey could help youth to reflect on their experiences, collaborate on their care, and be empowered to live their lives to the fullest. We interviewed 11 youth kidney transplant patients and 12 caregivers to elicit their transplant journey experiences. We found that probing participants about specific parts of their transplant journey gave them structure to tell us rich stories about their experiences. Based on our findings, we discuss informing the design of a tool to support the capturing of stories for youth with chronic illnesses. Designing such tool could help youth and their caregivers to identify barriers, support reflection, and promote self-efficacy. Youth with chronic illnesses already have to change so many aspects of their lives to accommodate their illness, however, by giving them a platform to capture their chronic illness journey, it could encourage them to take more control of their lives and better collaborate with others.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"8 CSCW1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11824542/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143415447","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Sustaining the Usefulness and Appeal of an Older Adult-led Makerspace through Developing and Adapting Resources. 通过开发和调整资源，保持老年人主导的创客空间的实用性和吸引力。

Proceedings of the ACM on Human-Computer Interaction Pub Date : 2024-01-01

Ruipu Hu, Alisha Pradhan, Elizabeth Bonsignore, Amanda Lazar

{"title":"Sustaining the Usefulness and Appeal of an Older Adult-led Makerspace through Developing and Adapting Resources.","authors":"Ruipu Hu, Alisha Pradhan, Elizabeth Bonsignore, Amanda Lazar","doi":"","DOIUrl":"","url":null,"abstract":"Researchers are studying makerspaces as one way to support older adults in learning about and using new technologies and tools. In this paper, through a long-term (34 months), ethnographic approach, we study the ways that older adults arranged sociotechnical resources to sustain the community use of a makerspace. Our analysis identifies three interconnected resources that were developed: an adaptive staffing approach that could withstand constant personnel shifts and shortages; structured activities to draw interest and overcome challenges associated with learning to use the machines; and reference materials to support individuals in independent usage of the space. We describe the issues that arose as time went on with each of these resource types, and how individuals affiliated with the makerspace adapted the resources to address these issues. In the discussion, we extend best practices by reflecting on strategies that worked well in the makerspace, such as drawing interest through introductory classes, as well as different purposes for reference materials to support technology use.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"8 ","pages":"1-29"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11404555/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142297496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Hum-ble Beginnings: Developing Touch- and Proximity-Input-Based Interfaces for Zoo-Housed Giraffes’ Audio Enrichment 卑微的开端:开发触摸和接近输入为基础的界面，动物园饲养长颈鹿的音频丰富

Proceedings of the ACM on Human-Computer Interaction Pub Date : 2023-10-31 DOI: 10.1145/3626470

Alana Grant, Vilma Kankaanpää, Ilyena Hirskyj-Douglas

{"title":"Hum-ble Beginnings: Developing Touch- and Proximity-Input-Based Interfaces for Zoo-Housed Giraffes’ Audio Enrichment","authors":"Alana Grant, Vilma Kankaanpää, Ilyena Hirskyj-Douglas","doi":"10.1145/3626470","DOIUrl":"https://doi.org/10.1145/3626470","url":null,"abstract":"Though computer systems have entered widespread use for animals' enrichment in zoos, no interactive computer systems suited to giraffes have yet been developed. Hence, which input modes or audio stimuli giraffes might best utilise remains unknown. To address this issue and probe development of such systems alongside the animals themselves and zookeepers, researchers gathered requirements from the keepers and from prototyping with giraffes, then created two interfaces -- one touch-based and one proximity-based -- that play giraffe-humming audio or white noise when activated. Over two months of observation, giraffes utilised the proximity-based system more frequently than the touch-based one but in shorter episodes. Secondly, the study highlighted the significance of considering user-specific needs in computer systems' development: the lack of preference shown for any specific audio type indicates that the audio stimuli chosen were inappropriate for these giraffes. In addition, the paper articulates several lessons that can be drawn from human--computer interaction when one develops systems for animals and, in turn, what the findings presented mean for humans.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135930039","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Cross-Domain Gesture Sequence Recognition for Two-Player Exergames using COTS mmWave Radar 基于COTS毫米波雷达的双人游戏跨域手势序列识别

Proceedings of the ACM on Human-Computer Interaction Pub Date : 2023-10-31 DOI: 10.1145/3626477

Ahsan Jamal Akbar, Zhiyao Sheng, Qian Zhang, Dong Wang

{"title":"Cross-Domain Gesture Sequence Recognition for Two-Player Exergames using COTS mmWave Radar","authors":"Ahsan Jamal Akbar, Zhiyao Sheng, Qian Zhang, Dong Wang","doi":"10.1145/3626477","DOIUrl":"https://doi.org/10.1145/3626477","url":null,"abstract":"Wireless-based gesture recognition provides an effective input method for exergames. However, previous works in wireless-based gesture recognition systems mainly recognize one primary user's gestures. In the multi-player scenario, the mutual interference between users makes it difficult to predict multiple players' gestures individually. To address this challenge, we propose a flexible FMCW-radar-based system, RFDual, which enables real-time cross-domain gesture sequence recognition for two players. To eliminate the mutual interference between users, we extract a new feature type, biased range-velocity spectrum (BRVS), which only depends on a target user. We then propose customized preprocessing methods (cropping and stationary component removal) to produce environment-independent and position-independent inputs. To enhance RFDual's resistance to unseen users and articulating speeds, we design effective data augmentation methods, sequence concatenating, and randomizing. RFDual is evaluated with a dataset containing only unseen gesture sequences and achieves a gesture error rate of 1.41%. Extensive experimental results show the impressive robustness of RFDual for data in new domains, including new users, articulating speeds, positions, and environments. These results demonstrate the great potential of RFDual in practical applications like two-player exergames and gesture/activity recognition for drivers and passengers in the cab.","PeriodicalId":36902,"journal":{"name":"Proceedings of the ACM on Human-Computer Interaction","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135928380","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

SeatmateVR: Proxemic Cues for Close Bystander-Awareness in Virtual Reality SeatmateVR:虚拟现实中近距离旁观者意识的邻近线索

Proceedings of the ACM on Human-Computer Interaction Pub Date : 2023-10-31 DOI: 10.1145/3626474

Jingyi Li, Hyerim Park, Robin Welsch, Sven Mayer, Andreas Butz

引用次数: 0