The user experience in industrial human-robot interaction: A comparative analysis of Unimodal and Multimodal interfaces for disassembly tasks

Abstract

In the Industry 5.0 context, ensuring effective Human-Robot Interaction (HRI) is key to supporting human involvement in production processes. Interfaces are the foundation of this collaboration and serve as vital communication channels which bridge the gap between users and robotic systems. This study compares unimodal and multimodal interfaces and their impact on user experience (UX) in an HRI context. Unimodal interfaces, while simplifying implementation, may restrict the richness of communication, while multimodal interfaces provide detailed and flexible interaction, enhancing the conveyance of complex information. However, designing effective multimodal interfaces presents challenges due to their inherent complexity in managing multiple modalities. This paper presents an HRI disassembly case study comparing the impact of these interfaces on the UX. A methodological approach was used to monitor operator performance, physiological responses, and perceptual responses. An electroencephalogram was employed to objectively record the operators’ emotional responses of operators without interrupting or hindering the process. Twenty participants (10 men and 10 women) were involved in the study. The results indicate that levels of memorization and mental workload are lower when using the multimodal interface, a finding consistent across men and women. These findings suggest that the multimodal interface is an appropriate choice, not only for reducing memorization and mental workload levels, but also for its inclusive approach. This aligns with the objectives of Industry 5.0, promoting the development of technology that meets diverse user preferences and abilities, thereby ensuring greater accessibility and a more user-centric technological landscape.