Integration of a Gripper-Equipped Humanoid Social Robot for EEG-Monitored Action Observation Paradigms.

Abstract

Action Observation (AO) therapy leverages the mirror neuron system (MNS) and may support motor recovery in neurorehabilitation. In this study, we integrated Flo v2, a humanoid robot equipped with grippers and object detection system, into an AO therapy paradigm with electroencephalography (EEG) monitoring. Flo v2's enhanced design enables the execution of upper-limb actions, either transitive (involving object interaction such as grasping a cup) or intransitive (gesture-based without object manipulation such as waving). The robot control is synchronized with EEG recording to facilitate the investigation of cortical responses during AO tasks. We also conducted a case study to assess of the upgraded robot system's feasibility. Three healthy participants observed and imitated robot-performed actions, where the robot actor was in person or on videos. Exploratory analyses of EEG signals examined sensorimotor mu event-related desynchronization (ERD) during video-based and in-person AO tasks. Results indicated stronger responses during bimanual and transitive AO in the in-person settings. However, individual variability in cortical responses was evident, with one subject showing less pronounced ERD patterns, and that comparisons of mu ERDs across different types of action in video-based AO settings were inconsistent among subjects. Flo v2's enhancements demonstrated its feasibility as a tool for robot-mediated AOE therapy and highlighted potential for further neurorehabilitation research.