Design and Implementation of a Behavioral Sequence Framework for Human-robot Interaction Utilizing Brain-computer Interface and Haptic Feedback

Abstract

In assistive robotics, research in Brain-Computer-Interface aims to understand human intent with the goal to enhance Human-Robot-Interaction. In this research, a framework to enable a person with an upper limb disability to use an assistive system and maintain self-reliance is introduced and its implementation and evaluation are discussed. The framework interlinks functional components and establishes a behavioral sequence to operate the assistive system in three stages; action classification, verification, and execution. An action is classified based on identified human intent and verified through haptic and/or visual feedback before execution. The human intent is conveyed through facial expressions and verification through head movements. The interlinked functional components are an EEG sensing device, a head movement recorder, a dual-purpose glove, a visual feedback environment, and a robotic arm. The ability of the system to recognize a facial expression, time required to respond using head movements, convey information through vibrotactile feedback effects, and the ability to follow the established behavioral sequence are evaluated. Based on the evaluation, personalized training data set should be used to calibrate facial expression recognition and define the time required to respond during verification. Custom vibrotactile effects were effective in conveying system information to the user. Initial evaluation of the developed framework using three volunteers exhibited a 100% success rate in their ability to follow the behavioral sequence and control the system providing confidence to recruit more volunteers to identify and address improvements and expand the operational capability of the framework.