Scope of human manipulability sharing with VR device and EMG sensor for online motion analysis

Abstract

The research described in this paper presents a new scope of human manipulability sharing (SoHMS) using a head-mounted VR system and wireless EMG sensor. An application of the new SoHMS is developed in the Unity platform so that a high-quality computer mannequin can be presented in a 3D virtual space. The computer mannequin is controlled through the motion data of a player, which is measured using a KINECT v2 sensor in real time. A set of manipulability ellipsoids for the measured human body form is attached at the hand(s) and/or foot(feet) of the computer mannequin. The new SoHMS can provide two sports-like motor tasks with the upper limbs, which were designed based on the manipulability theory, so that a player can study how manipulability can be regulated at will.