Mutual hand representation for telexistence robots using projected virtual hands

Abstract

In this paper, a mutual body representation for Telexistence Robots that does not have physical arms were discussed. We propose a method of projecting user's hands as a virtual superimposition that not only the user sees through a HMD, but also to the remote participants by projecting virtual hands images into the remote environment with a small projector aligned with robot's eyes. These virtual hands are produced by capturing user's hands from the first point of view (FPV), and then segmented from the background. This method expands the physical body representation of the user, and allows mutual body communication between the user and remote participants while providing a better understanding user's hand motion and intended interactions in the remote place.