Handheld Device Design for Robotic Teleoperation based on Multi-Sensor Fusion

Precise leader-follower control is critical for teleop- eration. This paper designs and implements a low-cost leader device for unilateral teleoperation scenario. Monocular vision based on fiducial markers and MEMS Inertial Measurement Unit (IMU) are utilized to constitute the pose sensing system of the handheld device. To increase the positioning output frequency and deal with the motion blur of the fiducial markers, the IMU data and vision message are fused by an Error State Kalman Filter (ESKF). An assembly experiment was carried out to verify the effectiveness of the proposed device and the feasibility of the fusion algorithm.