Robot grasp synthesis from virtual demonstration and topology-preserving environment reconstruction

Abstract

Automatic environment modeling is an essential requirement for intelligent robots to execute manipulation tasks. Object recognition and workspace reconstruction also enable 3D user interaction and programming of assembly operations. In this paper a novel method for synthesizing robot grasps from demonstration is presented. The system allows learning and classification of human grasps demonstrated in virtual reality as well as teaching of robot grasps and simulation of manipulation tasks. Both virtual grasp demonstration and grasp synthesis take advantage of a topology-preserving approach for automatic workspace modeling with a monocular camera. The method is based on the computation of edge-face graphs. The algorithm works in real-time and shows high scalability in the number of objects thus allowing accurate reconstruction and registration from multiple views. Grasp synthesis is performed mimicking the human hand pre-grasp motion with data smoothing. Experiments reported in the paper have tested the capabilities of both the vision algorithm and the grasp synthesizer.