Vision Guided Manipulation by Learning from Demonstration

Most of the commonly used learning target detection algorithms require a large amount of data sets and time for training, and if the target has to be changed, the network needs to be retrained. In response to this problem, we aim to build a vision-based grasping system, which acquires target features through multi-angle demonstration, and can select an appropriate matching method according to the geometric shape of the target to detect more accurately. The method involves improved template matching, comparing the means of BGR channels and shape parameter with the features from demonstration. Our improvements to the template matching algorithm solve the shortcomings of its inability to recognize rotated targets. We also combine 2D recognition with 3D point clouds to obtain the grasping point. It has been verified by simulation experiments that our vision guided manipulation system can learn and extract the target features through a few demonstrations, and select an appropriate method to detect the target, the robotic arm performs manipulations such as grasping the target.