A robot visual servo-based approach to the determination of next best views

Abstract

In automatic 3D reconstruction, determining next best view (NBV) is the key problem for continuous automatic view planning. The mass vector chain (MVC) is one of the classical methods, but it can only determine the NBV direction. A visual servo-based approach is proposed in this paper for determining the orientation and direction of NBV. In the proposed approach, the 2-1/2-D visual servoing is used and modified in which MVC method is employed for orientation control and the image-based visual servoing is employed for position control. The MVC method is used in an open-loop, which decreases the dimensionality of the image Jacobian. The experimental results show that the proposed method can guide the robot to the desire views automatically. The final 3D reconstruction surface of an object is basically complete, only with a few tiny blind areas due to too many concave small surface patches of the object.