A new interaction method for augmented reality based on ARToolKit

Abstract

In this paper, we implement a new interaction method for the application of augmented reality using ARToolKit and OpenCV SDK. First, on the basis of the exiting marker-based tracking system, this paper achieved the multi-marker tracking that solved the tracking failure problem when the single marker is partially occluded, which greatly improves the robustness of the registration algorithm. In addition, Codebook-based foreground detection model is used to detect the hand region under an unexpected background environment. Moreover, we could recognize the hand gesture by convex hull on the basis of the hand contour. Therefore, a gesture recognition algorithm is presented based on codebook model algorithm and convex hull algorithm for the interaction. In the end, we use several different experiments to show the performance, which can be seen the good interactivity and realistic.