iAR: an exploratory augmented reality system for mobile devices

Abstract

In this paper we propose an exploratory augmented reality(AR) system for mobile devices. A hybrid system of 3D object detection and 3D tracking is used to rapidly localize the object in the scene. Based on randomized tree classifier, object detection supports large viewpoint changes. While edge-based 3D tracking provides efficient computation and better accuracy for pose estimation of incremental motions. The result is an augmented reality system that works well with large viewpoint variance and has superior accuracy. Using a mobile device such as iPad or iPhone, our system further provides exploratory capability using their touch screen and wireless connectivity. The user is able to interact and explore the 3D object on the image or video, and collaborate with a remote user. Extensive experiments with different subjects demonstrate that the proposed system advances the state-of-the-art in augmented reality with novel and intuitive applications.