Interaction in marker-less augmented reality based on hand detection using leap motion

Abstract

In this paper, a novel interaction framework for marker-less Augmented Reality is introduced. Model-based detection is one of the solutions for marker-less Augmented Reality. Instead of a marker, human hand is used as a distinctive object on which the augmented object placed. Leap Motion, a Virtual Reality (VR) hand tracking device, is used to detect the hand in our interaction framework for marker-less Augmented Reality. 3D hand position, gesture and direction can be obtained by using Leap Motion and passed to Unity 3d game engine. The main task for this framework is to calibrate the actual hand and the virtual hand generated by computer so that they can overlay each other. With the help of marker-less Augmented Reality Framework a user can experience intuitive interaction with virtual object and natural occlusion which will be the core functionality for next generation game, education, user interface and industrial.