Interactive Image Projective Desktop and Screen Using Hand Tracking by Leap Motion

Abstract

Interactive display units have been used extensively in mobile phones and digital tablets. Their usage on a larger screen is still limited due to the higher costs. An alternative method is to use a projector to display on flat surfaces and use sensors to determine the interaction with the surface by the end-user. One such attempt was SAKSHAR IDVT (Interactive Desktop Varnamala Trainer), reported elsewhere, which used a laser range finder to detect a human touching a flat surface on which educational games were projected. The authors have replaced the expensive laser range finder with an inexpensive Leap Motion device in SAKSHAR and found it to be suitable for converting any non-touch display screen as a touch-based display. The calibration steps, the methodology and the results of the new SAKSHAR system have been reported in this paper. Also, a regular television (LCD) connected as a display unit from a computer is integrated with the Leap Motion device to make it an interactive screen using the hand tracking of the end-user. The methodology and the results of the survey conducted on a set of users on the usability of both systems are reported in this paper, which suggests their acceptance as interactive and intuitive devices.