TouchX — Mouse simulation using gestures on a virtual screen

Abstract

Vision based finger tracking is a constraint in the field of gesture recognition. Thus to overcome this constraint, the project implements a cost effective touch screen and reduce the issues of its maintainability and portability. This paper proposes an approach to mouse simulation using finger tracking on a virtual screen with the aid of color cameras. The finger is confined within a range of projection of the cameras. The system aims to reduce the hardware costs involved in the touch screen by eliminating the need of sensor and improve interactivity by integrating with skin color model. Due to real time recognition, items in the background or distinct features of the users do not hamper its efficiency.