A survey of AR systems and a case study of virtual keyboard based camera projector system

Augmented reality is an interesting field which use live video imagery to add virtual data to the real world. In this paper, we firstly present a review of recent applications of augmented reality. One of the recent application of the augmented reality is the use of video projection to provide a more comfortable interaction with display devices without any hardware equipment. Thus, we secondly present a review of AR camera-projector based system and its main still open challenges. Visual understanding and image processing present a fundamental part which constitutes the easiest and most natural tool for interacting with a normal user in video projection system. One of the most important challenges is related to image interpretation and user fingertip tracking. In this context, we review the existing methods for hand segmentation, fingertip detection and contact surface detection. Finally, we consider a case study of virtual keyboard for user interface and smart environment. In this study, we propose a fingertip tracking system. We accordingly propose a hand segmentation approach based on new automated version of k-means. Experimental validation on real acquisitions is presented to illustrate the feasibility of the proposed system.