A depth camera-based system to enable touch-less interaction using hand gestures

Abstract

Touch-less interaction is an active area of research due to its numerous applications ranging from medical systems to gaming. In this paper we propose a novel interactive system based on RealSense camera to track the pose of hand and to recognize gestures. Our approach is based on MediaPipe model introduced by Google to detect the landmarks of the hand. The system utilizes the camera calibration information and user actions to get the geometry of the deployed environment, which shows high accuracy in measurement of hand position. The touch-less interaction is demonstrated using a graphical user interface for painting.