Freehand Push-Gesture Recognition via 3D Palm Trajectory Modeling

Abstract

This paper aims at improving the recognition of 3D push-hand gesture, which can trigger a target selection command with our hands in the air. Although general 3D push-gesture recognizers have been developed and widely used for this purpose, a severe weakness of the current push-recognizers is that they are instable to askew-pushing problems that happen frequently in practice. It is because that the push trajectory of our hand is not always a straightforward movement due to the anatomy of human, but would vary depending on the location of the target relative to the users. We explore the 3D palm trajectories of push-gestures in different locations around the user, and propose a 3D push-gesture modeling approach by learning 3D palm trajectories to solve the askew-click problem. We evaluate the proposed recognizers on a click-gesture dataset, and compare it with the prior arts of forward-push recognizers. Experimental results demonstrate that our approach achieves higher recognition accuracies than existing approaches.