Finger-based gesture control of a collaborative online workspace

Abstract

A gesture-based human computer interface can make computers and devices easier to use, such as by allowing people to share photos by moving their hands through the air. Existing solutions have relied on exotic hardware, often involving elaborate setups limited to the research lab. Gesture recognition algorithms used so far are not practical or responsive enough for real-world use, partially due to the inadequate data on which the image processing is applied. Most importantly, existing solutions have lacked a workspace that allows users to perform common collaborative tasks by using their hands and fingers. In this paper, a new paradigm for next-generation computer interfaces is introduced. The method presented is based on a custom 3D camera that is easy to set up and has a flexible detection range. This method accurately detects hand gestures from depth data, allowing them to be used to control any application or device. The paper proposes the control of application windows and their content in collaborative online workspaces on which many teams cooperate to complete useful tasks, as shown with examples.