Augmented reality paper clay making based on hand gesture recognition

Abstract

We propose a gesture-based 3D modeling system, which allows the user to create and sculpt a 3D model with hand-gestures. The goal of our system is to provide a more intuitive 3D user interface than the traditional 2D ones such as mouse or touch pad. Inspired by how people make paper clay, a series of hand gestures are designed for interacting with the 3D object and their corresponding mesh processing functions are developed. Thus, the user can create a desired virtual 3D object just like paper clay making.