AR Pottery Wheel-Throwing by Attaching Omnidirectional Cameras to the Center of a User's Palms

Abstract

This research describes our system for AR pottery wheel-throwing employing an HMD and omnidirectional cameras each of which is attached to the center of a user's palm. The omnidirectional cameras enable the user's finger postures and the three-dimensional relative position and orientation between the user's hands and virtual clay model on the wheel to be estimated. Our system detects a marker on the desk and the wheel is set on its coordinate system along with the finger posture estimation in real time. The system then simulates the collision between the virtual clay model and the left/right hand model based on the above information. Pottery wheel-throwing is reproduced in Unity software environment by deforming the clay model by contact with hand models in this simulation.