A tangible user interface using spatial Augmented Reality

Abstract

In this paper, we describe the novel implementation of a tangible user interface framework, namely the MagicPad, inspired by the concept of Spatial Augmented Reality. By using an Infrared pen with any flat surface, such as a paper pad that receives projected images from a projector, a user is able to perform a variety of interactive visualization and manipulation in the 3D space. Two implementations using the MagicPad framework are presented, which include the magic lenses like interface inside a CAVE-like system and a virtual book in an art installation.