Crystal Palace: Merging Virtual Objects and Physical Hand-held Tools

Abstract

We developed a mixed-reality approach, called Crystal Palace, which provides prop-based passive haptic feedback for the 3DUI contest. In this system, we propose an interface of controlling virtual object with physical tools such as scissors, a spray and a screwdriver as game controllers. Our prop-based approach provides natural visual affordance and passive haptics by associating physical tools with various 3D tasks. Using 360 degrees spherical display, players will be able to use common real-world tools in an intuitive way to interact with 3D objects in a virtual escape room.