Batmen X The Puzzler - Escaping AR's Drawbacks with Augmented Virtuality and Low Cost Sensors

Abstract

We present an augmented virtuality system using low-cost or outdated devices as sensors, attached to tangible objects. Five interactions were implemented, featuring rotation, pressing, pulling, pushing and insertion movements, including passive mechanical resistance. Interactions were tied together by a puzzling narrative. Concerning storytelling, in contrast to AR, pure virtual reality offers unlimited visual possibilities and higher flexibility. Augmenting VR with physical objects allows ignoring most details of the physical environment and exploring ‘magical’ interactions. Precise registration was accomplished using wireless tracking system. The main challenge was the absent physical counterparts of the scenario, which was tackled by limiting user's reach to available interactions. Despite Leap Motion's erratic hand tracking, mouse and tablet sensors were precise enough and the augmented environment allowed a high sense of presence.