Empower VR Art and AR Book with Spatial Interaction

Abstract

In some circumstances it is necessary to allow the public to interact with AR or VR contents in physical space in an easy to use and low cost way, such as mark based AR book in classroom and interactive VR art or AR art in exhibition or museum in open space. The authors developed tangible user interface elements based on marker recognition. The user interface elements include virtual buttons, virtual rotate, and virtual hotspot. The user elements were integrated into various kinds of digital presentation systems by optimizing the logistic structure and interaction design of the user interface system to realize convenient spatial interactions. Thus, providing friendly user interaction and effective communication of information. Especially when interacting with art works, this interface could hide technology aspects and reduce the technology noise over art, and bring magical and amazing experience to users.