"Twin Spin": steering karaoke (or anything else) with smartphone wands deployable as spinnable affordances

Abstract

We have built haptic interfaces featuring smartphones and tablets that use magnetometerderived orientation sensing to modulate virtual displays, especially spatial sound, allowing, for instance, each side of a karaoke recording to be separately steered around a periphonic display. Embedding such devices into a spinnable affordance allows a "spinning plate"- style interface, a novel interaction technique. Either static (pointing) or dynamic (spinning) modes can be used to control "whirled" multimodal display, including a rotary motion platform, panoramic movies, and the positions of avatars in virtual environments.