Everywhere Cursor: Extending Desktop Mouse Interaction into Spatial Augmented Reality: Extended Abstract

Abstract

Spatial augmented reality (SAR) allows us to extend desktop environments to our surroundings. However, previous works on enabling mouse interaction in SAR lacks consistent pointing behaviour with desktop environments. We present Everywhere Cursor, an indirect mouse interaction technique that moves along the environment’s surface geometry, which preserves mouse behaviour in desktop environments. We discuss fundamental design problems in extending desktop mouse interaction to SAR, implementation details of our system, and guidelines on future improvements. Our work provides an important step in the transition of desktop environments to a pervasive computing system.