Robust gloves for 3D interaction in mobile outdoor AR environments

Abstract

This paper describes the design of hand-worn gloves for interacting with mobile outdoor augmented reality systems. Most existing systems rely on more traditional 2D input devices such as mice and keyboards. Since augmented reality information is typically registered in 3D to the environment, user interfaces need to be designed that are capable of supporting the more complex operations possible. This paper describes how we used metallic thread and adhesive fabric to add conduction sensing to a standard set of gloves which can survive harsh treatment; how Bluetooth and MSP430 microcontrollers are used to build a small circuit that is wireless and highly portable; and how AR-ToolKit is used for 3D tracking of fiducial markers on the thumbs. While we have previously demonstrated this technology with a number of our previous systems, this paper explains the various techniques we use in the implementation.