Cursive:: controlling expressive avatar gesture using pen gesture

Abstract

We describe an interaction technique for expressive nonverbal communication through an avatar. The input consists of letters written with expressive modulation, by hand, using a pen tablet input device. This technique, which we call Cursive, translates an alphabetic letter into a body gesture. Our design is inspired by the observation that handwriting, like some kinds of human gesture, informs through the symbols it depicts, and through the manner in which the symbols are produced. The technique is especially suited for desktop and portable virtual reality applications--appli¿cations that do not use special rooms or equipment but only two-dimensional displays and simple pointing devices for interaction with the virtual environment. Our system solves the difficult prob¿lem of controlling the movements of a highly articulated, 3D ava¿tar using a common input device within the context of an office or other real world environment.