The VideoWriter: towards active paper for a natural user interface

Abstract

The VideoWriter is an investigation into applying a natural user interface to telewriting. It employs a computer-controlled video camera to capture images of the user's writing space: a desk with various pieces of paper. The images are processed to extract the written marks on the current page from the clutter of objects in the scene, including the user's moving hand and pen. The system compresses the extracted marks for transmission. The system is successful at extracting the marks as the user is writing and avoids digitizing most false marks. It incorporates update mechanisms that deal with false marks that do occur.