Dual-mode tongue drive system: using speech and tongue motion to improve computer access for people with disabilities

Abstract

In this paper, we are presenting a new wireless and wearable assistive technology called dual-mode Tongue Drive System (dTDS), which is designed to allow people with severe disabilities use computers more effectively with increased speed, flexibility, usability, and independence through their tongue motion and speech. The dTDS detects users' tongue motion using a magnetic tracer and an array of magnetic sensors embedded in a compact, ergonomic, and stylish wireless headset. It also captures users' voice wirelessly using a small microphone on the same headset in a highly integrated fashion. Preliminary evaluation results based on 14 able-bodied subjects indicate that the dTDS headset combined with a commercially available speech recognition software can provide end users with significantly higher performance than either unimodal forms based on tongue motion or speech alone, particularly in completing tasks that require both pointing and text entry.