Improving the learning experience for the deaf through augment reality innovations

Abstract

One challenge facing the deaf is the need to divide their attention between subject matter and sign language interpreters. Sign language interpreters provide a visual interpretation of speech. However, the observation of an interpreter distracts an individual from other visual stimuli such as a presentation, demonstration or video. This paper proposes an augmented reality, head-mounted display system designed to improve the learning experience for the deaf, specifically a child's experience in a planetarium. The system uses augmented reality to enable a sign language interpreter to remain within the wearer's vision. This improves on subtitle-based alternatives by removing literacy as a requirement. The project is part of a three-year development calibration between three Brigham Young University departments and Gallaudet University, with funding from the National Science Foundation. This paper focuses on the design, prototyping and proposed usability testing performed by a team of six IT students for a senior capstone project.