Caption support system for complementary dialogical information using see-through head mounted display

Abstract

The aim of this work is to provide dialogical information for hearing-impaired people. In this paper, we developed a portable caption support system consisting of a see-through head mounted display (HMD), a directional microphone array, and a speech recognition system. For users' convenience, the dialogical information of the person in the front was captioned as a result of the directional characteristic of the microphone array. With these interfaces, the proposed system would provide the complementary dialogical information.