Talking about what we think we see: natural language processing for a real-time virtual environment

Abstract

In this paper we discuss some aspects of our development of a natural language (NL) processing system to be used in a virtual reality (VR) environment. Our group is pursuing two lines of work: the Natural Language and Virtual Reality (NLVR) project and the natural language research program. The latter addresses basic research problems in NL processing and the former is an implementation project. The two are, in many ways, parallel and overlapping. The research generates hypotheses that we want to test and the NLVR testbed provides new problems for research.