Integrated virtual human interface system with portable virtual reality capability

Abstract

We demonstrate a photo-realistic, interactive virtual human agent application, called the Virtual Human Interface that employs virtual people to provide digital media users with information, learning services and entertainment in a highly personalized, visually rich virtual reality environment. The virtual digital human is capable of seeing, detecting and recognizing one or multiple people in front of the display and internally model, adapt to, and modulate the user’s mood and emotional state via advanced facial information processing techniques. Additional real-time modules include a portable head mounted VR system to enhance the experience and live imagery captured from a video source to support augmented reality applications.