Real-time update on the 3D head model texture

Abstract

In this paper, a real-time tracking/synthesis loop is proposed to animate the eye texture of a 3D head model by a camera performance. The user's eyes, captured by a video camera, are tracked by means of a frame-rate pupil detector technique, based on an active illumination scheme. A small area of interest is selected around each pupil detected in the video. These areas contain the eye and eyebrow features. Substituting the captured areas on the texture of the 3D model, the eyes and eyebrows animation is created. To avoid the 'collage' effect, the extracted areas are color-corrected, stretched and blended with the texture.