Generating a population of animated faces from pictures

Abstract

This paper describes a simple and robust method for generating photo-realistic animated face population in a virtual world. First we make a small set of 3D-virtual faces just using photo data, using a method so called virtual cloning. Then we use very intuitive 3D-morphing system to generate a new population, which is profited from 3D-structure of existing virtual faces. The virtual cloning method uses a set of orthogonal pictures of a person. This efficient method for reconstructing 3D heads suitable for animation starts with the extraction of feature points from the orthogonal picture sets. A previously constructed, animation-ready generic model is transformed to each individualized head based on the features extracted from the orthogonal pictures. Using projections of the 3D head, a 2D texture image is obtained for an individual reconstructed from pictures, which is then fitted to the clone, a fully automated procedure resulting in 360-degree seamless texture mapping. We also introduce an extremely fast dynamic system for 3D morphing with 3D spatial interpolation and powerful 2D texture-image metamorphosis based on triangulation inherited from 3D structure of virtual faces. The interface allows for the real-time inspection and control of the morphing process.