Morphable face reconstruction with multiple images

Abstract

Efficient 3D face reconstruction is very important for face animation and recognition. The slow speed of the 3D morphable model is due to the texture mapping. To improve the speed, we only use the shape matching to recover the 3D shape and use texture mapping to get the texture. However, only with the shape information, one image is not enough for accurate 3D face reconstruction. So, we propose to use multiple images with the morphable shape model. First, with the feature points given on the multiple images, the 3D coordinates of the feature points are estimate by the pose estimation. Then, frontal and profile 2D morphable shape models are built to estimate the 3D morphable shape model. These two steps works iteratively to improve the result. At last, the texture is extracted from multiple images with the pose estimation from the estimated 3D face. The effectiveness of our method is demonstrated by the experimental results