Factorization-based Automatic 3D Face Modeling from Turntable Image Sequence using Monocular Camera

Abstract

〈Summary〉 Creating a 3D model of a human face from an image sequence remains an important problem in the fields of computer vision and computer graphics. We propose a method based on a factorization algorithm; it automatically constructs a 3D face model from an image sequence that contains turntable motion of the face as captured by a monocular camera. Our proposal uses multiple Active Appearance Models for feature tracking to avoid manual operations and to recover the 3D shape of the whole face. In contrast to previous methods, our approach requires no 3D generic model and can obtain the user’s individual 3D face shape. Experiments conducted on real image sequences demonstrate the effectiveness of the proposed method.