Enhanced real-time face models from stereo imaging for gaming applications

Abstract

Techniques for improved 2D active appearance face models are presented. When these are applied to stereoscopic image pairs we show that sufficient information on image depth is obtained to generate an approximate 3D face model. Two techniques are investigated, the first based on 2D+3D AAMs and the second using methods based on thin plate splines. The resulting 3D models can offer a practical real-time face model which is suitable for a range of applications in computer gaming. Due to the compact nature of AAMs these are also very suitable for use in embedded devices such as gaming peripherals!!