Robust facial action recognition from real-time 3D streams

Abstract

This paper presents a completely automated facial action and facial expression recognition system using 2D + 3D images recorded in real-time by a structured light sensor. It is based on local feature tracking and rule-based classification of geometric, appearance and surface curvature measurements. Good performance is achieved under relatively non-controlled conditions.