Lip feature extraction using motion, color, and edge information

Abstract

In this paper, we present a Markov random field based technique for extracting lip features from video using color and edge information. Motion between frames is used as an indicator to locate the approximate lip region, while color and edge information allow boundaries of naturally covered lips to be identified and segmented from the rest of the face. Using the lip region, geometric lip features are then extracted from the segmented lip area. The experimental results show that 96% accuracy is obtained in extracting six key lip feature points in typical talking head video sequences when the tongue is not visible in the scene, and 90% accuracy when the tongue is visible.