Human face based approach for video summarization

Abstract

In video summarization, a short video clip is made from lengthy video without losing its semantic content using significant scenes containing important frames, called keyframes. This process finds importance in video content management systems. The proposed method involves automatic summarization of motion picture based on human face. In this method, those frames within which the appearances of an actor or actress, selected by the user, occurs are treated as keyframes. In the first step, the video is segmented into shots by Mutual Information. Then it detects the available faces in the frames of each shot using the local Successive Mean Quantization Transform (SMQT) features and Sparse Network of Winnows (SNoW) classifier. Then the face of an actor of interest is selected to match with different available faces, already extracted, using Eigenfaces method. A shot is taken into consideration, if the method succeeds in finding at least one matched face in the shot. The selected shots are finally combined to create summarized video.