Extraction of features from video files using different image algebraic point operations

In the human-computer interaction (HCI) field, facial feature analysis and extraction are the most decisive stages which can lead to a robust and efficient classification system like facial expression recognition, emotion classification. In this paper, an approach to the problem of automatic facial feature extraction from different videos are presented using several image algebraic operations. These operations deal with pixel intensity values individually through some mathematical theory involved in image analysis and transformations. In this paper, 11 operations (point subtraction, point addition, point multiplication, point division, edge detecting, average neighborhood filtering, image stretching, log operation, exponential operation, inverse filtering, and image thresholding) are implemented and tested on the images (video frames) extracted from three different self-recorded videos named as video1, video2, video3. The videos are in .avi, .mp4 and .wmv format respectively. The work is tested on two types of data: grayscale and RGB (Red, Green, Blue). To assess the efficiency of each operation, three factors are considered: processing time, frames per second (FPS) and sharpness of edges of feature points based on image gradients. The implementation has been done in MATLAB R2017a.