On the Effect of Human Body Parts in Large Scale Human Behaviour Recognition

Abstract

Automatic analysis of human behaviour in large collections of videos is gaining interest, even more so with the advent of file sharing sites such as YouTube. Human behaviour analysis methods can be categorised into three classes based on the type of features. The three representations are local, region of interest and densely sampled based representations. Local feature representation, such as Spatio-Temporal Interest Points (STIP), are quite popular for modelling temporal aspects in human action recognition. Region of Interest (ROI) based feature representations try to capture and represent human body part regions. Densely sampled representations capture information at uniformly spaced intervals spread in space and temporal directions of the given video. In this paper, we investigate the effect of human body part (ROI) information in large scale action recognition. Further, we also investigate the effect of its fusion with Harris 3D points (local representation) information and densely sampled representations. All experiments use a Bag-of-Words framework. We present our results on large class benchmark databases such as the UCF50 and HMDB51 datasets.