Spatial-Temporal Context for Action Recognition Combined with Confidence and Contribution Weight

Abstract

In this paper, we propose a new method for human action analysis in videos. A video sequence of human action in our perspective can be modeled through feature distribution over spatial-temporal domain. Relationships between features and each defined action are also explored to form discriminative feature sets. In our work, we first capture contextual correlations between the local features through multiple windows. We then mine confidences from association rules and learn contributions from trained-SVM based on sample videos. Finally, through the analysis of feature distribution and their interactions over spatial-temporal domain, we combine the contexture correlations and the relationships between words and their related actions to derive weights of bag of feature words for action matching. In most of the case, our experiments have indicated that the new method outperforms other previous published results on the Weizmann and KTH datasets.