Violence Detection using Feature Fusion of Optical Flow and 3D CNN on AICS-Violence Dataset

Abstract

In this paper, we introduce a new self-developed violence dataset named AICS-Violence. It contains 7576 high-resolution video clips of violent and non-violent scenarios collected by outdoor security cameras. It includes two different test sets with additional non-violent but seemingly violent actions as well. One of those test sets has data collected using a different camera angle compared to that of the training set and the remaining test set. To focus on each group of people in frames, we develop a method to automatically crop candidate boxes from detected human bounding boxes. Furthermore, two methods named 3D DenseNet Fusion OF RGB and 3D DenseNet Fusion OFnom RGB are proposed. In both methods, two 3D DenseNets are used to extract features from RGB and visualized optical flow respectively. Then, two different ways of fusion namely addition and normalization-based multiplication are applied to the two methods respectively. Evaluation results show that our methods achieve slightly better performance in the first test set and especially significantly better generation than those of some other state-of-the-art methods on the second test set.