A Deep Fusion Network for Violence Recognition

Abstract

With the rise of smart city construction, the importance of violence recognition based on surveillance video is increasingly prominent. For the violence in a surveillance video, it is challenging to define specific violent behavior, and the number of participants engaging in violence is unknown while the involvement of each participant is different. Undoubtedly, these barriers are unfavorable for the consistency of the video frame and video clip labels. In this paper, we propose a new framework of violence recognition: a frame selection strategy based on local differential brightness is designed for the accurate selection of violence frames; meanwhile, a deep fusion network P-VFN is designed, targeting to avoid the mismatch between frames and video labels; finally, various motion image detection algorithms are compared to explore the substitutability of the optical flow method, which aims to better the unsatisfactory real-time performance of current optical flow calculation. Experimental results on three challenging benchmark datasets demonstrate that the proposed approach outperforms many state- of-the-art violence recognition models. Furthermore, to compensate for the lack of the current public dataset in the real surveillance scene, we use real surveillance cameras to capture and produce a largescale real violence dataset, which also attributes to a better performance.