Real-Time Target Detection and Recognition with Deep Convolutional Networks for Intelligent Visual Surveillance

Moving target detection and tracking, recognition, behaviours analysis are the key issues in the intelligent visual surveillance system (IVSS). The challenge is how to process the real-time video stream in an effective way in case that we could find the interested objects for analysis. However, the traditional video surveillance technology often does not meet the needs of real-time key frame recognition for the on-line intelligent video monitoring system. In our paper, we apply the state-of-the-art Faster R-CNN [7] that takes advantages of convolutional neural networks into our real-time target recognition system - Deep Intelligent Visual Surveillance (DIVS). The key aspects of our DIVS are consisted of four parts: (i) Getting the real-time video image from remote cameras, (ii) Processing the data with the deep learning framework caffe [23] built for Faster R-CNN, (iii) Storing the valuable data with MySQL, (iv) Data presentation on the website. Experiments based on our system validated the effectiveness, stability and accuracy of our proposed solutions.