Depthwise Over-parameterized Siamese Network for Visual Tracking

Siamese Network based trackers have achieved excellent performance because of their balanced accuracy and speed. Extracting effective feature of the target template and search regions is a very important problem in visual tracking. Generally, existing trackers use Convolutional Neural Network (CNN) to extract features, which make full use of the depth feature while the spatial structure information is ignored. The spatial structure information is very helpful to represent appearance characteristics of targets and templates. In this paper, we propose a novel tracking algorithm based on Siamese network. Specifically, it consists of Siamese subnetwork for feature extraction and cross correlation. Subnetwork improves feature learning capability of extracting shallow spatial information and deep semantic information, and accelerates the model training. Extensive experiments conducted on three benchmarks including OTB2015 and VOT2016 show that the proposed DOSiam tracker has superior performances and real-time response against state-of-the-art trackers while runs at more than 60 FPS.