Robust Object Tracking Based on Recurrent Neural Networks

Abstract

Object tracking through image sequences is one of the important components of many vision systems, and it has numerous applications in driver assistance systems such as pedestrian collision avoidance or collision mitigating systems. Blurred images produced by a rolling shutter camera or occlusions may easily disturb the object tracking system. In this article, a method based on convolutional and recurrent neural networks is presented to further enhance the performance and robustness of such trackers. It is proposed to use a convolutional neural network to detect an intended object and feed the tracker with found image. Moreover, by using this structure the tracker is updated every ′n′ frames. A recurrent neural network is designed to learn the object behavior for estimating and predicting its position in blurred frames or when it is occluded behind an obstacle. Real-time implementation of the proposed approach verifies its applicability for improvement of the trackers performance.