Multi sensor based tracking of pedestrians: a survey of suitable movement models

Abstract

This article presents a multi sensor approach for driver assistance systems: the detection and tracking of pedestrians in a road environment. A multi sensor system consisting of a far infrared camera and a laser scanning device is used for the detection and precise localization of pedestrians. Kalman filter based data fusion handles the combination of the sensor information of the infrared camera and of the laser scanner. Arranging a set of Kalman filters in parallel, a multi sensor/multi target tracking system was created. The usage of suitable movement models has a great influence on the performance of the tracking system. Several types of models are discussed focussing on the typical behavior of pedestrians in road environments. The multi sensor/multi target tracking system is installed on a test vehicle to obtain practical results which is discussed in this article too.