A Multivehicle Tracking Method for Video-SAR With Reliable Foreground–Background Motion Feature Compensation

Abstract

Most of the existing video synthetic aperture radar (ViSAR) vehicle multitarget tracking (MTT) methods only perform interframe association based on the idea of appearance modeling, and are not closely integrated with the ViSAR moving target imaging characteristics, resulting in limited accuracy improvement of existing MTT methods. ViSAR moving targets have the characteristics of individual similarity, time-varying appearance, and background pseudo-motion, which have a great impact on tracking performance. In this regard, we propose a multivehicle tracking method for ViSAR with reliable foreground-background motion feature compensation (RFBMFC). Specifically, in order to improve the distinguishability of individual features, the spatial-temporal semantic sparse alignment (STSSA) module with intraframe and interframe context key information aggregation and interaction is constructed in the feature extraction stage, which can generate more accurate dense optical flow to enhance the detection and association of foreground targets. In order to improve the tracking continuity of foreground targets with time-varying appearance, the shadow-observation-state mining (SOSM) module is designed in the interframe association stage, which can cluster targets under different appearance states and adaptively restore lost target trajectories. In addition, the background motion fast compensation (BMFC) module is designed, which can learn background motion estimation and correct the trajectory prediction error of foreground targets in an end-to-end self-supervised manner to improve the MTT accuracy under camera motion. Tests on datasets captured by Sandia National Laboratories (SNL) and Beijing Institute of Radio Measurement (BIRM) show that RFBMFC outperforms many representative MTT methods. Compared with the suboptimal method, RFBMFC improves the multiobject tracking accuracy (MOTA) by 1.10% on the SNL data, and by 5.00% on the BIRM data, verifying the effectiveness of RFBMFC.