Cellular multi-core fusion-tracking system for multi-modal space-time signature analysis

Abstract

Summary form only given. A novel real-time signal processing device will be demonstrated designed and implemented for improved target feature extraction, discrimination, and tracking. The device utilizes a unique combination of advanced signal processing techniques for multi-spectral fusion and image analysis. It incorporates state-of-the-art algorithms and the associated electronics to combine the functions of a multi-spectral fusion (MSF) engine and a multi-target tracking and discrimination (MTTD) engine. The resulting compact MSF-MTTD system, currently is capable of processing image flows from two external sensors (e.g. infrared and visible) by utilizing the processing power of massively parallel cellular nonlinear processor architectures at different levels of processing. The compact (<2in¿3) light-weight (<25 g), low-power (<5 W for the entire system) prototype of the multi-core MSF-MTTD engine and system has been implemented using low-power FPGAs and will be used and demonstrated in complex event detection scenarios.