A DNN-LSTM based Target Tracking Approach using mmWave Radar and Camera Sensor Fusion

Abstract

A new sensor fusion study for monocular camera and mmWave radar using deep neural network and LSTMs is presented. The proposed study includes a decision framework to produce reliable output when either sensor fails. Experiment results to demonstrate single sensor uncertainty and the proposed method’s advantages are also presented.