Occluded Object Classification With mmWave MIMO Radar IQ Signals Using Dual-Stream Convolutional Neural Networks

Abstract

The ability of millimeter-wave (mmWave) radar to penetrate lightweight materials and provide nonvisual insights into obscured areas represents a significant advantage over camera or LiDAR sensors. This capability enables mmWave radar to detect humans behind thin walls or identify occluded objects stored within luggage or packages. The latter capability is particularly valuable in industrial, logistics, and manufacturing applications, where the ability to “look inside the box without opening it” can greatly enhance the efficiency and security. However, the current state of the art in these applications relies on expensive custom-built large antenna array imaging scanners, coupled with image-based object detection algorithms, to detect and classify occluded or concealed objects. To address this challenge more efficiently, we propose a lightweight classification approach for detecting various occluded objects inside a cardboard box. We employ a standard off-the-shelf mmWave 4-D frequency-modulated continuous wave (FMCW) imaging radar. This is combined with a deep learning-based classification method in the form of a dual-stream convolutional neural network (CNN) approach to process complex in-phase and quadrature (IQ) radar signals. This approach reaches in our experiments an overall accuracy of 95.15% on average over a collection of ten different concealed objects.