A real-time detector for small-object remote sensing

Abstract

In the field of object detection, small-object detection has always been a difficult task. Remote sensing images have complex backgrounds and small objects can be densely distributed. Moreover, remote sensing detection must meet real-time requirements. To address these challenges, this paper proposes a detector called NanoDet-Drone for the real-time detection of small objects in remote sensing scenes. The baseline model lacks a sufficient receptive field to capture both local and long-distance information, and cannot achieve satisfactory detection results when directly applied to remote sensing detection. Our project improves the baseline network. First, the receptive field module is proposed, which uses dilated convolution at different dilation rates to expand the model’s receptive field while fully exploiting the contextual information of the small objects, incorporating the coordinate attention mechanism to highlight the features of small objects. Then, the adaptive fusion feature pyramid network (AF-FPN) is proposed to reasonably fuse the features of different branches; this efficiently uses multi-scale features and provides the network with more detailed information about small objects. Finally, the improved training auxiliary module, called the assign guidance module, is used to guide the detection head training and help the network learn richer feature representations to improve the accuracy and robustness of the model. In this study, we conducted extensive experiments on two challenging remote sensing datasets, VisDrone and AI-TOD, to demonstrate the effectiveness and robustness of NanoDet-Drone. Results show that NanoDet-Drone is capable of running at 56.8 frames per second on a CPU, outperforming other advanced detectors (YOLOv9-T and YOLOv10-N) at the same scale. Our model achieves a better trade-off between accuracy and inference speed. The proposed AF-FPN can be easily embedded into a one-stage detector, which effectively improves detection performance while significantly reducing the number of model parameters and computations. Compared with the baseline, NanoDet-Drone increased average precision (AP) and $A{P}_{0.5}$ by 5.2% and 8.6%, respectively, on VisDrone, and increased AP and $A{P}_{0.5}$ by 4.8% and 10.9%, respectively, on AI-TOD.