Ship Detection in SAR Images via Cross-Attention Mechanism

Abstract

Abstract Deep learning has been widely applied to ship detection in Synthetic Aperture Radar (SAR) images. Unlike optical images, the current object detection methods have the problem of weak feature representation due to the low object resolution in SAR images. In addition, disturbed by chaotic noise, the features of classification and location are prone to significant differences, resulting in classification and location task misalignment. Therefore, this paper proposes a novel SAR ship target detection algorithm based on Cross-Attention Mechanism (CAM), which can establish the information interaction between the classification and localization task and strengthen the correlation between features through attention. In addition, to suppress the noise in multi-scale feature fusion, we designed an Attention-based Feature Fusion Module (AFFM), which uses the attention information between channels to perform the re-weighting operation. This operation can enhance useful feature information and suppress noise information. Experimental results show that on a benchmark SAR Ship Detection Dataset (SSDD), the Fully Convolutional One-Stage Object Detector (FCOS) with ResNet-50 backbone network was optimized to improve AP by 6.5% and computational cost by 0.51%. RetinaNet with ResNet-50 backbone network was optimized to improve AP by 1.8% and computational cost by 0.51%.