Look Twice and Closer: A Coarse-to-Fine Segmentation Network for Small Objects in Remote Sensing Images

Abstract

Convolutional neural networks (CNNs) are frequently used to analyze remote sensing images and achieve impressive progress. Limited by the receptive field size of CNNs, small objects tended to lack adequate features to obtain more accurate segmentation results. To address this problem, we introduce a novel CNN model for coarse-to-fine segmentation called C2FNet. C2FNet comprises two stages: the coarse network and the fine network. The coarse network identifies the positions and coarse segmentation outcomes of small objects in the input image. The fine network then takes a closer look at the small objects and re-segments the patches using binary segmentation. The fine network distinguishes small objects from the background to refine small object segmentation. Finally, C2FNet employs an aggregation module that merges the binary segmentation maps and coarse outcomes to obtain accurate small object segmentation. We conducted extensive experiments on three widely accepted datasets for remote sensing image segmentation, namely the ISPRS 2-D semantic labeling Potsdam, Vaihingen, and iSAID. Our approach significantly improves the performance of baseline models, achieving a 0.24%–2.83% increase in IoU per small object class on iSAID.