FPS-U2Net: Combining U2Net and multi-level aggregation architecture for fire point segmentation in remote sensing images

Abstract

Traditional methods for fire point segmentation (FPS) in satellite remote sensing images (RSIs) overly rely on threshold judgment, which are greatly affected by factors such as regional time and show poor generalization. Besides, due to the difference between natural scene images (NSIs) and RSIs, directly apply NSIs-based deep learning methods to forest fire RSIs without any modification fails to achieve satisfactory results. To address these issues, first, we construct a Landsat8 RSI-FPS dataset covering different years, seasons and regions. Then, for the first time, we apply salient object detection (SOD) to FPS in forest fire monitoring and propose a novel network FPS-U²Net to improve the performance of FPS. FPS-U²Net is based on U²Netp (a lightweight U²Net), to make better use of the multi-level features from adjacent encoders, we propose multi-level aggregation module (MAM), which is placed between the encoder and decoder at the same stage to aggregate the adjacent multi-scale features and capture richer contextual information. To make up for the weakness of BCE loss, we employ the hybrid loss, BCE + IoU, for the training of the network, which can guide the network learn the salient information from pixel and map levels. Extensive experiments on three datasets demonstrate that our FPS-U²Net significantly outperforms the state-of-the-art semantic segmentation and SOD methods. FPS-U²Net can accurately segment fire regions and predict clear local details.