Unifying remote sensing change detection via deep probabilistic change models: From principles, models to applications

Abstract

Change detection in high-resolution Earth observation is a fundamental Earth vision task to understand the subtle temporal dynamics of Earth’s surface, significantly promoted by generic vision technologies in recent years. Vision Transformer is a powerful component to learning spatiotemporal representation but with enormous computation complexity, especially for high-resolution images. Besides, there is still lacking principles in designing macro architectures integrating these advanced vision components for various change detection tasks. In this paper, we present a deep probabilistic change model (DPCM) to provide a unified, interpretable, modular probabilistic change process modeling to address multiple change detection tasks, including binary change detection, one-to-many semantic change detection, and many-to-many semantic change detection. DPCM describes any complex change process as a probabilistic graphical model to provide theoretical evidence for macro architecture design and generic change detection task modeling. We refer to this probabilistic graphical model as the probabilistic change model (PCM), where DPCM is the PCM parameterized by deep neural networks. For parameterization, the PCM is factorized into many easy-to-solve distributions based on task-specific assumptions, and then we can use deep neural modules to parameterize these distributions to solve the change detection problem uniformly. In this way, DPCM has both theoretical macro architecture from PCM and strong representation capability of deep networks. We also present the sparse change Transformer for better parameterization. Inspired by domain knowledge, i.e., the sparsity of change and the local correlation of change, the sparse change Transformer computes self-attention within change regions to model spatiotemporal correlations, which has a quadratic computational complexity of the change region size but independent of image size, significantly reducing computation overhead for high-resolution image change detection. We refer to this instance of DPCM with sparse change Transformer as ChangeSparse to demonstrate their effectiveness. The experiments confirm ChangeSparse’s superiority in speed and accuracy for multiple real-world application scenarios, such as disaster response and urban development monitoring. The code is available at https://github.com/Z-Zheng/pytorch-change-models. More resources can be found in http://rsidea.whu.edu.cn/resource_sharing.htm.