CDSS-Pan: Convolutional Dictionary Learning With State Space Model for Pansharpening

Abstract

Restricted by the development of contemporary sensors, we can only acquire multispectral images (MS) and high-resolution panchromatic (PAN) images separately. The purpose of pansharpening methods is to combine the rich spectral-spatial information contained in MS and PAN images to generate the high-resolution multispectral image. Most existing pansharpening methods either separately extract feature information from MS and PAN images or extract feature information after concatenating MS and PAN images, lacking the utilization of complementary information throughout the feature extraction process. Motivated by the advancements in optimization algorithm and the state space model, we introduce a convolutional dictionary learning with state space model for pansharpeningin this article. Our network comprises two parts: the encoder and the decoder. In the encoder part, we begin by building an observation model to capture the common and unique information between MS and PAN images. Subsequently, we continuously iterate and optimize the network parameters using the approximate gradient algorithm. Meanwhile, we utilize the powerful long-range dependence modeling capability of the SSM to comprehensively extract feature information from the images. In the decoder part, we propose both a detail enhancement block and an adaptive weight learning block to strengthen the model's ability to extract detailed feature information from the images. To demonstrate the superiority of our proposed method, we conduct comparative experiments with current state-of-the-art pansharpening methods on three benchmark datasets: QB, GF2, and WV3. Experimental results prove that our method exhibits the best performance.