Wenkai Xu , Wenxing Bao , Wei Feng , Kewen Qu , Xuan Ma , Xiaowu Zhang , Wenlong Wang
{"title":"ddacm - cr: sar辅助光学数据云去除的判别注意和云感知动态曼巴","authors":"Wenkai Xu , Wenxing Bao , Wei Feng , Kewen Qu , Xuan Ma , Xiaowu Zhang , Wenlong Wang","doi":"10.1016/j.dsp.2025.105522","DOIUrl":null,"url":null,"abstract":"<div><div>Cloud contamination significantly diminishes the potential applications of optical remote sensing images in geosciences, whereas Synthetic Aperture Radar (SAR) images remain unaffected by such interference. Numerous approaches have sought to leverage information from SAR images to restore affected areas in optical images. However, these methods still have room for improvement in fully leveraging the synergistic potential of SAR and optical images while preserving the global consistency of the reconstructed images. This paper proposes a novel SAR-assisted cloud removal network for optical remote sensing images, which comprises two key stages: feature extraction and image reconstruction. The feature extraction stage involves extracting deep features from optical and SAR images, which are then integrated into a Discriminative Attention Feature Interaction (DAFI) module. This enables multimodal feature collaboration, effectively recovering missing textural information in cloud-contaminated regions. In the image reconstruction stage, a Dynamic Cloud-Adaptive MAMBA Gated Spatial-Channel Attention (DMA) module is employed, efficiently reconstructing global contextual information with linear computational complexity while restoring spatial and channel details in cloud-affected areas. To further improve visual quality, this study introduces a multi-scale cloud-adaptive perceptual loss function based on VGG19, specifically targeting cloud-contaminated regions across different scales. The proposed method is validated on the SEN12MSCR dataset and M3M-CR dataset, with experimental results demonstrating superior performance over existing algorithms in terms of peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), spectral angle mapper (SAM), and mean absolute error (MAE).</div></div>","PeriodicalId":51011,"journal":{"name":"Digital Signal Processing","volume":"168 ","pages":"Article 105522"},"PeriodicalIF":3.0000,"publicationDate":"2025-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DACDM-CR: Discriminative attention and cloud-aware dynamic mamba for SAR-assisted optical data cloud removal\",\"authors\":\"Wenkai Xu , Wenxing Bao , Wei Feng , Kewen Qu , Xuan Ma , Xiaowu Zhang , Wenlong Wang\",\"doi\":\"10.1016/j.dsp.2025.105522\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Cloud contamination significantly diminishes the potential applications of optical remote sensing images in geosciences, whereas Synthetic Aperture Radar (SAR) images remain unaffected by such interference. Numerous approaches have sought to leverage information from SAR images to restore affected areas in optical images. However, these methods still have room for improvement in fully leveraging the synergistic potential of SAR and optical images while preserving the global consistency of the reconstructed images. This paper proposes a novel SAR-assisted cloud removal network for optical remote sensing images, which comprises two key stages: feature extraction and image reconstruction. The feature extraction stage involves extracting deep features from optical and SAR images, which are then integrated into a Discriminative Attention Feature Interaction (DAFI) module. This enables multimodal feature collaboration, effectively recovering missing textural information in cloud-contaminated regions. In the image reconstruction stage, a Dynamic Cloud-Adaptive MAMBA Gated Spatial-Channel Attention (DMA) module is employed, efficiently reconstructing global contextual information with linear computational complexity while restoring spatial and channel details in cloud-affected areas. To further improve visual quality, this study introduces a multi-scale cloud-adaptive perceptual loss function based on VGG19, specifically targeting cloud-contaminated regions across different scales. The proposed method is validated on the SEN12MSCR dataset and M3M-CR dataset, with experimental results demonstrating superior performance over existing algorithms in terms of peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), spectral angle mapper (SAM), and mean absolute error (MAE).</div></div>\",\"PeriodicalId\":51011,\"journal\":{\"name\":\"Digital Signal Processing\",\"volume\":\"168 \",\"pages\":\"Article 105522\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2025-08-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Digital Signal Processing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1051200425005445\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1051200425005445","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
DACDM-CR: Discriminative attention and cloud-aware dynamic mamba for SAR-assisted optical data cloud removal
Cloud contamination significantly diminishes the potential applications of optical remote sensing images in geosciences, whereas Synthetic Aperture Radar (SAR) images remain unaffected by such interference. Numerous approaches have sought to leverage information from SAR images to restore affected areas in optical images. However, these methods still have room for improvement in fully leveraging the synergistic potential of SAR and optical images while preserving the global consistency of the reconstructed images. This paper proposes a novel SAR-assisted cloud removal network for optical remote sensing images, which comprises two key stages: feature extraction and image reconstruction. The feature extraction stage involves extracting deep features from optical and SAR images, which are then integrated into a Discriminative Attention Feature Interaction (DAFI) module. This enables multimodal feature collaboration, effectively recovering missing textural information in cloud-contaminated regions. In the image reconstruction stage, a Dynamic Cloud-Adaptive MAMBA Gated Spatial-Channel Attention (DMA) module is employed, efficiently reconstructing global contextual information with linear computational complexity while restoring spatial and channel details in cloud-affected areas. To further improve visual quality, this study introduces a multi-scale cloud-adaptive perceptual loss function based on VGG19, specifically targeting cloud-contaminated regions across different scales. The proposed method is validated on the SEN12MSCR dataset and M3M-CR dataset, with experimental results demonstrating superior performance over existing algorithms in terms of peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), spectral angle mapper (SAM), and mean absolute error (MAE).
期刊介绍:
Digital Signal Processing: A Review Journal is one of the oldest and most established journals in the field of signal processing yet it aims to be the most innovative. The Journal invites top quality research articles at the frontiers of research in all aspects of signal processing. Our objective is to provide a platform for the publication of ground-breaking research in signal processing with both academic and industrial appeal.
The journal has a special emphasis on statistical signal processing methodology such as Bayesian signal processing, and encourages articles on emerging applications of signal processing such as:
• big data• machine learning• internet of things• information security• systems biology and computational biology,• financial time series analysis,• autonomous vehicles,• quantum computing,• neuromorphic engineering,• human-computer interaction and intelligent user interfaces,• environmental signal processing,• geophysical signal processing including seismic signal processing,• chemioinformatics and bioinformatics,• audio, visual and performance arts,• disaster management and prevention,• renewable energy,