DiffuSAR: SAR图像生成的频域感知扩散模型

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Zilu Ying;Wenyu Ke;Yikui Zhai;Zhihao Long;Jianhong Zhou;Hufei Zhu;C. L. Philip Chen
{"title":"DiffuSAR: SAR图像生成的频域感知扩散模型","authors":"Zilu Ying;Wenyu Ke;Yikui Zhai;Zhihao Long;Jianhong Zhou;Hufei Zhu;C. L. Philip Chen","doi":"10.1109/JSTARS.2025.3563798","DOIUrl":null,"url":null,"abstract":"In recent years, deep learning-based synthetic aperture radar (SAR) image detection, recognition, and segmentation models achieve remarkable accuracy when trained on large amounts of SAR image samples. However, the acquisition of SAR images tends to be costly. A practical approach to address this issue involves the use of artificially generated training samples to supplement the dataset. Current SAR image generation methods based on generative adversarial networks have issues with generation fidelity and are challenge to converge. Moreover, most of these methods only consider the spatial domain of SAR images without exploring the characteristics of their frequency domain. To tackle the aforementioned problems, we proposed a lightweight frequency domain-aware SAR image generation model based on the denoising diffusion probabilistic model. The proposed generative model is capable of producing highly realistic artificial SAR image samples while converging stably. Meanwhile, our research reveals that high-frequency (HF) components of SAR images play a crucial role in the generation process, and a frequency adjustment module (FAM) based on the fast Fourier transform is implemented in our generation model to prevent interference of HF components by low-frequency components. Tests on the MSTAR dataset highlight our model's advantages in both generation quality and parameter efficiency compared to other cutting-edge image generation models. An additional ablation study also confirms the effectiveness of our proposed FAM, which reduces the Fréchet inception distance by 2.85%, confirming our hypothesis that HF components are more crucial to SAR image generation.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"18 ","pages":"11851-11866"},"PeriodicalIF":4.7000,"publicationDate":"2025-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10974573","citationCount":"0","resultStr":"{\"title\":\"DiffuSAR: Frequency Domain-Aware Diffusion Model for SAR Image Generation\",\"authors\":\"Zilu Ying;Wenyu Ke;Yikui Zhai;Zhihao Long;Jianhong Zhou;Hufei Zhu;C. L. Philip Chen\",\"doi\":\"10.1109/JSTARS.2025.3563798\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In recent years, deep learning-based synthetic aperture radar (SAR) image detection, recognition, and segmentation models achieve remarkable accuracy when trained on large amounts of SAR image samples. However, the acquisition of SAR images tends to be costly. A practical approach to address this issue involves the use of artificially generated training samples to supplement the dataset. Current SAR image generation methods based on generative adversarial networks have issues with generation fidelity and are challenge to converge. Moreover, most of these methods only consider the spatial domain of SAR images without exploring the characteristics of their frequency domain. To tackle the aforementioned problems, we proposed a lightweight frequency domain-aware SAR image generation model based on the denoising diffusion probabilistic model. The proposed generative model is capable of producing highly realistic artificial SAR image samples while converging stably. Meanwhile, our research reveals that high-frequency (HF) components of SAR images play a crucial role in the generation process, and a frequency adjustment module (FAM) based on the fast Fourier transform is implemented in our generation model to prevent interference of HF components by low-frequency components. Tests on the MSTAR dataset highlight our model's advantages in both generation quality and parameter efficiency compared to other cutting-edge image generation models. An additional ablation study also confirms the effectiveness of our proposed FAM, which reduces the Fréchet inception distance by 2.85%, confirming our hypothesis that HF components are more crucial to SAR image generation.\",\"PeriodicalId\":13116,\"journal\":{\"name\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"volume\":\"18 \",\"pages\":\"11851-11866\"},\"PeriodicalIF\":4.7000,\"publicationDate\":\"2025-04-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10974573\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10974573/\",\"RegionNum\":2,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10974573/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

近年来,基于深度学习的合成孔径雷达(SAR)图像检测、识别和分割模型在大量SAR图像样本的训练下取得了显著的精度。然而,SAR图像的获取往往是昂贵的。解决这个问题的一个实用方法是使用人工生成的训练样本来补充数据集。目前基于生成对抗网络的SAR图像生成方法存在生成保真度和收敛性等问题。此外,这些方法大多只考虑了SAR图像的空间域,而没有探索其频域特征。针对上述问题,提出了一种基于去噪扩散概率模型的轻型频域感知SAR图像生成模型。该生成模型能够生成高逼真度的人工SAR图像样本,且收敛稳定。同时,我们的研究表明,SAR图像的高频分量在生成过程中起着至关重要的作用,我们的生成模型中实现了基于快速傅里叶变换的频率调整模块(FAM),以防止低频分量对高频分量的干扰。在MSTAR数据集上的测试表明,与其他尖端图像生成模型相比,我们的模型在生成质量和参数效率方面都具有优势。一项额外的消融研究也证实了我们提出的FAM的有效性,它减少了2.85%的光谱起始距离,证实了我们的假设,即HF成分对SAR图像生成更重要。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
DiffuSAR: Frequency Domain-Aware Diffusion Model for SAR Image Generation
In recent years, deep learning-based synthetic aperture radar (SAR) image detection, recognition, and segmentation models achieve remarkable accuracy when trained on large amounts of SAR image samples. However, the acquisition of SAR images tends to be costly. A practical approach to address this issue involves the use of artificially generated training samples to supplement the dataset. Current SAR image generation methods based on generative adversarial networks have issues with generation fidelity and are challenge to converge. Moreover, most of these methods only consider the spatial domain of SAR images without exploring the characteristics of their frequency domain. To tackle the aforementioned problems, we proposed a lightweight frequency domain-aware SAR image generation model based on the denoising diffusion probabilistic model. The proposed generative model is capable of producing highly realistic artificial SAR image samples while converging stably. Meanwhile, our research reveals that high-frequency (HF) components of SAR images play a crucial role in the generation process, and a frequency adjustment module (FAM) based on the fast Fourier transform is implemented in our generation model to prevent interference of HF components by low-frequency components. Tests on the MSTAR dataset highlight our model's advantages in both generation quality and parameter efficiency compared to other cutting-edge image generation models. An additional ablation study also confirms the effectiveness of our proposed FAM, which reduces the Fréchet inception distance by 2.85%, confirming our hypothesis that HF components are more crucial to SAR image generation.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信