CycleGAN-based unsupervised image smoothing framework with wavelet downsampling and multi-scale spatially-adaptive attention

IF 2.9 3区 工程技术 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Jiafu Zeng , Huiyu Li , Yepeng Liu , Fan Zhang
{"title":"CycleGAN-based unsupervised image smoothing framework with wavelet downsampling and multi-scale spatially-adaptive attention","authors":"Jiafu Zeng ,&nbsp;Huiyu Li ,&nbsp;Yepeng Liu ,&nbsp;Fan Zhang","doi":"10.1016/j.dsp.2025.105300","DOIUrl":null,"url":null,"abstract":"<div><div>Edge-preserving smoothing is an important image processing operation designed to enhance low-frequency structural components while suppressing high-frequency textures and noise. However, existing methods entail high costs for parameter tuning and dataset requirements, and lack generalization across different images. In response, this paper proposes an unsupervised image smoothing framework based on a cycle-consistent adversarial network (CycleGAN). It learns smoothing relationships from unpaired, unlabeled data and uses adversarial training to generate high-quality smoothing results. To better leverage image information, this paper designs a wavelet-based downsampling module to extract key features from subbands in different frequency bands of the image. Furthermore, a multi-scale spatially-adaptive attention module is proposed, which dynamically adjusts the importance of spatial features and facilitates comprehensive information interaction by fusing image features at different scales. Additionally, a composite loss function is employed to guide network optimization and improve the quality of generated results. Qualitative and quantitative experimental results demonstrate that, compared to state-of-the-art smoothing methods, the proposed approach achieves both effective smoothing performance and computational efficiency.</div></div>","PeriodicalId":51011,"journal":{"name":"Digital Signal Processing","volume":"165 ","pages":"Article 105300"},"PeriodicalIF":2.9000,"publicationDate":"2025-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1051200425003227","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Edge-preserving smoothing is an important image processing operation designed to enhance low-frequency structural components while suppressing high-frequency textures and noise. However, existing methods entail high costs for parameter tuning and dataset requirements, and lack generalization across different images. In response, this paper proposes an unsupervised image smoothing framework based on a cycle-consistent adversarial network (CycleGAN). It learns smoothing relationships from unpaired, unlabeled data and uses adversarial training to generate high-quality smoothing results. To better leverage image information, this paper designs a wavelet-based downsampling module to extract key features from subbands in different frequency bands of the image. Furthermore, a multi-scale spatially-adaptive attention module is proposed, which dynamically adjusts the importance of spatial features and facilitates comprehensive information interaction by fusing image features at different scales. Additionally, a composite loss function is employed to guide network optimization and improve the quality of generated results. Qualitative and quantitative experimental results demonstrate that, compared to state-of-the-art smoothing methods, the proposed approach achieves both effective smoothing performance and computational efficiency.
基于小波下采样和多尺度空间自适应关注的cyclegan无监督图像平滑框架
边缘保持平滑是一种重要的图像处理操作,旨在增强低频结构成分,同时抑制高频纹理和噪声。然而,现有方法在参数调优和数据集需求方面的成本较高,并且缺乏对不同图像的泛化。为此,本文提出了一种基于周期一致对抗网络(CycleGAN)的无监督图像平滑框架。它从未配对、未标记的数据中学习平滑关系,并使用对抗性训练来生成高质量的平滑结果。为了更好地利用图像信息,本文设计了基于小波的下采样模块,从图像不同频带的子带中提取关键特征。在此基础上,提出了一种多尺度空间自适应关注模块,通过融合不同尺度的图像特征,动态调整空间特征的重要性,促进信息的综合交互。此外,采用复合损失函数来指导网络优化,提高生成结果的质量。定性和定量实验结果表明,与现有的平滑方法相比,该方法具有良好的平滑性能和计算效率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Digital Signal Processing
Digital Signal Processing 工程技术-工程:电子与电气
CiteScore
5.30
自引率
17.20%
发文量
435
审稿时长
66 days
期刊介绍: Digital Signal Processing: A Review Journal is one of the oldest and most established journals in the field of signal processing yet it aims to be the most innovative. The Journal invites top quality research articles at the frontiers of research in all aspects of signal processing. Our objective is to provide a platform for the publication of ground-breaking research in signal processing with both academic and industrial appeal. The journal has a special emphasis on statistical signal processing methodology such as Bayesian signal processing, and encourages articles on emerging applications of signal processing such as: • big data• machine learning• internet of things• information security• systems biology and computational biology,• financial time series analysis,• autonomous vehicles,• quantum computing,• neuromorphic engineering,• human-computer interaction and intelligent user interfaces,• environmental signal processing,• geophysical signal processing including seismic signal processing,• chemioinformatics and bioinformatics,• audio, visual and performance arts,• disaster management and prevention,• renewable energy,
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信