Clustered Adaptive Graph Priors Network for Few-Shot Image Denoising

IF 10.8 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Bo Jiang;Yao Lu;Huaibo Song;Bob Zhang;Guangming Lu
{"title":"Clustered Adaptive Graph Priors Network for Few-Shot Image Denoising","authors":"Bo Jiang;Yao Lu;Huaibo Song;Bob Zhang;Guangming Lu","doi":"10.1109/TCSVT.2026.3705049","DOIUrl":null,"url":null,"abstract":"Recently, although current few-shot image denoising methods use limited samples to alleviate the problem of data scarcity, they still suffer from two main problems. Firstly, regular <bold>C</b>onvolutional <bold>N</b>eural <bold>N</b>etworks (CNNs) cannot explicitly use the relationship between various parts of the image to construct global information in each layer, which hinders the image denoising performance promotion when using limited training samples. Secondly, due to limited training data, especially for noisy images with high diversity and complex noise, the retrieved features are insufficient to recover the denoised image. To address these issues, this work proposes a Clustered Adaptive Graph Priors Network (CAGP-Net) with few-shot learning for image denoising. Specifically, Graph Neural Networks (GNNs) are applied to capture local and global features. Then, a new method is proposed in CAGP-Net to transform image feature maps into graphs to generate local and global features and construct their interdependence. Additionally, to flexibly supplement the feature prior information required for image denoising, we propose a Clustering Adaptive Graph Prior (CAGP) mechanism to supplement the graph prior information learned from embedding features and provide adaptive graph prior information for restoring denoised images. Finally, to further improve the performance of few-shot image denoising methods, we propose a new two-stage few-shot learning strategy, which mainly aims to integrate the reconstruction feature maps from the first stage into each layer of CAGP-Net in the second stage to adaptively remove noise from noisy images. Extensive ablation and benchmark tests show that our CAGP-Net achieves state-of-the-art performance of the few-shot image denoising tasks.","PeriodicalId":13082,"journal":{"name":"IEEE Transactions on Circuits and Systems for Video Technology","volume":"36 10","pages":"15039-15053"},"PeriodicalIF":10.8000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Circuits and Systems for Video Technology","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/11570908/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/6/22 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Recently, although current few-shot image denoising methods use limited samples to alleviate the problem of data scarcity, they still suffer from two main problems. Firstly, regular Convolutional Neural Networks (CNNs) cannot explicitly use the relationship between various parts of the image to construct global information in each layer, which hinders the image denoising performance promotion when using limited training samples. Secondly, due to limited training data, especially for noisy images with high diversity and complex noise, the retrieved features are insufficient to recover the denoised image. To address these issues, this work proposes a Clustered Adaptive Graph Priors Network (CAGP-Net) with few-shot learning for image denoising. Specifically, Graph Neural Networks (GNNs) are applied to capture local and global features. Then, a new method is proposed in CAGP-Net to transform image feature maps into graphs to generate local and global features and construct their interdependence. Additionally, to flexibly supplement the feature prior information required for image denoising, we propose a Clustering Adaptive Graph Prior (CAGP) mechanism to supplement the graph prior information learned from embedding features and provide adaptive graph prior information for restoring denoised images. Finally, to further improve the performance of few-shot image denoising methods, we propose a new two-stage few-shot learning strategy, which mainly aims to integrate the reconstruction feature maps from the first stage into each layer of CAGP-Net in the second stage to adaptively remove noise from noisy images. Extensive ablation and benchmark tests show that our CAGP-Net achieves state-of-the-art performance of the few-shot image denoising tasks.
基于聚类自适应图先验网络的小样本图像去噪
目前,虽然现有的小片段图像去噪方法利用有限的样本来缓解数据稀缺性的问题,但仍然存在两个主要问题。首先,正则卷积神经网络(cnn)不能明确地利用图像各部分之间的关系来构建每一层的全局信息,这阻碍了在使用有限训练样本时图像去噪性能的提升。其次,由于训练数据有限,特别是对于具有高多样性和复杂噪声的噪声图像,检索到的特征不足以恢复去噪图像。为了解决这些问题,本研究提出了一种带有少量学习的聚类自适应图先验网络(CAGP-Net)用于图像去噪。具体来说,图神经网络(gnn)被用于捕获局部和全局特征。然后,在CAGP-Net中提出了一种将图像特征映射转换成图形的新方法,以生成局部和全局特征并构建它们之间的相互依存关系。此外,为了灵活地补充图像去噪所需的特征先验信息,我们提出了一种聚类自适应图先验(CAGP)机制来补充从嵌入特征中学习到的图先验信息,为去噪图像的恢复提供自适应图先验信息。最后,为了进一步提高小片段图像去噪方法的性能,我们提出了一种新的两阶段小片段学习策略,该策略主要是将第一阶段的重构特征映射整合到第二阶段的CAGP-Net的每一层中,以自适应地去除噪声图像中的噪声。广泛的消融和基准测试表明,我们的CAGP-Net在少量图像去噪任务中达到了最先进的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
13.80
自引率
27.40%
发文量
660
审稿时长
5 months
期刊介绍: The IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) is dedicated to covering all aspects of video technologies from a circuits and systems perspective. We encourage submissions of general, theoretical, and application-oriented papers related to image and video acquisition, representation, presentation, and display. Additionally, we welcome contributions in areas such as processing, filtering, and transforms; analysis and synthesis; learning and understanding; compression, transmission, communication, and networking; as well as storage, retrieval, indexing, and search. Furthermore, papers focusing on hardware and software design and implementation are highly valued. Join us in advancing the field of video technology through innovative research and insights.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书