基于多变量高斯泊松噪声的自监督多盲网络去噪

IF 6.5 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Hang Zhao, Zitong Wang, Xiaoli Zhang, Zhaojun Liu
{"title":"基于多变量高斯泊松噪声的自监督多盲网络去噪","authors":"Hang Zhao,&nbsp;Zitong Wang,&nbsp;Xiaoli Zhang,&nbsp;Zhaojun Liu","doi":"10.1016/j.neucom.2025.131557","DOIUrl":null,"url":null,"abstract":"<div><div>The noise in real images exhibits more complex distributions than the synthetic noise and distinguishes across different scenarios. Furthermore, the scarcity of \"clean-to-noisy\" paired image datasets makes the current models difficult to denoise successfully. To address these challenges, we propose MGP-MBF<span><math><msup><mtext>M</mtext><mn>2</mn></msup></math></span>ANet, a self-supervised multi-blind feature multi-modulation attention network based on multivariate Gaussian-Poisson noise prior for real image denoising. Firstly, we propose a multivariate Gaussian-Poisson distribution to construct noisy images that contain more complex pixel spatial positions and intensity correlations, which expand the training domain and improve the model’s ability to generalize across diverse real noisy images. Building on this, we implement a random sampling mechanism based on four-neighborhood similarity to construct \"noise-noise\" training pairs, effectively exploiting the statistical properties of local structures in noisy images, without relying on any clean reference image. During the network design phase, a multi-blind feature multi-modulation attention module successfully enhances the representation of local features, which introduces multi-masked strategy to force network to learn more information to address the challenge of feature identity mapping. Experimental results demonstrate that the proposed method effectively suppresses noise and recovers high-frequency details within an unsupervised learning paradigm, achieving superior performance in both objective evaluation metrics and subjective visual quality across multiple real-world datasets.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"658 ","pages":"Article 131557"},"PeriodicalIF":6.5000,"publicationDate":"2025-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Self-supervised multi-blind network for real image denoising via multivariate Gaussian-poisson noise\",\"authors\":\"Hang Zhao,&nbsp;Zitong Wang,&nbsp;Xiaoli Zhang,&nbsp;Zhaojun Liu\",\"doi\":\"10.1016/j.neucom.2025.131557\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The noise in real images exhibits more complex distributions than the synthetic noise and distinguishes across different scenarios. Furthermore, the scarcity of \\\"clean-to-noisy\\\" paired image datasets makes the current models difficult to denoise successfully. To address these challenges, we propose MGP-MBF<span><math><msup><mtext>M</mtext><mn>2</mn></msup></math></span>ANet, a self-supervised multi-blind feature multi-modulation attention network based on multivariate Gaussian-Poisson noise prior for real image denoising. Firstly, we propose a multivariate Gaussian-Poisson distribution to construct noisy images that contain more complex pixel spatial positions and intensity correlations, which expand the training domain and improve the model’s ability to generalize across diverse real noisy images. Building on this, we implement a random sampling mechanism based on four-neighborhood similarity to construct \\\"noise-noise\\\" training pairs, effectively exploiting the statistical properties of local structures in noisy images, without relying on any clean reference image. During the network design phase, a multi-blind feature multi-modulation attention module successfully enhances the representation of local features, which introduces multi-masked strategy to force network to learn more information to address the challenge of feature identity mapping. Experimental results demonstrate that the proposed method effectively suppresses noise and recovers high-frequency details within an unsupervised learning paradigm, achieving superior performance in both objective evaluation metrics and subjective visual quality across multiple real-world datasets.</div></div>\",\"PeriodicalId\":19268,\"journal\":{\"name\":\"Neurocomputing\",\"volume\":\"658 \",\"pages\":\"Article 131557\"},\"PeriodicalIF\":6.5000,\"publicationDate\":\"2025-09-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neurocomputing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0925231225022295\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231225022295","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

与合成噪声相比,真实图像中的噪声分布更为复杂,在不同场景下具有明显的差异性。此外,“清洁噪声”配对图像数据集的稀缺性使得当前模型难以成功去噪。为了解决这些挑战,我们提出了MGP-MBFM2ANet,这是一个基于多元高斯-泊松噪声先验的自监督多盲特征多调制关注网络,用于真实图像的去噪。首先,我们提出了一个多元高斯-泊松分布来构建包含更复杂像素空间位置和强度相关性的噪声图像,这扩大了训练域,提高了模型在不同真实噪声图像上的泛化能力。在此基础上,我们实现了一种基于四邻域相似度的随机抽样机制来构建“噪声-噪声”训练对,有效地利用了噪声图像中局部结构的统计特性,而不依赖于任何干净的参考图像。在网络设计阶段,多盲特征多调制关注模块成功增强了局部特征的表示,引入多掩码策略,迫使网络学习更多信息,解决特征同一性映射的难题。实验结果表明,该方法在无监督学习范式下有效地抑制了噪声并恢复了高频细节,在多个真实世界数据集的客观评价指标和主观视觉质量方面都取得了优异的表现。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Self-supervised multi-blind network for real image denoising via multivariate Gaussian-poisson noise
The noise in real images exhibits more complex distributions than the synthetic noise and distinguishes across different scenarios. Furthermore, the scarcity of "clean-to-noisy" paired image datasets makes the current models difficult to denoise successfully. To address these challenges, we propose MGP-MBFM2ANet, a self-supervised multi-blind feature multi-modulation attention network based on multivariate Gaussian-Poisson noise prior for real image denoising. Firstly, we propose a multivariate Gaussian-Poisson distribution to construct noisy images that contain more complex pixel spatial positions and intensity correlations, which expand the training domain and improve the model’s ability to generalize across diverse real noisy images. Building on this, we implement a random sampling mechanism based on four-neighborhood similarity to construct "noise-noise" training pairs, effectively exploiting the statistical properties of local structures in noisy images, without relying on any clean reference image. During the network design phase, a multi-blind feature multi-modulation attention module successfully enhances the representation of local features, which introduces multi-masked strategy to force network to learn more information to address the challenge of feature identity mapping. Experimental results demonstrate that the proposed method effectively suppresses noise and recovers high-frequency details within an unsupervised learning paradigm, achieving superior performance in both objective evaluation metrics and subjective visual quality across multiple real-world datasets.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Neurocomputing
Neurocomputing 工程技术-计算机:人工智能
CiteScore
13.10
自引率
10.00%
发文量
1382
审稿时长
70 days
期刊介绍: Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信