{"title":"通过可控噪声生成的高效扩散模型实现真实世界图像去噪","authors":"Cheng Yang, Cong Wang, Lijing Liang, Zhixun Su","doi":"10.1117/1.jei.33.4.043003","DOIUrl":null,"url":null,"abstract":"Real-world image denoising is a critical task in image processing, aiming to restore clean images from their noisy counterparts captured in natural environments. While diffusion models have demonstrated remarkable success in image generation, surpassing traditional generative models, their application to image denoising has been limited due to challenges in controlling noise generation effectively. We present a general denoising method inspired by diffusion models. Specifically, our approach employs a diffusion process with linear interpolation, enabling control of noise generation. By interpolating the intermediate noisy image between the original clean image and the corresponding real-world noisy one, our model is able to achieve controllable noise generation. Moreover, we introduce two sampling algorithms for this diffusion model: a straightforward procedure aligned with the diffusion process and an enhanced version that addresses the shortcomings of the former. Experimental results demonstrate that our proposed method, utilizing simple convolutional neural networks such as UNet, achieves denoising performance comparable to that of the transformer architecture.","PeriodicalId":54843,"journal":{"name":"Journal of Electronic Imaging","volume":"203 1","pages":""},"PeriodicalIF":1.0000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Real-world image denoising via efficient diffusion model with controllable noise generation\",\"authors\":\"Cheng Yang, Cong Wang, Lijing Liang, Zhixun Su\",\"doi\":\"10.1117/1.jei.33.4.043003\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Real-world image denoising is a critical task in image processing, aiming to restore clean images from their noisy counterparts captured in natural environments. While diffusion models have demonstrated remarkable success in image generation, surpassing traditional generative models, their application to image denoising has been limited due to challenges in controlling noise generation effectively. We present a general denoising method inspired by diffusion models. Specifically, our approach employs a diffusion process with linear interpolation, enabling control of noise generation. By interpolating the intermediate noisy image between the original clean image and the corresponding real-world noisy one, our model is able to achieve controllable noise generation. Moreover, we introduce two sampling algorithms for this diffusion model: a straightforward procedure aligned with the diffusion process and an enhanced version that addresses the shortcomings of the former. Experimental results demonstrate that our proposed method, utilizing simple convolutional neural networks such as UNet, achieves denoising performance comparable to that of the transformer architecture.\",\"PeriodicalId\":54843,\"journal\":{\"name\":\"Journal of Electronic Imaging\",\"volume\":\"203 1\",\"pages\":\"\"},\"PeriodicalIF\":1.0000,\"publicationDate\":\"2024-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Electronic Imaging\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1117/1.jei.33.4.043003\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Electronic Imaging","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1117/1.jei.33.4.043003","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Real-world image denoising via efficient diffusion model with controllable noise generation
Real-world image denoising is a critical task in image processing, aiming to restore clean images from their noisy counterparts captured in natural environments. While diffusion models have demonstrated remarkable success in image generation, surpassing traditional generative models, their application to image denoising has been limited due to challenges in controlling noise generation effectively. We present a general denoising method inspired by diffusion models. Specifically, our approach employs a diffusion process with linear interpolation, enabling control of noise generation. By interpolating the intermediate noisy image between the original clean image and the corresponding real-world noisy one, our model is able to achieve controllable noise generation. Moreover, we introduce two sampling algorithms for this diffusion model: a straightforward procedure aligned with the diffusion process and an enhanced version that addresses the shortcomings of the former. Experimental results demonstrate that our proposed method, utilizing simple convolutional neural networks such as UNet, achieves denoising performance comparable to that of the transformer architecture.
期刊介绍:
The Journal of Electronic Imaging publishes peer-reviewed papers in all technology areas that make up the field of electronic imaging and are normally considered in the design, engineering, and applications of electronic imaging systems.