{"title":"DDFSRM:用于线扫描超分辨率的去噪扩散融合模型","authors":"Rui Liu;Ying Xiao;Yini Peng;Xin Tian","doi":"10.1109/TCI.2024.3458468","DOIUrl":null,"url":null,"abstract":"Line-scanning super-resolution (LSSR) provides a new way to improve the spatial resolution of images. To further improve its super-resolution (SR) performance boosted by deep learning, a new denoising diffusion fusion super-resolution model (DDFSRM) is proposed in this paper. Considering the reconstruction optimization problem in LSSR is ill-posed, we first build a model-based fusion SR guidance and take the diffusion model sampling mean as an implicit prior learned from data to constrain the optimization model, which improves the model's accuracy. Then, the solution of the model is embedded in the iterative process of diffusion sampling. Finally, a posterior sampling model based on the denoising diffusion probabilistic model for LSSR task is obtained to achieve a good balance between denoising and SR capabilities by combining explicit and implicit priors. Both simulated and real experiments show that DDFSRM outperforms other state-of-the-art SR methods in both qualitative and quantitative evaluation.","PeriodicalId":56022,"journal":{"name":"IEEE Transactions on Computational Imaging","volume":"10 ","pages":"1357-1367"},"PeriodicalIF":4.2000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DDFSRM: Denoising Diffusion Fusion Model for Line-Scanning Super-Resolution\",\"authors\":\"Rui Liu;Ying Xiao;Yini Peng;Xin Tian\",\"doi\":\"10.1109/TCI.2024.3458468\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Line-scanning super-resolution (LSSR) provides a new way to improve the spatial resolution of images. To further improve its super-resolution (SR) performance boosted by deep learning, a new denoising diffusion fusion super-resolution model (DDFSRM) is proposed in this paper. Considering the reconstruction optimization problem in LSSR is ill-posed, we first build a model-based fusion SR guidance and take the diffusion model sampling mean as an implicit prior learned from data to constrain the optimization model, which improves the model's accuracy. Then, the solution of the model is embedded in the iterative process of diffusion sampling. Finally, a posterior sampling model based on the denoising diffusion probabilistic model for LSSR task is obtained to achieve a good balance between denoising and SR capabilities by combining explicit and implicit priors. Both simulated and real experiments show that DDFSRM outperforms other state-of-the-art SR methods in both qualitative and quantitative evaluation.\",\"PeriodicalId\":56022,\"journal\":{\"name\":\"IEEE Transactions on Computational Imaging\",\"volume\":\"10 \",\"pages\":\"1357-1367\"},\"PeriodicalIF\":4.2000,\"publicationDate\":\"2024-09-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Computational Imaging\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10675442/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Imaging","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10675442/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
摘要
线扫描超分辨率(LSSR)为提高图像的空间分辨率提供了一种新方法。为了在深度学习的推动下进一步提高其超分辨率(SR)性能,本文提出了一种新的去噪扩散融合超分辨率模型(DDFSRM)。考虑到 LSSR 中的重构优化问题是非拟的,我们首先建立了基于模型的融合 SR 引导,并将扩散模型采样均值作为从数据中学习到的隐含先验来约束优化模型,从而提高了模型的精度。然后,将模型的解嵌入扩散采样的迭代过程中。最后,在去噪扩散概率模型的基础上得到了用于 LSSR 任务的后验采样模型,通过结合显式和隐式前验,在去噪和 SR 能力之间实现了良好的平衡。模拟和实际实验都表明,DDFSRM 在定性和定量评估方面都优于其他最先进的 SR 方法。
DDFSRM: Denoising Diffusion Fusion Model for Line-Scanning Super-Resolution
Line-scanning super-resolution (LSSR) provides a new way to improve the spatial resolution of images. To further improve its super-resolution (SR) performance boosted by deep learning, a new denoising diffusion fusion super-resolution model (DDFSRM) is proposed in this paper. Considering the reconstruction optimization problem in LSSR is ill-posed, we first build a model-based fusion SR guidance and take the diffusion model sampling mean as an implicit prior learned from data to constrain the optimization model, which improves the model's accuracy. Then, the solution of the model is embedded in the iterative process of diffusion sampling. Finally, a posterior sampling model based on the denoising diffusion probabilistic model for LSSR task is obtained to achieve a good balance between denoising and SR capabilities by combining explicit and implicit priors. Both simulated and real experiments show that DDFSRM outperforms other state-of-the-art SR methods in both qualitative and quantitative evaluation.
期刊介绍:
The IEEE Transactions on Computational Imaging will publish articles where computation plays an integral role in the image formation process. Papers will cover all areas of computational imaging ranging from fundamental theoretical methods to the latest innovative computational imaging system designs. Topics of interest will include advanced algorithms and mathematical techniques, model-based data inversion, methods for image and signal recovery from sparse and incomplete data, techniques for non-traditional sensing of image data, methods for dynamic information acquisition and extraction from imaging sensors, software and hardware for efficient computation in imaging systems, and highly novel imaging system design.