傅立叶扩散模型:一种控制基于分数的随机图像生成中MTF和NPS的方法

Matthew Tivnan;Jacopo Teneggi;Tzu-Cheng Lee;Ruoqiao Zhang;Kirsten Boedeker;Liang Cai;Grace J. Gang;Jeremias Sulam;J. Webster Stayman
{"title":"傅立叶扩散模型:一种控制基于分数的随机图像生成中MTF和NPS的方法","authors":"Matthew Tivnan;Jacopo Teneggi;Tzu-Cheng Lee;Ruoqiao Zhang;Kirsten Boedeker;Liang Cai;Grace J. Gang;Jeremias Sulam;J. Webster Stayman","doi":"10.1109/TMI.2025.3553805","DOIUrl":null,"url":null,"abstract":"Score-based diffusion models are new and powerful tools for image generation. They are based on a forward stochastic process where an image is degraded with additive white noise and optional input scaling. A neural network can be trained to estimate the time-dependent score function, and used to run the reverse-time stochastic process to generate new samples from the training image distribution. However, one issue is that sampling the reverse process requires many passes of the neural network. In this work we present Fourier Diffusion Models which replace the scalar operations of the forward process with linear shift invariant systems and additive spatially-stationary noise. This allows for a model of continuous probability flow from true images to measurements with a specific modulation transfer function (MTF) and noise power spectrum (NPS). We also derive the reverse process for posterior sampling of high-quality images given blurry noisy measurements. We conducted a computational experiment using the Lung Image Database Consortium dataset of chest CT images and simulated CT measurements with correlated noise and system blur. Our results show that Fourier diffusion models can improve image quality for supervised diffusion posterior sampling relative to existing conditional diffusion models.","PeriodicalId":94033,"journal":{"name":"IEEE transactions on medical imaging","volume":"44 9","pages":"3694-3704"},"PeriodicalIF":0.0000,"publicationDate":"2025-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Fourier Diffusion Models: A Method to Control MTF and NPS in Score-Based Stochastic Image Generation\",\"authors\":\"Matthew Tivnan;Jacopo Teneggi;Tzu-Cheng Lee;Ruoqiao Zhang;Kirsten Boedeker;Liang Cai;Grace J. Gang;Jeremias Sulam;J. Webster Stayman\",\"doi\":\"10.1109/TMI.2025.3553805\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Score-based diffusion models are new and powerful tools for image generation. They are based on a forward stochastic process where an image is degraded with additive white noise and optional input scaling. A neural network can be trained to estimate the time-dependent score function, and used to run the reverse-time stochastic process to generate new samples from the training image distribution. However, one issue is that sampling the reverse process requires many passes of the neural network. In this work we present Fourier Diffusion Models which replace the scalar operations of the forward process with linear shift invariant systems and additive spatially-stationary noise. This allows for a model of continuous probability flow from true images to measurements with a specific modulation transfer function (MTF) and noise power spectrum (NPS). We also derive the reverse process for posterior sampling of high-quality images given blurry noisy measurements. We conducted a computational experiment using the Lung Image Database Consortium dataset of chest CT images and simulated CT measurements with correlated noise and system blur. Our results show that Fourier diffusion models can improve image quality for supervised diffusion posterior sampling relative to existing conditional diffusion models.\",\"PeriodicalId\":94033,\"journal\":{\"name\":\"IEEE transactions on medical imaging\",\"volume\":\"44 9\",\"pages\":\"3694-3704\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-03-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE transactions on medical imaging\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10937272/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on medical imaging","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10937272/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

基于分数的扩散模型是一种新的强大的图像生成工具。它们基于前向随机过程,其中图像用加性白噪声和可选的输入缩放进行退化。通过训练神经网络来估计与时间相关的分数函数,并通过运行逆时随机过程从训练图像分布中生成新的样本。然而,一个问题是,对逆向过程进行采样需要神经网络的多次传递。在这项工作中,我们提出了傅立叶扩散模型,该模型用线性移位不变系统和加性空间平稳噪声取代了正演过程的标量操作。这允许从真实图像到具有特定调制传递函数(MTF)和噪声功率谱(NPS)的测量的连续概率流模型。我们还推导了高质量图像后验采样的逆向过程,给出了模糊的噪声测量。我们使用肺图像数据库联盟的胸部CT图像数据集和具有相关噪声和系统模糊的模拟CT测量数据进行了计算实验。研究结果表明,相对于现有的条件扩散模型,傅里叶扩散模型可以提高监督扩散后验采样的图像质量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Fourier Diffusion Models: A Method to Control MTF and NPS in Score-Based Stochastic Image Generation
Score-based diffusion models are new and powerful tools for image generation. They are based on a forward stochastic process where an image is degraded with additive white noise and optional input scaling. A neural network can be trained to estimate the time-dependent score function, and used to run the reverse-time stochastic process to generate new samples from the training image distribution. However, one issue is that sampling the reverse process requires many passes of the neural network. In this work we present Fourier Diffusion Models which replace the scalar operations of the forward process with linear shift invariant systems and additive spatially-stationary noise. This allows for a model of continuous probability flow from true images to measurements with a specific modulation transfer function (MTF) and noise power spectrum (NPS). We also derive the reverse process for posterior sampling of high-quality images given blurry noisy measurements. We conducted a computational experiment using the Lung Image Database Consortium dataset of chest CT images and simulated CT measurements with correlated noise and system blur. Our results show that Fourier diffusion models can improve image quality for supervised diffusion posterior sampling relative to existing conditional diffusion models.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信