Yazid Janati, Eric Moulines, Jimmy Olsson, Alain Oliviero-Durmus
{"title":"桥接扩散后验抽样与蒙特卡罗方法综述。","authors":"Yazid Janati, Eric Moulines, Jimmy Olsson, Alain Oliviero-Durmus","doi":"10.1098/rsta.2024.0331","DOIUrl":null,"url":null,"abstract":"<p><p>Diffusion models enable the synthesis of highly accurate samples from complex distributions and have become foundational in generative modelling. Recently, they have demonstrated significant potential for solving Bayesian inverse problems by serving as priors. This review offers a comprehensive overview of current methods that leverage <i>pre-trained</i> diffusion models alongside Monte Carlo methods to address Bayesian inverse problems without requiring additional training. We show that these methods primarily employ a <i>twisting</i> mechanism for the intermediate distributions within the diffusion process, guiding the simulations towards the posterior distribution. We describe how various Monte Carlo methods are then used to aid in sampling from these twisted distributions.This article is part of the theme issue 'Generative modelling meets Bayesian inference: a new paradigm for inverse problems'.</p>","PeriodicalId":19879,"journal":{"name":"Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences","volume":"383 2299","pages":"20240331"},"PeriodicalIF":3.7000,"publicationDate":"2025-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Bridging diffusion posterior sampling and Monte Carlo methods: a survey.\",\"authors\":\"Yazid Janati, Eric Moulines, Jimmy Olsson, Alain Oliviero-Durmus\",\"doi\":\"10.1098/rsta.2024.0331\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Diffusion models enable the synthesis of highly accurate samples from complex distributions and have become foundational in generative modelling. Recently, they have demonstrated significant potential for solving Bayesian inverse problems by serving as priors. This review offers a comprehensive overview of current methods that leverage <i>pre-trained</i> diffusion models alongside Monte Carlo methods to address Bayesian inverse problems without requiring additional training. We show that these methods primarily employ a <i>twisting</i> mechanism for the intermediate distributions within the diffusion process, guiding the simulations towards the posterior distribution. We describe how various Monte Carlo methods are then used to aid in sampling from these twisted distributions.This article is part of the theme issue 'Generative modelling meets Bayesian inference: a new paradigm for inverse problems'.</p>\",\"PeriodicalId\":19879,\"journal\":{\"name\":\"Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences\",\"volume\":\"383 2299\",\"pages\":\"20240331\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2025-06-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://doi.org/10.1098/rsta.2024.0331\",\"RegionNum\":3,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MULTIDISCIPLINARY SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1098/rsta.2024.0331","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
Bridging diffusion posterior sampling and Monte Carlo methods: a survey.
Diffusion models enable the synthesis of highly accurate samples from complex distributions and have become foundational in generative modelling. Recently, they have demonstrated significant potential for solving Bayesian inverse problems by serving as priors. This review offers a comprehensive overview of current methods that leverage pre-trained diffusion models alongside Monte Carlo methods to address Bayesian inverse problems without requiring additional training. We show that these methods primarily employ a twisting mechanism for the intermediate distributions within the diffusion process, guiding the simulations towards the posterior distribution. We describe how various Monte Carlo methods are then used to aid in sampling from these twisted distributions.This article is part of the theme issue 'Generative modelling meets Bayesian inference: a new paradigm for inverse problems'.
期刊介绍:
Continuing its long history of influential scientific publishing, Philosophical Transactions A publishes high-quality theme issues on topics of current importance and general interest within the physical, mathematical and engineering sciences, guest-edited by leading authorities and comprising new research, reviews and opinions from prominent researchers.