Jian Huang;Yuling Jiao;Lican Kang;Xu Liao;Jin Liu;Yanyan Liu
{"title":"Schrödinger-Föllmer Sampler","authors":"Jian Huang;Yuling Jiao;Lican Kang;Xu Liao;Jin Liu;Yanyan Liu","doi":"10.1109/TIT.2024.3522494","DOIUrl":null,"url":null,"abstract":"Sampling from probability distributions is a critical problem in statistics and machine learning, particularly in Bayesian inference, where direct integration over the posterior distribution is often infeasible, making sampling from the posterior essential for inference. This paper introduces the Schrödinger-Föllmer sampler (SFS), a novel approach for sampling from potentially unnormalized distributions. The SFS leverages the Schrödinger-Föllmer diffusion process on the unit interval, incorporating a time-dependent drift term that evolves the distribution from a degenerate form at time zero to the target distribution at time one. Unlike existing Markov chain Monte Carlo methods that rely on ergodicity, SFS operates independently of ergodicity. Computationally, SFS is straightforward to implement using the Euler-Maruyama discretization. In our theoretical analysis, we derive non-asymptotic error bounds for the SFS sampling distribution in the Wasserstein distance, subject to reasonable conditions. Numerical experiments demonstrate that SFS generates higher-quality samples than several established methods.","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"71 2","pages":"1283-1299"},"PeriodicalIF":2.2000,"publicationDate":"2024-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Information Theory","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10815994/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Sampling from probability distributions is a critical problem in statistics and machine learning, particularly in Bayesian inference, where direct integration over the posterior distribution is often infeasible, making sampling from the posterior essential for inference. This paper introduces the Schrödinger-Föllmer sampler (SFS), a novel approach for sampling from potentially unnormalized distributions. The SFS leverages the Schrödinger-Föllmer diffusion process on the unit interval, incorporating a time-dependent drift term that evolves the distribution from a degenerate form at time zero to the target distribution at time one. Unlike existing Markov chain Monte Carlo methods that rely on ergodicity, SFS operates independently of ergodicity. Computationally, SFS is straightforward to implement using the Euler-Maruyama discretization. In our theoretical analysis, we derive non-asymptotic error bounds for the SFS sampling distribution in the Wasserstein distance, subject to reasonable conditions. Numerical experiments demonstrate that SFS generates higher-quality samples than several established methods.
期刊介绍:
The IEEE Transactions on Information Theory is a journal that publishes theoretical and experimental papers concerned with the transmission, processing, and utilization of information. The boundaries of acceptable subject matter are intentionally not sharply delimited. Rather, it is hoped that as the focus of research activity changes, a flexible policy will permit this Transactions to follow suit. Current appropriate topics are best reflected by recent Tables of Contents; they are summarized in the titles of editorial areas that appear on the inside front cover.