{"title":"使用正则化瓦塞尔斯坦近似值的无噪声采样算法的收敛性","authors":"Fuqun Han, Stanley Osher, Wuchen Li","doi":"arxiv-2409.01567","DOIUrl":null,"url":null,"abstract":"In this work, we investigate the convergence properties of the backward\nregularized Wasserstein proximal (BRWP) method for sampling a target\ndistribution. The BRWP approach can be shown as a semi-implicit time\ndiscretization for a probability flow ODE with the score function whose density\nsatisfies the Fokker-Planck equation of the overdamped Langevin dynamics.\nSpecifically, the evolution of the score function is computed using a kernel\nformula derived from the regularized Wasserstein proximal operator. By applying\nthe Laplace method to obtain the asymptotic expansion of this kernel formula,\nwe establish guaranteed convergence in terms of the Kullback-Leibler divergence\nfor the BRWP method towards a strongly log-concave target distribution. Our\nanalysis also identifies the optimal and maximum step sizes for convergence.\nFurthermore, we demonstrate that the deterministic and semi-implicit BRWP\nscheme outperforms many classical Langevin Monte Carlo methods, such as the\nUnadjusted Langevin Algorithm (ULA), by offering faster convergence and reduced\nbias. Numerical experiments further validate the convergence analysis of the\nBRWP method.","PeriodicalId":501379,"journal":{"name":"arXiv - STAT - Statistics Theory","volume":"12 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Convergence of Noise-Free Sampling Algorithms with Regularized Wasserstein Proximals\",\"authors\":\"Fuqun Han, Stanley Osher, Wuchen Li\",\"doi\":\"arxiv-2409.01567\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this work, we investigate the convergence properties of the backward\\nregularized Wasserstein proximal (BRWP) method for sampling a target\\ndistribution. The BRWP approach can be shown as a semi-implicit time\\ndiscretization for a probability flow ODE with the score function whose density\\nsatisfies the Fokker-Planck equation of the overdamped Langevin dynamics.\\nSpecifically, the evolution of the score function is computed using a kernel\\nformula derived from the regularized Wasserstein proximal operator. By applying\\nthe Laplace method to obtain the asymptotic expansion of this kernel formula,\\nwe establish guaranteed convergence in terms of the Kullback-Leibler divergence\\nfor the BRWP method towards a strongly log-concave target distribution. Our\\nanalysis also identifies the optimal and maximum step sizes for convergence.\\nFurthermore, we demonstrate that the deterministic and semi-implicit BRWP\\nscheme outperforms many classical Langevin Monte Carlo methods, such as the\\nUnadjusted Langevin Algorithm (ULA), by offering faster convergence and reduced\\nbias. Numerical experiments further validate the convergence analysis of the\\nBRWP method.\",\"PeriodicalId\":501379,\"journal\":{\"name\":\"arXiv - STAT - Statistics Theory\",\"volume\":\"12 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - STAT - Statistics Theory\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.01567\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - STAT - Statistics Theory","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.01567","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Convergence of Noise-Free Sampling Algorithms with Regularized Wasserstein Proximals
In this work, we investigate the convergence properties of the backward
regularized Wasserstein proximal (BRWP) method for sampling a target
distribution. The BRWP approach can be shown as a semi-implicit time
discretization for a probability flow ODE with the score function whose density
satisfies the Fokker-Planck equation of the overdamped Langevin dynamics.
Specifically, the evolution of the score function is computed using a kernel
formula derived from the regularized Wasserstein proximal operator. By applying
the Laplace method to obtain the asymptotic expansion of this kernel formula,
we establish guaranteed convergence in terms of the Kullback-Leibler divergence
for the BRWP method towards a strongly log-concave target distribution. Our
analysis also identifies the optimal and maximum step sizes for convergence.
Furthermore, we demonstrate that the deterministic and semi-implicit BRWP
scheme outperforms many classical Langevin Monte Carlo methods, such as the
Unadjusted Langevin Algorithm (ULA), by offering faster convergence and reduced
bias. Numerical experiments further validate the convergence analysis of the
BRWP method.