{"title":"Convergence of stratified MCMC sampling of non-reversible dynamics","authors":"Gabriel Earle, Jonathan C. Mattingly","doi":"10.1007/s40072-024-00325-0","DOIUrl":null,"url":null,"abstract":"<p>We present a form of stratified MCMC algorithm built with non-reversible stochastic dynamics in mind. It can also be viewed as a generalization of the exact milestoning method or form of NEUS. We prove the convergence of the method under certain assumptions, with expressions for the convergence rate in terms of the process’s behavior within each stratum and large-scale behavior between strata. We show that the algorithm has a unique fixed point which corresponds to the invariant measure of the process without stratification. We will show how the convergence speeds of two versions of the algorithm, one with an extra eigenvalue problem step and one without, related to the mixing rate of a discrete process on the strata, and the mixing probability of the process being sampled within each stratum. The eigenvalue problem version also relates to local and global perturbation results of discrete Markov chains, such as those given by Van Koten, Weare et. al.</p>","PeriodicalId":48569,"journal":{"name":"Stochastics and Partial Differential Equations-Analysis and Computations","volume":null,"pages":null},"PeriodicalIF":1.4000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Stochastics and Partial Differential Equations-Analysis and Computations","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1007/s40072-024-00325-0","RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
引用次数: 0
Abstract
We present a form of stratified MCMC algorithm built with non-reversible stochastic dynamics in mind. It can also be viewed as a generalization of the exact milestoning method or form of NEUS. We prove the convergence of the method under certain assumptions, with expressions for the convergence rate in terms of the process’s behavior within each stratum and large-scale behavior between strata. We show that the algorithm has a unique fixed point which corresponds to the invariant measure of the process without stratification. We will show how the convergence speeds of two versions of the algorithm, one with an extra eigenvalue problem step and one without, related to the mixing rate of a discrete process on the strata, and the mixing probability of the process being sampled within each stratum. The eigenvalue problem version also relates to local and global perturbation results of discrete Markov chains, such as those given by Van Koten, Weare et. al.
期刊介绍:
Stochastics and Partial Differential Equations: Analysis and Computations publishes the highest quality articles presenting significantly new and important developments in the SPDE theory and applications. SPDE is an active interdisciplinary area at the crossroads of stochastic anaylsis, partial differential equations and scientific computing. Statistical physics, fluid dynamics, financial modeling, nonlinear filtering, super-processes, continuum physics and, recently, uncertainty quantification are important contributors to and major users of the theory and practice of SPDEs. The journal is promoting synergetic activities between the SPDE theory, applications, and related large scale computations. The journal also welcomes high quality articles in fields strongly connected to SPDE such as stochastic differential equations in infinite-dimensional state spaces or probabilistic approaches to solving deterministic PDEs.