The 42nd International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering最新文献

筛选

英文中文

The 42nd International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering Pub Date : 2023-08-10 DOI: 10.3390/psf2023009017

Johannes Buchner

引用次数: 0

Proximal Nested Sampling with Data-Driven Priors for Physical Scientists 面向物理科学家的近端嵌套采样与数据驱动先验

The 42nd International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering Pub Date : 2023-06-30 DOI: 10.3390/psf2023009013

J. McEwen, T. Liaudat, Matthew Alexander Price, Xiaohao Cai, M. Pereyra

引用次数: 0

Learned Harmonic Mean Estimation of the Marginal Likelihood with Normalizing Flows 边际似然的学习谐波平均值估计与归一化流量

The 42nd International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering Pub Date : 2023-06-30 DOI: 10.3390/psf2023009010

Alicja Polanska, Matthew Alexander Price, A. Mancini, J. McEwen

{"title":"Learned Harmonic Mean Estimation of the Marginal Likelihood with Normalizing Flows","authors":"Alicja Polanska, Matthew Alexander Price, A. Mancini, J. McEwen","doi":"10.3390/psf2023009010","DOIUrl":"https://doi.org/10.3390/psf2023009010","url":null,"abstract":"Computing the marginal likelihood (also called the Bayesian model evidence) is an important task in Bayesian model selection, providing a principled quantitative way to compare models. The learned harmonic mean estimator solves the exploding variance problem of the original harmonic mean estimation of the marginal likelihood. The learned harmonic mean estimator learns an importance sampling target distribution that approximates the optimal distribution. While the approximation need not be highly accurate, it is critical that the probability mass of the learned distribution is contained within the posterior in order to avoid the exploding variance problem. In previous work a bespoke optimization problem is introduced when training models in order to ensure this property is satisfied. In the current article we introduce the use of normalizing flows to represent the importance sampling target distribution. A flow-based model is trained on samples from the posterior by maximum likelihood estimation. Then, the probability density of the flow is concentrated by lowering the variance of the base distribution, i.e. by lowering its\"temperature\", ensuring its probability mass is contained within the posterior. This approach avoids the need for a bespoke optimisation problem and careful fine tuning of parameters, resulting in a more robust method. Moreover, the use of normalizing flows has the potential to scale to high dimensional settings. We present preliminary experiments demonstrating the effectiveness of the use of flows for the learned harmonic mean estimator. The harmonic code implementing the learned harmonic mean, which is publicly available, has been updated to now support normalizing flows.","PeriodicalId":506244,"journal":{"name":"The 42nd International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering","volume":"62 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139366406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

首页上一页