{"title":"Unbiased estimation of the Hessian for partially observed diffusions.","authors":"Neil K Chada, Ajay Jasra, Fangyuan Yu","doi":"10.1098/rspa.2021.0710","DOIUrl":null,"url":null,"abstract":"<p><p>In this article, we consider the development of unbiased estimators of the Hessian, of the log-likelihood function with respect to parameters, for partially observed diffusion processes. These processes arise in numerous applications, where such diffusions require derivative information, either through the Jacobian or Hessian matrix. As time-discretizations of diffusions induce a bias, we provide an unbiased estimator of the Hessian. This is based on using Girsanov's Theorem and randomization schemes developed through Mcleish (2011 <i>Monte Carlo Methods Appl.</i> <b>17</b>, 301-315 (doi:10.1515/mcma.2011.013)) and Rhee & Glynn (2016 <i>Op. Res.</i> <b>63</b>, 1026-1043). We demonstrate our developed estimator of the Hessian is unbiased, and one of finite variance. We numerically test and verify this by comparing the methodology here to that of a newly proposed particle filtering methodology. We test this on a range of diffusion models, which include different Ornstein-Uhlenbeck processes and the Fitzhugh-Nagumo model, arising in neuroscience.</p>","PeriodicalId":520758,"journal":{"name":"Proceedings. Mathematical, physical, and engineering sciences","volume":" ","pages":"20210710"},"PeriodicalIF":3.0000,"publicationDate":"2022-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9215219/pdf/","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings. Mathematical, physical, and engineering sciences","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1098/rspa.2021.0710","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/6/22 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
Abstract
In this article, we consider the development of unbiased estimators of the Hessian, of the log-likelihood function with respect to parameters, for partially observed diffusion processes. These processes arise in numerous applications, where such diffusions require derivative information, either through the Jacobian or Hessian matrix. As time-discretizations of diffusions induce a bias, we provide an unbiased estimator of the Hessian. This is based on using Girsanov's Theorem and randomization schemes developed through Mcleish (2011 Monte Carlo Methods Appl.17, 301-315 (doi:10.1515/mcma.2011.013)) and Rhee & Glynn (2016 Op. Res.63, 1026-1043). We demonstrate our developed estimator of the Hessian is unbiased, and one of finite variance. We numerically test and verify this by comparing the methodology here to that of a newly proposed particle filtering methodology. We test this on a range of diffusion models, which include different Ornstein-Uhlenbeck processes and the Fitzhugh-Nagumo model, arising in neuroscience.