{"title":"Feature learning and generalization error analysis of two-layer linear neural networks for high-dimensional inputs","authors":"Hayato Nishimori, Taiji Suzuki","doi":"10.1007/s41884-024-00142-3","DOIUrl":"https://doi.org/10.1007/s41884-024-00142-3","url":null,"abstract":"","PeriodicalId":93762,"journal":{"name":"Information geometry","volume":"1 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141796838","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Prosper Rosaire Mama Assandje, Joseph Dongho, Thomas Bouetou Bouetou
{"title":"On the complete integrability of gradient systems on manifold of the beta family of the first kind","authors":"Prosper Rosaire Mama Assandje, Joseph Dongho, Thomas Bouetou Bouetou","doi":"10.1007/s41884-023-00130-z","DOIUrl":"https://doi.org/10.1007/s41884-023-00130-z","url":null,"abstract":"","PeriodicalId":93762,"journal":{"name":"Information geometry","volume":"10 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140489466","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Information geometryPub Date : 2024-01-01Epub Date: 2022-06-28DOI: 10.1007/s41884-022-00068-8
H S Battey, D R Cox, Su Hyeong Lee
{"title":"On partial likelihood and the construction of factorisable transformations.","authors":"H S Battey, D R Cox, Su Hyeong Lee","doi":"10.1007/s41884-022-00068-8","DOIUrl":"10.1007/s41884-022-00068-8","url":null,"abstract":"<p><p>Models whose associated likelihood functions fruitfully factorise are an important minority allowing elimination of nuisance parameters via partial likelihood, an operation that is valuable in both Bayesian and frequentist inferences, particularly when the number of nuisance parameters is not small. After some general discussion of partial likelihood, we focus on marginal likelihood factorisations, which are particularly difficult to ascertain from elementary calculations. We suggest a systematic approach for deducing transformations of the data, if they exist, whose marginal likelihood functions are free of the nuisance parameters. This is based on the solution to an integro-differential equation constructed from aspects of the Laplace transform of the probability density function, for which candidate solutions solve a simpler first-order linear homogeneous differential equation. The approach is generalised to the situation in which such factorisable structure is not exactly present. Examples are used in illustration. Although motivated by inferential problems in statistics, the proposed construction is of independent interest and may find application elsewhere.</p>","PeriodicalId":93762,"journal":{"name":"Information geometry","volume":" ","pages":"9-28"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12630320/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47426676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Information geometryPub Date : 2024-01-01Epub Date: 2023-02-02DOI: 10.1007/s41884-022-00093-7
John Armstrong, Damiano Brigo, Emilio Ferrucci
{"title":"Projections of SDEs onto submanifolds.","authors":"John Armstrong, Damiano Brigo, Emilio Ferrucci","doi":"10.1007/s41884-022-00093-7","DOIUrl":"10.1007/s41884-022-00093-7","url":null,"abstract":"<p><p>In Armstrong et al. (Proc Lond Math Soc (3) 119(1):176-213, 2019) the authors define three projections of <math> <msup><mrow><mi>R</mi></mrow> <mi>d</mi></msup> </math> -valued stochastic differential equations (SDEs) onto submanifolds: the Stratonovich, Itô-vector and Itô-jet projections. In this paper, after a brief survey of SDEs on manifolds, we begin by giving these projections a natural, coordinate-free description, each in terms of a specific representation of manifold-valued SDEs. We proceed by deriving formulae for the three projections in ambient <math> <msup><mrow><mi>R</mi></mrow> <mi>d</mi></msup> </math> -coordinates. We use these to show that the Itô-vector and Itô-jet projections satisfy respectively a weak and mean-square optimality criterion \"for small t\": this is achieved by solving constrained optimisation problems. These results confirm, but do not rely on the approach taken in Armstrong et al. (Proc Lond Math Soc (3) 119(1):176-213, 2019), which is formulated in terms of weak and strong Itô-Taylor expansions. In the final section we exhibit examples showing how the three projections can differ, and explore alternative notions of optimality.</p>","PeriodicalId":93762,"journal":{"name":"Information geometry","volume":"1 1","pages":"397-427"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12630303/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42931848","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Information geometryPub Date : 2024-01-01Epub Date: 2023-07-03DOI: 10.1007/s41884-023-00111-2
Dmitrii Pavlov, Bernd Sturmfels, Simon Telen
{"title":"Gibbs manifolds.","authors":"Dmitrii Pavlov, Bernd Sturmfels, Simon Telen","doi":"10.1007/s41884-023-00111-2","DOIUrl":"10.1007/s41884-023-00111-2","url":null,"abstract":"<p><p>Gibbs manifolds are images of affine spaces of symmetric matrices under the exponential map. They arise in applications such as optimization, statistics and quantum physics, where they extend the ubiquitous role of toric geometry. The Gibbs variety is the zero locus of all polynomials that vanish on the Gibbs manifold. We compute these polynomials and show that the Gibbs variety is low-dimensional. Our theory is applied to a wide range of scenarios, including matrix pencils and quantum optimal transport.</p>","PeriodicalId":93762,"journal":{"name":"Information geometry","volume":" ","pages":"691-717"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12630195/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45880513","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Foreword: Half a Century of Information Geometry","authors":"S. Amari","doi":"10.1007/s41884-023-00128-7","DOIUrl":"https://doi.org/10.1007/s41884-023-00128-7","url":null,"abstract":"","PeriodicalId":93762,"journal":{"name":"Information geometry","volume":"56 11","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138951738","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Half a century of information geometry, part 1","authors":"Hiroshi Matsuzoe","doi":"10.1007/s41884-023-00127-8","DOIUrl":"https://doi.org/10.1007/s41884-023-00127-8","url":null,"abstract":"","PeriodicalId":93762,"journal":{"name":"Information geometry","volume":"69 10","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138953040","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}