利用双层神经网络数值求解高维度泊松偏微分方程

IF 2.2 2区 数学 Q1 MATHEMATICS, APPLIED
Mathias Dus, Virginie Ehrlacher
{"title":"利用双层神经网络数值求解高维度泊松偏微分方程","authors":"Mathias Dus, Virginie Ehrlacher","doi":"10.1090/mcom/3971","DOIUrl":null,"url":null,"abstract":"<p>The aim of this article is to analyze numerical schemes using two-layer neural networks with infinite width for the resolution of the high-dimensional Poisson partial differential equation with Neumann boundary condition. Using Barron’s representation of the solution [IEEE Trans. Inform. Theory 39 (1993), pp. 930–945] with a probability measure defined on the set of parameter values, the energy is minimized thanks to a gradient curve dynamic on the <inline-formula content-type=\"math/mathml\"> <mml:math xmlns:mml=\"http://www.w3.org/1998/Math/MathML\" alttext=\"2\"> <mml:semantics> <mml:mn>2</mml:mn> <mml:annotation encoding=\"application/x-tex\">2</mml:annotation> </mml:semantics> </mml:math> </inline-formula>-Wasserstein space of the set of parameter values defining the neural network. Inspired by the work from Bach and Chizat [On the global convergence of gradient descent for over-parameterized models using optimal transport, 2018; ICM–International Congress of Mathematicians, EMS Press, Berlin, 2023], we prove that if the gradient curve converges, then the represented function is the solution of the elliptic equation considered. Numerical experiments are given to show the potential of the method.</p>","PeriodicalId":18456,"journal":{"name":"Mathematics of Computation","volume":null,"pages":null},"PeriodicalIF":2.2000,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Numerical solution of Poisson partial differential equation in high dimension using two-layer neural networks\",\"authors\":\"Mathias Dus, Virginie Ehrlacher\",\"doi\":\"10.1090/mcom/3971\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>The aim of this article is to analyze numerical schemes using two-layer neural networks with infinite width for the resolution of the high-dimensional Poisson partial differential equation with Neumann boundary condition. Using Barron’s representation of the solution [IEEE Trans. Inform. Theory 39 (1993), pp. 930–945] with a probability measure defined on the set of parameter values, the energy is minimized thanks to a gradient curve dynamic on the <inline-formula content-type=\\\"math/mathml\\\"> <mml:math xmlns:mml=\\\"http://www.w3.org/1998/Math/MathML\\\" alttext=\\\"2\\\"> <mml:semantics> <mml:mn>2</mml:mn> <mml:annotation encoding=\\\"application/x-tex\\\">2</mml:annotation> </mml:semantics> </mml:math> </inline-formula>-Wasserstein space of the set of parameter values defining the neural network. Inspired by the work from Bach and Chizat [On the global convergence of gradient descent for over-parameterized models using optimal transport, 2018; ICM–International Congress of Mathematicians, EMS Press, Berlin, 2023], we prove that if the gradient curve converges, then the represented function is the solution of the elliptic equation considered. Numerical experiments are given to show the potential of the method.</p>\",\"PeriodicalId\":18456,\"journal\":{\"name\":\"Mathematics of Computation\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2024-05-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Mathematics of Computation\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://doi.org/10.1090/mcom/3971\",\"RegionNum\":2,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MATHEMATICS, APPLIED\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Mathematics of Computation","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1090/mcom/3971","RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
引用次数: 0

摘要

本文旨在分析使用无限宽双层神经网络的数值方案,以解决具有诺伊曼边界条件的高维泊松偏微分方程。利用巴伦的求解表示法[IEEE Trans. Inform. Theory 39 (1993), pp.受 Bach 和 Chizat [On the global convergence of gradient descent for over-parameterized models using optimal transport, 2018; ICM-International Congress of Mathematicians, EMS Press, Berlin, 2023] 工作的启发,我们证明,如果梯度曲线收敛,那么所表示的函数就是所考虑的椭圆方程的解。我们给出了数值实验,以展示该方法的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Numerical solution of Poisson partial differential equation in high dimension using two-layer neural networks

The aim of this article is to analyze numerical schemes using two-layer neural networks with infinite width for the resolution of the high-dimensional Poisson partial differential equation with Neumann boundary condition. Using Barron’s representation of the solution [IEEE Trans. Inform. Theory 39 (1993), pp. 930–945] with a probability measure defined on the set of parameter values, the energy is minimized thanks to a gradient curve dynamic on the 2 2 -Wasserstein space of the set of parameter values defining the neural network. Inspired by the work from Bach and Chizat [On the global convergence of gradient descent for over-parameterized models using optimal transport, 2018; ICM–International Congress of Mathematicians, EMS Press, Berlin, 2023], we prove that if the gradient curve converges, then the represented function is the solution of the elliptic equation considered. Numerical experiments are given to show the potential of the method.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Mathematics of Computation
Mathematics of Computation 数学-应用数学
CiteScore
3.90
自引率
5.00%
发文量
55
审稿时长
7.0 months
期刊介绍: All articles submitted to this journal are peer-reviewed. The AMS has a single blind peer-review process in which the reviewers know who the authors of the manuscript are, but the authors do not have access to the information on who the peer reviewers are. This journal is devoted to research articles of the highest quality in computational mathematics. Areas covered include numerical analysis, computational discrete mathematics, including number theory, algebra and combinatorics, and related fields such as stochastic numerical methods. Articles must be of significant computational interest and contain original and substantial mathematical analysis or development of computational methodology.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信