无监督学习与物理通知图网络偏微分方程

IF 3.5 2区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Lin Lu, Yiye Zou, Jingyu Wang, Shufan Zou, Laiping Zhang, Xiaogang Deng
{"title":"无监督学习与物理通知图网络偏微分方程","authors":"Lin Lu,&nbsp;Yiye Zou,&nbsp;Jingyu Wang,&nbsp;Shufan Zou,&nbsp;Laiping Zhang,&nbsp;Xiaogang Deng","doi":"10.1007/s10489-025-06479-1","DOIUrl":null,"url":null,"abstract":"<div><p>Natural physical phenomena are commonly expressed using partial differential equations (PDEs), in domains such as fluid dynamics, electromagnetism, and atmospheric science. These equations typically require numerical solutions under given boundary conditions. There is a burgeoning interest in the exploration of neural network methodologies for solving PDEs, mainly based on automatic differentiation methods to learn the PDE-solving process, which means that the model needs to be retrained when the boundary conditions of PDE are changed. However, automatic differentiation requires substantial memory resources to facilitate the training regimen. Moreover, a learning objective that is tailored to the solution process often lacks the flexibility to extend to boundary conditions; thereby limiting the solution’s overall precision. The method proposed in this paper introduces a graph neural network approach, embedded with physical information, mainly for solving Poisson’s equation. An approach is introduced that reduces memory usage and enhances training efficiency through an unsupervised learning methodology based on numerical differentiation. Concurrently, by integrating boundary conditions directly into the neural network as supplementary physical information, this approach ensures that a singular model is capable of solving PDEs across a variety of boundary conditions. To address the challenges posed by more complex network inputs, the introduction of graph residual connections serves as a strategic measure to prevent network overfitting and to elevate the accuracy of the solutions provided. Experimental findings reveal that, despite having 30 times more training parameters than the Physics-Informed Neural Networks (PINN) model, the proposed model consumes 2.2% less memory than PINN. Additionally, generalization in boundary conditions has been achieved to a certain extent. This enables the model to solve partial differential equations with different boundary conditions, a capability that PINN currently lacks. To validate the solving capability of the proposed method, it has been applied to the model equation, the Sod shock tube problem, and the two-dimensional inviscid airfoil problem. In terms of the solution accuracy of the model equations, the proposed method outperforms PINN by 30% to four orders of magnitude. Compared to the traditional numerical method, the Finite Element Method (FEM), the proposed method also shows an order of magnitude improvement. Additionally, when compared to the improved version of PINN, TSONN, our method demonstrates certain advantages. The forward problem of the Sod shock tube, which PINN is currently unable to solve, is successfully handled by the proposed method. For the airfoil problem, the results are comparable to those of PINN.</p></div>","PeriodicalId":8041,"journal":{"name":"Applied Intelligence","volume":"55 7","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2025-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Unsupervised learning with physics informed graph networks for partial differential equations\",\"authors\":\"Lin Lu,&nbsp;Yiye Zou,&nbsp;Jingyu Wang,&nbsp;Shufan Zou,&nbsp;Laiping Zhang,&nbsp;Xiaogang Deng\",\"doi\":\"10.1007/s10489-025-06479-1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Natural physical phenomena are commonly expressed using partial differential equations (PDEs), in domains such as fluid dynamics, electromagnetism, and atmospheric science. These equations typically require numerical solutions under given boundary conditions. There is a burgeoning interest in the exploration of neural network methodologies for solving PDEs, mainly based on automatic differentiation methods to learn the PDE-solving process, which means that the model needs to be retrained when the boundary conditions of PDE are changed. However, automatic differentiation requires substantial memory resources to facilitate the training regimen. Moreover, a learning objective that is tailored to the solution process often lacks the flexibility to extend to boundary conditions; thereby limiting the solution’s overall precision. The method proposed in this paper introduces a graph neural network approach, embedded with physical information, mainly for solving Poisson’s equation. An approach is introduced that reduces memory usage and enhances training efficiency through an unsupervised learning methodology based on numerical differentiation. Concurrently, by integrating boundary conditions directly into the neural network as supplementary physical information, this approach ensures that a singular model is capable of solving PDEs across a variety of boundary conditions. To address the challenges posed by more complex network inputs, the introduction of graph residual connections serves as a strategic measure to prevent network overfitting and to elevate the accuracy of the solutions provided. Experimental findings reveal that, despite having 30 times more training parameters than the Physics-Informed Neural Networks (PINN) model, the proposed model consumes 2.2% less memory than PINN. Additionally, generalization in boundary conditions has been achieved to a certain extent. This enables the model to solve partial differential equations with different boundary conditions, a capability that PINN currently lacks. To validate the solving capability of the proposed method, it has been applied to the model equation, the Sod shock tube problem, and the two-dimensional inviscid airfoil problem. In terms of the solution accuracy of the model equations, the proposed method outperforms PINN by 30% to four orders of magnitude. Compared to the traditional numerical method, the Finite Element Method (FEM), the proposed method also shows an order of magnitude improvement. Additionally, when compared to the improved version of PINN, TSONN, our method demonstrates certain advantages. The forward problem of the Sod shock tube, which PINN is currently unable to solve, is successfully handled by the proposed method. For the airfoil problem, the results are comparable to those of PINN.</p></div>\",\"PeriodicalId\":8041,\"journal\":{\"name\":\"Applied Intelligence\",\"volume\":\"55 7\",\"pages\":\"\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2025-04-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s10489-025-06479-1\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Intelligence","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s10489-025-06479-1","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

在流体动力学、电磁学和大气科学等领域,自然物理现象通常用偏微分方程(PDEs)来表示。这些方程通常需要在给定边界条件下的数值解。人们对求解偏微分方程的神经网络方法的探索兴趣日益浓厚,主要是基于自动微分方法来学习偏微分方程的求解过程,这意味着当偏微分方程的边界条件发生变化时,需要对模型进行重新训练。然而,自动区分需要大量的记忆资源来促进训练方案。此外,为解决过程量身定制的学习目标往往缺乏扩展到边界条件的灵活性;从而限制了解决方案的整体精度。本文提出了一种嵌入物理信息的图神经网络方法,主要用于求解泊松方程。介绍了一种基于数值微分的无监督学习方法,减少了内存的使用,提高了训练效率。同时,通过将边界条件作为补充物理信息直接集成到神经网络中,该方法确保了奇异模型能够跨越各种边界条件求解偏微分方程。为了解决更复杂的网络输入带来的挑战,引入图残差连接作为防止网络过拟合和提高所提供解决方案准确性的战略措施。实验结果表明,尽管该模型的训练参数比物理信息神经网络(PINN)模型多30倍,但其消耗的内存比PINN模型少2.2%。此外,在边界条件下也实现了一定的泛化。这使得模型能够求解具有不同边界条件的偏微分方程,这是目前PINN所缺乏的能力。为了验证该方法的求解能力,将其应用于模型方程、Sod激波管问题和二维无粘翼型问题。在模型方程的求解精度方面,所提方法比PINN算法高出30%至4个数量级。与传统的数值计算方法——有限元法(FEM)相比,所提出的方法也有了数量级的改进。此外,与改进版的PINN、TSONN相比,我们的方法显示出一定的优势。该方法成功地解决了目前PINN算法无法解决的Sod激波管的正向问题。对于翼型问题,结果是可比的那些PINN。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Unsupervised learning with physics informed graph networks for partial differential equations

Unsupervised learning with physics informed graph networks for partial differential equations

Natural physical phenomena are commonly expressed using partial differential equations (PDEs), in domains such as fluid dynamics, electromagnetism, and atmospheric science. These equations typically require numerical solutions under given boundary conditions. There is a burgeoning interest in the exploration of neural network methodologies for solving PDEs, mainly based on automatic differentiation methods to learn the PDE-solving process, which means that the model needs to be retrained when the boundary conditions of PDE are changed. However, automatic differentiation requires substantial memory resources to facilitate the training regimen. Moreover, a learning objective that is tailored to the solution process often lacks the flexibility to extend to boundary conditions; thereby limiting the solution’s overall precision. The method proposed in this paper introduces a graph neural network approach, embedded with physical information, mainly for solving Poisson’s equation. An approach is introduced that reduces memory usage and enhances training efficiency through an unsupervised learning methodology based on numerical differentiation. Concurrently, by integrating boundary conditions directly into the neural network as supplementary physical information, this approach ensures that a singular model is capable of solving PDEs across a variety of boundary conditions. To address the challenges posed by more complex network inputs, the introduction of graph residual connections serves as a strategic measure to prevent network overfitting and to elevate the accuracy of the solutions provided. Experimental findings reveal that, despite having 30 times more training parameters than the Physics-Informed Neural Networks (PINN) model, the proposed model consumes 2.2% less memory than PINN. Additionally, generalization in boundary conditions has been achieved to a certain extent. This enables the model to solve partial differential equations with different boundary conditions, a capability that PINN currently lacks. To validate the solving capability of the proposed method, it has been applied to the model equation, the Sod shock tube problem, and the two-dimensional inviscid airfoil problem. In terms of the solution accuracy of the model equations, the proposed method outperforms PINN by 30% to four orders of magnitude. Compared to the traditional numerical method, the Finite Element Method (FEM), the proposed method also shows an order of magnitude improvement. Additionally, when compared to the improved version of PINN, TSONN, our method demonstrates certain advantages. The forward problem of the Sod shock tube, which PINN is currently unable to solve, is successfully handled by the proposed method. For the airfoil problem, the results are comparable to those of PINN.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Applied Intelligence
Applied Intelligence 工程技术-计算机:人工智能
CiteScore
6.60
自引率
20.80%
发文量
1361
审稿时长
5.9 months
期刊介绍: With a focus on research in artificial intelligence and neural networks, this journal addresses issues involving solutions of real-life manufacturing, defense, management, government and industrial problems which are too complex to be solved through conventional approaches and require the simulation of intelligent thought processes, heuristics, applications of knowledge, and distributed and parallel processing. The integration of these multiple approaches in solving complex problems is of particular importance. The journal presents new and original research and technological developments, addressing real and complex issues applicable to difficult problems. It provides a medium for exchanging scientific research and technological achievements accomplished by the international community.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信