PTPI-DL-ROMs: Pre-trained physics-informed deep learning-based reduced order models for nonlinear parametrized PDEs

IF 6.9 1区 工程技术 Q1 ENGINEERING, MULTIDISCIPLINARY
Simone Brivio, Stefania Fresca, Andrea Manzoni
{"title":"PTPI-DL-ROMs: Pre-trained physics-informed deep learning-based reduced order models for nonlinear parametrized PDEs","authors":"Simone Brivio,&nbsp;Stefania Fresca,&nbsp;Andrea Manzoni","doi":"10.1016/j.cma.2024.117404","DOIUrl":null,"url":null,"abstract":"<div><div>Among several recently proposed data-driven Reduced Order Models (ROMs), the coupling of Proper Orthogonal Decompositions (POD) and deep learning-based ROMs (DL-ROMs) has proved to be a successful strategy to construct non-intrusive, highly accurate, surrogates for the <em>real time</em> solution of parametric nonlinear time-dependent PDEs. Inexpensive to evaluate, POD-DL-ROMs are also relatively fast to train, thanks to their limited complexity. However, POD-DL-ROMs account for the physical laws governing the problem at hand only through the training data, that are usually obtained through a full order model (FOM) relying on a high-fidelity discretization of the underlying equations. Moreover, the accuracy of POD-DL-ROMs strongly depends on the amount of available data. In this paper, we consider a major extension of POD-DL-ROMs by enforcing the fulfillment of the governing physical laws in the training process – that is, by making them physics-informed – to compensate for possible scarce and/or unavailable data and improve the overall reliability. To do that, we first complement POD-DL-ROMs with a <em>trunk net</em> architecture, endowing them with the ability to compute the problem’s solution at every point in the spatial domain, and ultimately enabling a seamless computation of the physics-based loss by means of the strong continuous formulation. Then, we introduce an efficient training strategy that limits the notorious computational burden entailed by a physics-informed training phase. In particular, we take advantage of the few available data to develop a low-cost pre-training procedure; then, we fine-tune the architecture in order to further improve the prediction reliability. Accuracy and efficiency of the resulting pre-trained physics-informed DL-ROMs (PTPI-DL-ROMs) are then assessed on a set of test cases ranging from non-affinely parametrized advection–diffusion–reaction equations, to nonlinear problems like the Navier–Stokes equations for fluid flows.</div></div>","PeriodicalId":55222,"journal":{"name":"Computer Methods in Applied Mechanics and Engineering","volume":"432 ","pages":"Article 117404"},"PeriodicalIF":6.9000,"publicationDate":"2024-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Methods in Applied Mechanics and Engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0045782524006595","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

Among several recently proposed data-driven Reduced Order Models (ROMs), the coupling of Proper Orthogonal Decompositions (POD) and deep learning-based ROMs (DL-ROMs) has proved to be a successful strategy to construct non-intrusive, highly accurate, surrogates for the real time solution of parametric nonlinear time-dependent PDEs. Inexpensive to evaluate, POD-DL-ROMs are also relatively fast to train, thanks to their limited complexity. However, POD-DL-ROMs account for the physical laws governing the problem at hand only through the training data, that are usually obtained through a full order model (FOM) relying on a high-fidelity discretization of the underlying equations. Moreover, the accuracy of POD-DL-ROMs strongly depends on the amount of available data. In this paper, we consider a major extension of POD-DL-ROMs by enforcing the fulfillment of the governing physical laws in the training process – that is, by making them physics-informed – to compensate for possible scarce and/or unavailable data and improve the overall reliability. To do that, we first complement POD-DL-ROMs with a trunk net architecture, endowing them with the ability to compute the problem’s solution at every point in the spatial domain, and ultimately enabling a seamless computation of the physics-based loss by means of the strong continuous formulation. Then, we introduce an efficient training strategy that limits the notorious computational burden entailed by a physics-informed training phase. In particular, we take advantage of the few available data to develop a low-cost pre-training procedure; then, we fine-tune the architecture in order to further improve the prediction reliability. Accuracy and efficiency of the resulting pre-trained physics-informed DL-ROMs (PTPI-DL-ROMs) are then assessed on a set of test cases ranging from non-affinely parametrized advection–diffusion–reaction equations, to nonlinear problems like the Navier–Stokes equations for fluid flows.
PTPI-DL-ROMs:预先训练的基于物理信息深度学习的非线性参数化 PDE 减阶模型
在最近提出的几种数据驱动的还原阶模型(ROM)中,适当正交分解(POD)与基于深度学习的还原阶模型(DL-ROM)的耦合已被证明是一种成功的策略,可以构建非侵入、高精度的代用模型,用于实时求解参数非线性时变 PDE。POD-DL-ROM 的评估成本低,由于其复杂性有限,因此训练速度也相对较快。不过,POD-DL-ROM 只能通过训练数据来解释当前问题的物理规律,而这些数据通常是通过全阶模型(FOM)获得的,依赖于对基础方程的高保真离散化。此外,POD-DL-ROM 的准确性在很大程度上取决于可用数据的数量。在本文中,我们将考虑对 POD-DL-ROMs 进行重大扩展,在训练过程中强制实现管理物理定律,即使其具有物理信息,以弥补可能的数据稀缺和/或不可用数据,并提高整体可靠性。为此,我们首先利用主干网架构对 POD-DL-ROM 进行补充,使其具备在空间域的每个点计算问题解决方案的能力,最终通过强连续公式实现基于物理损失的无缝计算。然后,我们引入了一种高效的训练策略,以限制物理信息训练阶段带来的众所周知的计算负担。特别是,我们利用为数不多的可用数据,开发了一种低成本的预训练程序;然后,我们对架构进行了微调,以进一步提高预测的可靠性。然后,我们在一组测试案例中评估了预训练的物理信息 DL-ROM (PTPI-DL-ROM)的准确性和效率,这些案例包括非参数化的平流-扩散-反应方程,以及流体流动的纳维-斯托克斯方程等非线性问题。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
12.70
自引率
15.30%
发文量
719
审稿时长
44 days
期刊介绍: Computer Methods in Applied Mechanics and Engineering stands as a cornerstone in the realm of computational science and engineering. With a history spanning over five decades, the journal has been a key platform for disseminating papers on advanced mathematical modeling and numerical solutions. Interdisciplinary in nature, these contributions encompass mechanics, mathematics, computer science, and various scientific disciplines. The journal welcomes a broad range of computational methods addressing the simulation, analysis, and design of complex physical problems, making it a vital resource for researchers in the field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信