{"title":"用于减少非线性模型阶次的物理信息双层神经网络。","authors":"Yankun Hong, Harshit Bansal, Karen Veroy","doi":"10.1186/s40323-024-00273-3","DOIUrl":null,"url":null,"abstract":"<p><p>In recent years, machine learning (ML) has had a great impact in the area of non-intrusive, non-linear model order reduction (MOR). However, the offline training phase often still entails high computational costs since it requires numerous, expensive, full-order solutions as the training data. Furthermore, in state-of-the-art methods, neural networks trained by a small amount of training data cannot be expected to generalize sufficiently well, and the training phase often ignores the underlying physical information when it is applied with MOR. Moreover, state-of-the-art MOR techniques that ensure an efficient online stage, such as hyper reduction techniques, are either intrusive or entail high offline computational costs. To resolve these challenges, inspired by recent developments in physics-informed and physics-reinforced neural networks, we propose a non-intrusive, physics-informed, two-tier deep network (TTDN) method. The proposed network, in which the first tier achieves the regression of the unknown quantity of interest and the second tier rebuilds the physical constitutive law between the unknown quantities of interest and derived quantities, is trained using pretraining and semi-supervised learning strategies. To illustrate the efficiency of the proposed approach, we perform numerical experiments on challenging non-linear and non-affine problems, including multi-scale mechanics problems.</p>","PeriodicalId":37424,"journal":{"name":"Advanced Modeling and Simulation in Engineering Sciences","volume":"11 1","pages":"20"},"PeriodicalIF":2.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11564392/pdf/","citationCount":"0","resultStr":"{\"title\":\"Physics-informed two-tier neural network for non-linear model order reduction.\",\"authors\":\"Yankun Hong, Harshit Bansal, Karen Veroy\",\"doi\":\"10.1186/s40323-024-00273-3\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>In recent years, machine learning (ML) has had a great impact in the area of non-intrusive, non-linear model order reduction (MOR). However, the offline training phase often still entails high computational costs since it requires numerous, expensive, full-order solutions as the training data. Furthermore, in state-of-the-art methods, neural networks trained by a small amount of training data cannot be expected to generalize sufficiently well, and the training phase often ignores the underlying physical information when it is applied with MOR. Moreover, state-of-the-art MOR techniques that ensure an efficient online stage, such as hyper reduction techniques, are either intrusive or entail high offline computational costs. To resolve these challenges, inspired by recent developments in physics-informed and physics-reinforced neural networks, we propose a non-intrusive, physics-informed, two-tier deep network (TTDN) method. The proposed network, in which the first tier achieves the regression of the unknown quantity of interest and the second tier rebuilds the physical constitutive law between the unknown quantities of interest and derived quantities, is trained using pretraining and semi-supervised learning strategies. To illustrate the efficiency of the proposed approach, we perform numerical experiments on challenging non-linear and non-affine problems, including multi-scale mechanics problems.</p>\",\"PeriodicalId\":37424,\"journal\":{\"name\":\"Advanced Modeling and Simulation in Engineering Sciences\",\"volume\":\"11 1\",\"pages\":\"20\"},\"PeriodicalIF\":2.0000,\"publicationDate\":\"2024-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11564392/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced Modeling and Simulation in Engineering Sciences\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1186/s40323-024-00273-3\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/11/14 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"MECHANICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Modeling and Simulation in Engineering Sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/s40323-024-00273-3","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/11/14 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"MECHANICS","Score":null,"Total":0}
引用次数: 0
摘要
近年来,机器学习(ML)在非侵入式、非线性模型阶次缩减(MOR)领域产生了巨大影响。然而,离线训练阶段往往仍需要高昂的计算成本,因为它需要大量昂贵的全阶解决方案作为训练数据。此外,在最先进的方法中,通过少量训练数据训练出来的神经网络无法实现足够好的泛化,而且在使用 MOR 时,训练阶段往往会忽略潜在的物理信息。此外,确保高效在线阶段的最先进 MOR 技术(如超缩减技术)要么具有侵入性,要么需要高昂的离线计算成本。为了解决这些难题,受物理信息和物理强化神经网络最新发展的启发,我们提出了一种非侵入式、物理信息双层深度网络(TTDN)方法。所提议的网络中,第一层实现了相关未知量的回归,第二层重建了相关未知量与衍生量之间的物理构成规律,该网络采用预训练和半监督学习策略进行训练。为了说明所提方法的效率,我们对具有挑战性的非线性和非参数问题(包括多尺度力学问题)进行了数值实验。
Physics-informed two-tier neural network for non-linear model order reduction.
In recent years, machine learning (ML) has had a great impact in the area of non-intrusive, non-linear model order reduction (MOR). However, the offline training phase often still entails high computational costs since it requires numerous, expensive, full-order solutions as the training data. Furthermore, in state-of-the-art methods, neural networks trained by a small amount of training data cannot be expected to generalize sufficiently well, and the training phase often ignores the underlying physical information when it is applied with MOR. Moreover, state-of-the-art MOR techniques that ensure an efficient online stage, such as hyper reduction techniques, are either intrusive or entail high offline computational costs. To resolve these challenges, inspired by recent developments in physics-informed and physics-reinforced neural networks, we propose a non-intrusive, physics-informed, two-tier deep network (TTDN) method. The proposed network, in which the first tier achieves the regression of the unknown quantity of interest and the second tier rebuilds the physical constitutive law between the unknown quantities of interest and derived quantities, is trained using pretraining and semi-supervised learning strategies. To illustrate the efficiency of the proposed approach, we perform numerical experiments on challenging non-linear and non-affine problems, including multi-scale mechanics problems.
期刊介绍:
The research topics addressed by Advanced Modeling and Simulation in Engineering Sciences (AMSES) cover the vast domain of the advanced modeling and simulation of materials, processes and structures governed by the laws of mechanics. The emphasis is on advanced and innovative modeling approaches and numerical strategies. The main objective is to describe the actual physics of large mechanical systems with complicated geometries as accurately as possible using complex, highly nonlinear and coupled multiphysics and multiscale models, and then to carry out simulations with these complex models as rapidly as possible. In other words, this research revolves around efficient numerical modeling along with model verification and validation. Therefore, the corresponding papers deal with advanced modeling and simulation, efficient optimization, inverse analysis, data-driven computation and simulation-based control. These challenging issues require multidisciplinary efforts – particularly in modeling, numerical analysis and computer science – which are treated in this journal.