{"title":"Liquid Fourier Latent Dynamics Networks for fast GPU-based numerical simulations in computational cardiology","authors":"Matteo Salvador, Alison L. Marsden","doi":"arxiv-2408.09818","DOIUrl":null,"url":null,"abstract":"Scientific Machine Learning (ML) is gaining momentum as a cost-effective\nalternative to physics-based numerical solvers in many engineering\napplications. In fact, scientific ML is currently being used to build accurate\nand efficient surrogate models starting from high-fidelity numerical\nsimulations, effectively encoding the parameterized temporal dynamics\nunderlying Ordinary Differential Equations (ODEs), or even the spatio-temporal\nbehavior underlying Partial Differential Equations (PDEs), in appropriately\ndesigned neural networks. We propose an extension of Latent Dynamics Networks\n(LDNets), namely Liquid Fourier LDNets (LFLDNets), to create parameterized\nspace-time surrogate models for multiscale and multiphysics sets of highly\nnonlinear differential equations on complex geometries. LFLDNets employ a\nneurologically-inspired, sparse, liquid neural network for temporal dynamics,\nrelaxing the requirement of a numerical solver for time advancement and leading\nto superior performance in terms of tunable parameters, accuracy, efficiency\nand learned trajectories with respect to neural ODEs based on feedforward\nfully-connected neural networks. Furthermore, in our implementation of\nLFLDNets, we use a Fourier embedding with a tunable kernel in the\nreconstruction network to learn high-frequency functions better and faster than\nusing space coordinates directly as input. We challenge LFLDNets in the\nframework of computational cardiology and evaluate their capabilities on two\n3-dimensional test cases arising from multiscale cardiac electrophysiology and\ncardiovascular hemodynamics. This paper illustrates the capability to run\nArtificial Intelligence-based numerical simulations on single or multiple GPUs\nin a matter of minutes and represents a significant step forward in the\ndevelopment of physics-informed digital twins.","PeriodicalId":501347,"journal":{"name":"arXiv - CS - Neural and Evolutionary Computing","volume":"23 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Neural and Evolutionary Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.09818","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Scientific Machine Learning (ML) is gaining momentum as a cost-effective
alternative to physics-based numerical solvers in many engineering
applications. In fact, scientific ML is currently being used to build accurate
and efficient surrogate models starting from high-fidelity numerical
simulations, effectively encoding the parameterized temporal dynamics
underlying Ordinary Differential Equations (ODEs), or even the spatio-temporal
behavior underlying Partial Differential Equations (PDEs), in appropriately
designed neural networks. We propose an extension of Latent Dynamics Networks
(LDNets), namely Liquid Fourier LDNets (LFLDNets), to create parameterized
space-time surrogate models for multiscale and multiphysics sets of highly
nonlinear differential equations on complex geometries. LFLDNets employ a
neurologically-inspired, sparse, liquid neural network for temporal dynamics,
relaxing the requirement of a numerical solver for time advancement and leading
to superior performance in terms of tunable parameters, accuracy, efficiency
and learned trajectories with respect to neural ODEs based on feedforward
fully-connected neural networks. Furthermore, in our implementation of
LFLDNets, we use a Fourier embedding with a tunable kernel in the
reconstruction network to learn high-frequency functions better and faster than
using space coordinates directly as input. We challenge LFLDNets in the
framework of computational cardiology and evaluate their capabilities on two
3-dimensional test cases arising from multiscale cardiac electrophysiology and
cardiovascular hemodynamics. This paper illustrates the capability to run
Artificial Intelligence-based numerical simulations on single or multiple GPUs
in a matter of minutes and represents a significant step forward in the
development of physics-informed digital twins.