{"title":"液体傅立叶潜动力网络用于计算心脏病学中基于 GPU 的快速数值模拟","authors":"Matteo Salvador, Alison L. Marsden","doi":"arxiv-2408.09818","DOIUrl":null,"url":null,"abstract":"Scientific Machine Learning (ML) is gaining momentum as a cost-effective\nalternative to physics-based numerical solvers in many engineering\napplications. In fact, scientific ML is currently being used to build accurate\nand efficient surrogate models starting from high-fidelity numerical\nsimulations, effectively encoding the parameterized temporal dynamics\nunderlying Ordinary Differential Equations (ODEs), or even the spatio-temporal\nbehavior underlying Partial Differential Equations (PDEs), in appropriately\ndesigned neural networks. We propose an extension of Latent Dynamics Networks\n(LDNets), namely Liquid Fourier LDNets (LFLDNets), to create parameterized\nspace-time surrogate models for multiscale and multiphysics sets of highly\nnonlinear differential equations on complex geometries. LFLDNets employ a\nneurologically-inspired, sparse, liquid neural network for temporal dynamics,\nrelaxing the requirement of a numerical solver for time advancement and leading\nto superior performance in terms of tunable parameters, accuracy, efficiency\nand learned trajectories with respect to neural ODEs based on feedforward\nfully-connected neural networks. Furthermore, in our implementation of\nLFLDNets, we use a Fourier embedding with a tunable kernel in the\nreconstruction network to learn high-frequency functions better and faster than\nusing space coordinates directly as input. We challenge LFLDNets in the\nframework of computational cardiology and evaluate their capabilities on two\n3-dimensional test cases arising from multiscale cardiac electrophysiology and\ncardiovascular hemodynamics. This paper illustrates the capability to run\nArtificial Intelligence-based numerical simulations on single or multiple GPUs\nin a matter of minutes and represents a significant step forward in the\ndevelopment of physics-informed digital twins.","PeriodicalId":501347,"journal":{"name":"arXiv - CS - Neural and Evolutionary Computing","volume":"23 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Liquid Fourier Latent Dynamics Networks for fast GPU-based numerical simulations in computational cardiology\",\"authors\":\"Matteo Salvador, Alison L. Marsden\",\"doi\":\"arxiv-2408.09818\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Scientific Machine Learning (ML) is gaining momentum as a cost-effective\\nalternative to physics-based numerical solvers in many engineering\\napplications. In fact, scientific ML is currently being used to build accurate\\nand efficient surrogate models starting from high-fidelity numerical\\nsimulations, effectively encoding the parameterized temporal dynamics\\nunderlying Ordinary Differential Equations (ODEs), or even the spatio-temporal\\nbehavior underlying Partial Differential Equations (PDEs), in appropriately\\ndesigned neural networks. We propose an extension of Latent Dynamics Networks\\n(LDNets), namely Liquid Fourier LDNets (LFLDNets), to create parameterized\\nspace-time surrogate models for multiscale and multiphysics sets of highly\\nnonlinear differential equations on complex geometries. LFLDNets employ a\\nneurologically-inspired, sparse, liquid neural network for temporal dynamics,\\nrelaxing the requirement of a numerical solver for time advancement and leading\\nto superior performance in terms of tunable parameters, accuracy, efficiency\\nand learned trajectories with respect to neural ODEs based on feedforward\\nfully-connected neural networks. Furthermore, in our implementation of\\nLFLDNets, we use a Fourier embedding with a tunable kernel in the\\nreconstruction network to learn high-frequency functions better and faster than\\nusing space coordinates directly as input. We challenge LFLDNets in the\\nframework of computational cardiology and evaluate their capabilities on two\\n3-dimensional test cases arising from multiscale cardiac electrophysiology and\\ncardiovascular hemodynamics. This paper illustrates the capability to run\\nArtificial Intelligence-based numerical simulations on single or multiple GPUs\\nin a matter of minutes and represents a significant step forward in the\\ndevelopment of physics-informed digital twins.\",\"PeriodicalId\":501347,\"journal\":{\"name\":\"arXiv - CS - Neural and Evolutionary Computing\",\"volume\":\"23 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Neural and Evolutionary Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2408.09818\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Neural and Evolutionary Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.09818","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Liquid Fourier Latent Dynamics Networks for fast GPU-based numerical simulations in computational cardiology
Scientific Machine Learning (ML) is gaining momentum as a cost-effective
alternative to physics-based numerical solvers in many engineering
applications. In fact, scientific ML is currently being used to build accurate
and efficient surrogate models starting from high-fidelity numerical
simulations, effectively encoding the parameterized temporal dynamics
underlying Ordinary Differential Equations (ODEs), or even the spatio-temporal
behavior underlying Partial Differential Equations (PDEs), in appropriately
designed neural networks. We propose an extension of Latent Dynamics Networks
(LDNets), namely Liquid Fourier LDNets (LFLDNets), to create parameterized
space-time surrogate models for multiscale and multiphysics sets of highly
nonlinear differential equations on complex geometries. LFLDNets employ a
neurologically-inspired, sparse, liquid neural network for temporal dynamics,
relaxing the requirement of a numerical solver for time advancement and leading
to superior performance in terms of tunable parameters, accuracy, efficiency
and learned trajectories with respect to neural ODEs based on feedforward
fully-connected neural networks. Furthermore, in our implementation of
LFLDNets, we use a Fourier embedding with a tunable kernel in the
reconstruction network to learn high-frequency functions better and faster than
using space coordinates directly as input. We challenge LFLDNets in the
framework of computational cardiology and evaluate their capabilities on two
3-dimensional test cases arising from multiscale cardiac electrophysiology and
cardiovascular hemodynamics. This paper illustrates the capability to run
Artificial Intelligence-based numerical simulations on single or multiple GPUs
in a matter of minutes and represents a significant step forward in the
development of physics-informed digital twins.