Prediction of spatiotemporal dynamics using deep learning: Coupled neural networks of long short-terms memory, auto-encoder and physics-informed neural networks
Ziyang Zhang , Feifan Zhang , Weixi Gong , Tailai Chen , Luowei Tan , Heng Gui
{"title":"Prediction of spatiotemporal dynamics using deep learning: Coupled neural networks of long short-terms memory, auto-encoder and physics-informed neural networks","authors":"Ziyang Zhang , Feifan Zhang , Weixi Gong , Tailai Chen , Luowei Tan , Heng Gui","doi":"10.1016/j.physd.2024.134399","DOIUrl":null,"url":null,"abstract":"<div><div>Several classic reaction-diffusion models using partial differential equations (PDEs) have been established to elucidate the formation mechanism of vegetation patterns. However, predictive modeling of complex spatiotemporal dynamics using traditional numerical methods can be significantly challenging in many practical scenarios. Physics-Informed Neural Networks (PINNs) provide a new approach to predict the solution of PDEs. However, the generalization of PINNs is not satisfactory when pretrained PINNs is directly used in non-trained space (defined as explorations). This may be attributed to the lack of training in the time dimension. Therefore, a framework (LA-PINNs) is proposed to predict the evolutionary solution of the non-dimensional vegetation-sand model. The framework couples neural networks of Long-Short Terms Memory, Auto-Encoder and Physics-Informed Neural Networks. The predictions of LA-PINNs are much better than those of PINNs. Then we studied the effects of hyperparameters on the accuracy of predictions. Based on training in time dimension by LSTM module and pretraining for quick-training strategy, LA-PINNs can improve the accuracy of explorations.</div></div>","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":null,"pages":null},"PeriodicalIF":4.6000,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016727892400349X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
引用次数: 0
Abstract
Several classic reaction-diffusion models using partial differential equations (PDEs) have been established to elucidate the formation mechanism of vegetation patterns. However, predictive modeling of complex spatiotemporal dynamics using traditional numerical methods can be significantly challenging in many practical scenarios. Physics-Informed Neural Networks (PINNs) provide a new approach to predict the solution of PDEs. However, the generalization of PINNs is not satisfactory when pretrained PINNs is directly used in non-trained space (defined as explorations). This may be attributed to the lack of training in the time dimension. Therefore, a framework (LA-PINNs) is proposed to predict the evolutionary solution of the non-dimensional vegetation-sand model. The framework couples neural networks of Long-Short Terms Memory, Auto-Encoder and Physics-Informed Neural Networks. The predictions of LA-PINNs are much better than those of PINNs. Then we studied the effects of hyperparameters on the accuracy of predictions. Based on training in time dimension by LSTM module and pretraining for quick-training strategy, LA-PINNs can improve the accuracy of explorations.