Ziyang Zhang , Feifan Zhang , Weixi Gong , Tailai Chen , Luowei Tan , Heng Gui
{"title":"利用深度学习预测时空动态:长短期记忆耦合神经网络、自动编码器和物理信息神经网络","authors":"Ziyang Zhang , Feifan Zhang , Weixi Gong , Tailai Chen , Luowei Tan , Heng Gui","doi":"10.1016/j.physd.2024.134399","DOIUrl":null,"url":null,"abstract":"<div><div>Several classic reaction-diffusion models using partial differential equations (PDEs) have been established to elucidate the formation mechanism of vegetation patterns. However, predictive modeling of complex spatiotemporal dynamics using traditional numerical methods can be significantly challenging in many practical scenarios. Physics-Informed Neural Networks (PINNs) provide a new approach to predict the solution of PDEs. However, the generalization of PINNs is not satisfactory when pretrained PINNs is directly used in non-trained space (defined as explorations). This may be attributed to the lack of training in the time dimension. Therefore, a framework (LA-PINNs) is proposed to predict the evolutionary solution of the non-dimensional vegetation-sand model. The framework couples neural networks of Long-Short Terms Memory, Auto-Encoder and Physics-Informed Neural Networks. The predictions of LA-PINNs are much better than those of PINNs. Then we studied the effects of hyperparameters on the accuracy of predictions. Based on training in time dimension by LSTM module and pretraining for quick-training strategy, LA-PINNs can improve the accuracy of explorations.</div></div>","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":null,"pages":null},"PeriodicalIF":4.6000,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Prediction of spatiotemporal dynamics using deep learning: Coupled neural networks of long short-terms memory, auto-encoder and physics-informed neural networks\",\"authors\":\"Ziyang Zhang , Feifan Zhang , Weixi Gong , Tailai Chen , Luowei Tan , Heng Gui\",\"doi\":\"10.1016/j.physd.2024.134399\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Several classic reaction-diffusion models using partial differential equations (PDEs) have been established to elucidate the formation mechanism of vegetation patterns. However, predictive modeling of complex spatiotemporal dynamics using traditional numerical methods can be significantly challenging in many practical scenarios. Physics-Informed Neural Networks (PINNs) provide a new approach to predict the solution of PDEs. However, the generalization of PINNs is not satisfactory when pretrained PINNs is directly used in non-trained space (defined as explorations). This may be attributed to the lack of training in the time dimension. Therefore, a framework (LA-PINNs) is proposed to predict the evolutionary solution of the non-dimensional vegetation-sand model. The framework couples neural networks of Long-Short Terms Memory, Auto-Encoder and Physics-Informed Neural Networks. The predictions of LA-PINNs are much better than those of PINNs. Then we studied the effects of hyperparameters on the accuracy of predictions. Based on training in time dimension by LSTM module and pretraining for quick-training strategy, LA-PINNs can improve the accuracy of explorations.</div></div>\",\"PeriodicalId\":2,\"journal\":{\"name\":\"ACS Applied Bio Materials\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2024-10-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Applied Bio Materials\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S016727892400349X\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATERIALS SCIENCE, BIOMATERIALS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016727892400349X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
Prediction of spatiotemporal dynamics using deep learning: Coupled neural networks of long short-terms memory, auto-encoder and physics-informed neural networks
Several classic reaction-diffusion models using partial differential equations (PDEs) have been established to elucidate the formation mechanism of vegetation patterns. However, predictive modeling of complex spatiotemporal dynamics using traditional numerical methods can be significantly challenging in many practical scenarios. Physics-Informed Neural Networks (PINNs) provide a new approach to predict the solution of PDEs. However, the generalization of PINNs is not satisfactory when pretrained PINNs is directly used in non-trained space (defined as explorations). This may be attributed to the lack of training in the time dimension. Therefore, a framework (LA-PINNs) is proposed to predict the evolutionary solution of the non-dimensional vegetation-sand model. The framework couples neural networks of Long-Short Terms Memory, Auto-Encoder and Physics-Informed Neural Networks. The predictions of LA-PINNs are much better than those of PINNs. Then we studied the effects of hyperparameters on the accuracy of predictions. Based on training in time dimension by LSTM module and pretraining for quick-training strategy, LA-PINNs can improve the accuracy of explorations.