{"title":"A New Method for Solving Nonlinear Partial Differential Equations Based on Liquid Time-Constant Networks","authors":"Jiuyun Sun, Huanhe Dong, Yong Fang","doi":"10.1007/s11424-024-3349-z","DOIUrl":"https://doi.org/10.1007/s11424-024-3349-z","url":null,"abstract":"<h3>Abstract</h3> <p>In this paper, physics-informed liquid networks (PILNs) are proposed based on liquid time-constant networks (LTC) for solving nonlinear partial differential equations (PDEs). In this approach, the network state is controlled via ordinary differential equations (ODEs). The significant advantage is that neurons controlled by ODEs are more expressive compared to simple activation functions. In addition, the PILNs use difference schemes instead of automatic differentiation to construct the residuals of PDEs, which avoid information loss in the neighborhood of sampling points. As this method draws on both the traveling wave method and physics-informed neural networks (PINNs), it has a better physical interpretation. Finally, the KdV equation and the nonlinear Schrödinger equation are solved to test the generalization ability of the PILNs. To the best of the authors’ knowledge, this is the first deep learning method that uses ODEs to simulate the numerical solutions of PDEs.</p>","PeriodicalId":50026,"journal":{"name":"Journal of Systems Science & Complexity","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139585303","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Number of Solitons Emerged in the Initial Profile of Shallow Water Using Convolutional Neural Networks","authors":"Zhen Wang, Shikun Cui","doi":"10.1007/s11424-024-3337-3","DOIUrl":"https://doi.org/10.1007/s11424-024-3337-3","url":null,"abstract":"<p>The soliton resolution conjecture proposes that the initial value problem can evolve into a dispersion part and a soliton part. However, the problem of determining the number of solitons that form in a given initial profile remains unsolved, except for a few specific cases. In this paper, the authors use the deep learning method to predict the number of solitons in a given initial value of the Korteweg-de Vries (KdV) equation. By leveraging the analytical relationship between Asech<sup>2</sup>(<i>x</i>) initial values and the number of solitons, the authors train a Convolutional Neural Network (CNN) that can accurately identify the soliton count from spatio-temporal data. The trained neural network is capable of predicting the number of solitons with other given initial values without any additional assistance. Through extensive calculations, the authors demonstrate the effectiveness and high performance of the proposed method.</p>","PeriodicalId":50026,"journal":{"name":"Journal of Systems Science & Complexity","volume":"148 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139585115","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Parallel Physics-Informed Neural Networks Method with Regularization Strategies for the Forward-Inverse Problems of the Variable Coefficient Modified KdV Equation","authors":"Huijuan Zhou","doi":"10.1007/s11424-024-3467-7","DOIUrl":"https://doi.org/10.1007/s11424-024-3467-7","url":null,"abstract":"<h3>Abstract</h3> <p>This paper mainly introduces the parallel physics-informed neural networks (PPINNs) method with regularization strategies to solve the data-driven forward-inverse problems of the variable coefficient modified Korteweg-de Vries (VC-MKdV) equation. For the forward problem of the VC-MKdV equation, the authors use the traditional PINN method to obtain satisfactory data-driven soliton solutions and provide a detailed analysis of the impact of network width and depth on solving accuracy and speed. Furthermore, the author finds that the traditional PINN method outperforms the one with locally adaptive activation functions in solving the data-driven forward problems of the VC-MKdV equation. As for the data-driven inverse problem of the VC-MKdV equation, the author introduces a parallel neural networks to separately train the solution function and coefficient function, successfully addressing the function discovery problem of the VC-MKdV equation. To further enhance the network’s generalization ability and noise robustness, the author incorporates two regularization strategies into the PPINNs. An amount of numerical experimental data in this paper demonstrates that the PPINNs method can effectively address the function discovery problem of the VC-MKdV equation, and the inclusion of appropriate regularization strategies in the PPINNs can improves its performance.</p>","PeriodicalId":50026,"journal":{"name":"Journal of Systems Science & Complexity","volume":"15 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139585373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Pre-Training Physics-Informed Neural Network with Mixed Sampling and Its Application in High-Dimensional Systems","authors":"Haiyi Liu, Yabin Zhang, Lei Wang","doi":"10.1007/s11424-024-3321-y","DOIUrl":"https://doi.org/10.1007/s11424-024-3321-y","url":null,"abstract":"<p>Recently, the physics-informed neural network shows remarkable ability in the context of solving the low-dimensional nonlinear partial differential equations. However, for some cases of high-dimensional systems, such technique may be time-consuming and inaccurate. In this paper, the authors put forward a pre-training physics-informed neural network with mixed sampling (pPINN) to address these issues. Just based on the initial and boundary conditions, the authors design the pre-training stage to filter out the set of the misfitting points, which is regarded as part of the training points in the next stage. The authors further take the parameters of the neural network in Stage 1 as the initialization in Stage 2. The advantage of the proposed approach is that it takes less time to transfer the valuable information from the first stage to the second one to improve the calculation accuracy, especially for the high-dimensional systems. To verify the performance of the pPINN algorithm, the authors first focus on the growing-and-decaying mode of line rogue wave in the Davey-Stewartson I equation. Another case is the accelerated motion of lump in the inhomogeneous Kadomtsev-Petviashvili equation, which admits a more complex evolution than the uniform equation. The exact solution provides a perfect sample for data experiments, and can also be used as a reference frame to identify the performance of the algorithm. The experiments confirm that the pPINN algorithm can improve the prediction accuracy and training efficiency well, and reduce the training time to a large extent for simulating nonlinear waves of high-dimensional equations.</p>","PeriodicalId":50026,"journal":{"name":"Journal of Systems Science & Complexity","volume":"3 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139585229","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Physics-Informed Neural Networks with Two Weighted Loss Function Methods for Interactions of Two-Dimensional Oceanic Internal Solitary Waves","authors":"Junchao Sun, Yong Chen, Xiaoyan Tang","doi":"10.1007/s11424-024-3500-x","DOIUrl":"https://doi.org/10.1007/s11424-024-3500-x","url":null,"abstract":"<p>The multiple patterns of internal solitary wave interactions (ISWI) are a complex oceanic phenomenon. Satellite remote sensing techniques indirectly detect these ISWI, but do not provide information on their detailed structure and dynamics. Recently, the authors considered a three-layer fluid with shear flow and developed a (2+1) Kadomtsev-Petviashvili (KP) model that is capable of describing five types of oceanic ISWI, including O-type, P-type, TO-type, TP-type, and Y-shaped. Deep learning models, particularly physics-informed neural networks (PINN), are widely used in the field of fluids and internal solitary waves. However, the authors find that the amplitude of internal solitary waves is much smaller than the wavelength and the ISWI occur at relatively large spatial scales, and these characteristics lead to an imbalance in the loss function of the PINN model. To solve this problem, the authors introduce two weighted loss function methods, the fixed weighing and the adaptive weighting methods, to improve the PINN model. This successfully simulated the detailed structure and dynamics of ISWI, with simulation results corresponding to the satellite images. In particular, the adaptive weighting method can automatically update the weights of different terms in the loss function and outperforms the fixed weighting method in terms of generalization ability.</p>","PeriodicalId":50026,"journal":{"name":"Journal of Systems Science & Complexity","volume":"148 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139585338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A New Random Sampling Method and Its Application in Improving Progressive BKZ Algorithm","authors":"Minghao Sun, Shixiong Wang, Hao Chen, Longjiang Qu","doi":"10.1007/s11424-023-3107-7","DOIUrl":"https://doi.org/10.1007/s11424-023-3107-7","url":null,"abstract":"","PeriodicalId":50026,"journal":{"name":"Journal of Systems Science & Complexity","volume":"6 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135113796","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A New Class of Strong Orthogonal Arrays of Strength Three","authors":"Chunyan Wang, Min-Qian Liu, Jinyu Yang","doi":"10.1007/s11424-023-3093-9","DOIUrl":"https://doi.org/10.1007/s11424-023-3093-9","url":null,"abstract":"","PeriodicalId":50026,"journal":{"name":"Journal of Systems Science & Complexity","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135112743","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fixed-Time Anti-Disturbance Average-Tracking for Multi-Agent Systems Without Velocity Measurements","authors":"Yuling Li, Chenglin Liu, Ya Zhang, Yangyang Chen","doi":"10.1007/s11424-023-2461-9","DOIUrl":"https://doi.org/10.1007/s11424-023-2461-9","url":null,"abstract":"","PeriodicalId":50026,"journal":{"name":"Journal of Systems Science & Complexity","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135510719","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Two-Stage Online Debiased Lasso Estimation and Inference for High-Dimensional Quantile Regression with Streaming Data","authors":"Yanjin Peng, Lei Wang","doi":"10.1007/s11424-023-3014-y","DOIUrl":"https://doi.org/10.1007/s11424-023-3014-y","url":null,"abstract":"","PeriodicalId":50026,"journal":{"name":"Journal of Systems Science & Complexity","volume":"27 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135510688","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Impact of General Correlation Under Multi-Period Mean-Variance Asset-Liability Portfolio Management","authors":"Xianping Wu, Weiping Wu, Yu Lin","doi":"10.1007/s11424-023-3019-6","DOIUrl":"https://doi.org/10.1007/s11424-023-3019-6","url":null,"abstract":"","PeriodicalId":50026,"journal":{"name":"Journal of Systems Science & Complexity","volume":"10 6","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135511369","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}