About Modifications of the Loss Function for the Causal Training of Physics-Informed Neural Networks

Abstract

A method is presented that allows to reduce a problem described by differential equations with initial and boundary conditions to a problem described only by differential equations which encapsulate initial and boundary conditions. It becomes possible to represent the loss function for physics-informed neural networks (PINNs) methodology in the form of a single term associated with modified differential equations. Thus eliminating the need to tune the scaling coefficients for the terms of loss function related to boundary and initial conditions. The weighted loss functions respecting causality were modified and new weighted loss functions, based on generalized functions, are derived. Numerical experiments have been carried out for a number of problems, demonstrating the accuracy of the proposed approaches. The neural network architecture was proposed for the Korteweg–De Vries equation, which is more relevant for this problem under consideration, and it demonstrates superior extrapolation of the solution in the space-time domain where training was not performed.