Modeling fluid flow in heterogeneous porous media with physics-informed neural networks: Weighting strategies for the mixed pressure head-velocity formulation

Abstract

Physics-informed neural networks (PINNs) are receiving increased attention in modeling flow in porous media because they can surpass purely data-driven approaches. However, in heterogeneous domains, PINNs often face convergence challenges due to discontinuities in rock properties. A promising alternative is the mixed formulation of PINNs, which utilizes pressure head and velocity fields as primary variables. This formulation introduces a multi-term loss function whose terms must be carefully balanced to ensure effective convergence during training. The main goal of this work is to identify the most suitable weighting technique to overcome convergence issues and enhance the applicability of the mixed formulation of PINNs for modeling flow in heterogeneous porous media. Thus, we implement and adapt different global and local weighting techniques and evaluate their performance through multiple test scenarios, involving stochastic and block heterogeneity. The results reveal that the most appropriate weighting strategy is the max-average technique. In the case of stochastic heterogeneity, this technique allows for improving the convergence of the training algorithm. In the case of discontinuous heterogeneity, the max-average method is the only strategy that achieved convergence, highlighting its robustness. The results also show that under high heterogeneity, using an appropriate weighting technique becomes imperative because baseline PINN failed to converge. Implementing an optimal weighting strategy can improve convergence and yield accurate solutions with fewer learnable parameters, thereby enhancing overall model performance.