Adjoint-Based Online Learning of Two-Layer Quasi-Geostrophic Baroclinic Turbulence

Abstract

For reasons of computational constraint, most global ocean circulation models used for Earth System Modeling still rely on parameterizations of sub-grid processes, and limitations in these parameterizations affect the modeled ocean circulation and impact on predictive skill. An increasingly popular approach is to leverage machine learning approaches for parameterizations, regressing for a map between the resolved state and missing feedbacks in a fluid system as a supervised learning task. However, the learning is often performed in an “offline” fashion, without involving the underlying fluid dynamical model during the training stage. Here, we explore “online” approaches that involve the fluid dynamical model during the training stage for the learning of baroclinic turbulence, with reference to ocean eddy parameterization. Two online approaches are considered: A full adjoint-based online approach, related to traditional adjoint optimization approaches that require a “differentiable” dynamical model, and an approximately online approach that approximates the adjoint calculation and does not require a differentiable dynamical model. The full online approach, without the need of additional constraints, is found to result in models that are generally more skillful. Other details relating to online training, such as window size, machine learning model set up and designs of the loss functions are detailed to aid in further explorations of the online training methodology for Earth System Modeling.