{"title":"State, parameters and hidden dynamics estimation with the Deep Kalman Filter: Regularization strategies","authors":"Erik Chinellato, Fabio Marcuzzi","doi":"10.1016/j.jocs.2025.102569","DOIUrl":null,"url":null,"abstract":"<div><div>In this paper we present in detail the various regularization strategies adopted for a novel scientific machine learning extension of the well known Kalman Filter (KF) that we call the Deep Kalman Filter (DKF), briefly presented in the conference paper (Chinellato and Marcuzzi 2024) . It is based on a recent scientific machine learning paradigm, called algorithm unfolding/unrolling, that allows to create a neural network from the algebraic structure dictated by an analytical method of scientific computing. We show the <em>interpretable consistency</em> of DKF with the classic KF when this is optimal, and its improvements against the KF with both linear and nonlinear models in general. Indeed, the DKF learns parameters of a quite general reference model, comprising: corrector gains, predictor model parameters and eventual unmodeled dynamics. This goes well beyond the ability of the KF and its known extensions.</div></div>","PeriodicalId":48907,"journal":{"name":"Journal of Computational Science","volume":"87 ","pages":"Article 102569"},"PeriodicalIF":3.1000,"publicationDate":"2025-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Computational Science","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1877750325000468","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
In this paper we present in detail the various regularization strategies adopted for a novel scientific machine learning extension of the well known Kalman Filter (KF) that we call the Deep Kalman Filter (DKF), briefly presented in the conference paper (Chinellato and Marcuzzi 2024) . It is based on a recent scientific machine learning paradigm, called algorithm unfolding/unrolling, that allows to create a neural network from the algebraic structure dictated by an analytical method of scientific computing. We show the interpretable consistency of DKF with the classic KF when this is optimal, and its improvements against the KF with both linear and nonlinear models in general. Indeed, the DKF learns parameters of a quite general reference model, comprising: corrector gains, predictor model parameters and eventual unmodeled dynamics. This goes well beyond the ability of the KF and its known extensions.
期刊介绍:
Computational Science is a rapidly growing multi- and interdisciplinary field that uses advanced computing and data analysis to understand and solve complex problems. It has reached a level of predictive capability that now firmly complements the traditional pillars of experimentation and theory.
The recent advances in experimental techniques such as detectors, on-line sensor networks and high-resolution imaging techniques, have opened up new windows into physical and biological processes at many levels of detail. The resulting data explosion allows for detailed data driven modeling and simulation.
This new discipline in science combines computational thinking, modern computational methods, devices and collateral technologies to address problems far beyond the scope of traditional numerical methods.
Computational science typically unifies three distinct elements:
• Modeling, Algorithms and Simulations (e.g. numerical and non-numerical, discrete and continuous);
• Software developed to solve science (e.g., biological, physical, and social), engineering, medicine, and humanities problems;
• Computer and information science that develops and optimizes the advanced system hardware, software, networking, and data management components (e.g. problem solving environments).