A Unifying Framework for Higher Order Derivatives of Matrix Functions

Abstract

SIAM Journal on Matrix Analysis and Applications, Volume 45, Issue 1, Page 504-528, March 2024.
Abstract. We present a theory for general partial derivatives of matrix functions of the form [math], where [math] is a matrix path of several variables ([math]). Building on results by Mathias [SIAM J. Matrix Anal. Appl., 17 (1996), pp. 610–620] for the first order derivative, we develop a block upper triangular form for higher order partial derivatives. This block form is used to derive conditions for existence and a generalized Daleckiĭ–Kreĭn formula for higher order derivatives. We show that certain specializations of this formula lead to classical formulas of quantum perturbation theory. We show how our results are related to earlier results for higher order Fréchet derivatives. Block forms of complex step approximations are introduced, and we show how those are related to evaluation of derivatives through the upper triangular form. These relations are illustrated with numerical examples.