Positive Markov Jump Linear Systems

Abstract

This paper presents a comprehensive study of continuous-time Positive Markov Jump Linear Systems (PMJLS). A PMJLS can be seen as a dynamical system that switches within a finite set of linear timeinvariant subsystems according to a stochastic switching signal modeled as a Markov chain, and describes the time-evolution of nonnegative variables under nonnegative inputs. Contrary to the well-studied general class of Markov Jump Linear Systems (MJLS), positivity endows the model with peculiar properties. The paper collects some existing results together with original developments on the stability analysis of PMJLS and the study of their input-output properties. In particular, conditions for stability of PMJLS are discussed, mainly based on Linear Programming problems. Similar computational tools are derived to analyze performance measures, such as L1, L2 and L∞ costs and the respective input-output induced gains. The second part of the paper is devoted to the class of Dual switching Positive Markov Jump Linear Systems (D-PMJLS), namely PMJLS affected by an additional switching variable which can be either an unknown disturbance or a control signal available to the designer for stabilization and performance optimization. We discuss several problems, including stability, performance analysis, stabilization via switching control, and optimization. Some application examples are introduced to motivate the interest in PMJLS and D-PMJLS. P. Bolzern and P. Colaneri. Positive Markov Jump Linear Systems. Foundations and Trends © in Systems and Control, vol. 2, no. 3-4, pp. 275–427, 2015. DOI: 10.1561/2600000006. Full text available at: http://dx.doi.org/10.1561/2600000006