Embedding of Markov matrices for d ⩽ 4.

The embedding problem of Markov matrices in Markov semigroups is a classic problem that regained a lot of impetus and activities through recent needs in phylogeny and population genetics. Here, we give an account for dimensions $d⩽4$ , including a complete and simplified treatment of the case $d=3$ , and derive the results in a systematic fashion, with an eye on the potential applications. Further, we reconsider the setup of the corresponding problem for time-inhomogeneous Markov chains, which is needed for real-world applications because transition rates need not be constant over time. Additional cases of this more general embedding occur for any $d⩾3$ . We review the known case of $d=3$ and describe the setting for future work on $d=4$ .