Exceptionality of the Variational Distance

Abstract

Csiszar f-divergences are an important class of distances for probability distributions. In particular, a well-known Csiszar f-divergence is the variational distance which is also a metric. Here, we prove that the variational distance is actually the unique Csiszar f-divergence which satisfies all metric conditions