Validating software metrics: producing quality discriminators

The author proposes a comprehensive metrics validation methodology that has six validation criteria, each of which supports certain quality functions. New criteria are defined and illustrated, including consistency, discrimination power, tracking, and repeatability. He shows that certain nonparametric statistical methods like contingency tables play an important role in evaluating metrics against the validity criteria. A detailed example emphasizing the discriminative power validity criterion is presented.<>