Hypothesis Tests and Corroboration

Abstract

According to Popper and other influential philosophers and scientists, scientific knowledge grows by repeatedly testing our best hypotheses. However, the interpretation of non-significant results—those that do not lead to a “rejection” of the tested hypothesis—poses a major philosophical challenge. To what extent do they corroborate the tested hypothesis or provide a reason to accept it? In this chapter, we prove two impossibility results for measures of corroboration that follow Popper’s criterion of measuring both predictive success and the testability of a hypothesis. Then we provide an axiomatic characterization of a more promising and scientifically useful concept of corroboration and discuss implications for the practice of hypothesis testing and the concept of statistical significance.