‘The effect is/isn’t significant!’: statistical evidence and ELT

Abstract

Statistical significance and averages are two pieces of statistical information that are often presented as evidence in support of researchers’ conclusions and teaching recommendations. In this article, I consider interpretation of this information as research evidence for ELT. In simple terms that will be accessible even to readers without any knowledge of statistics, I explain the basic nature of this information with the aim of elucidating what it can and cannot tell us about ELT findings and the implications for our teaching. I discuss what additional information crucially must be considered for adequate interpretation, and specifically how interpretation depends on this information. I urge producers of ELT research to present and interpret this important information and consumers of ELT research to consider it in assessing the implications of ELT findings for their teaching.