Interpreting Results from Statistical Hypothesis Testing: Understanding the Appropriate P-value.

Physical therapy research Pub Date : 2022-01-01 Epub Date: 2022-05-13 DOI:10.1298/ptr.R0019

Eiki Tsushima

{"title":"Interpreting Results from Statistical Hypothesis Testing: Understanding the Appropriate P-value.","authors":"Eiki Tsushima","doi":"10.1298/ptr.R0019","DOIUrl":null,"url":null,"abstract":"Clinical research based on epidemiological study designs requires a good understanding of statistical analysis. This paper discusses the common misconceptions of p-values so that researchers and readers of research papers will be able to properly present and understand the results of null hypothesis significance testing (NHST). The p-values calculated by NHST are categorized as three different types: \"significant at p <0.05,\" \"significant at p <0.01,\" or \"not significant.\" If specified, they may be written as p = 0.124. The 95% confidence interval (CI) of the supplementary statistics is presented regardless of the p-value, and the range of the CI is observed and discussed to determine whether the results are clinically valid. The effect size (ES), which is a measure of the magnitude of the effect, is also referenced and discussed. However, the ES should not be overestimated. It is important to examine the actual descriptive statistics and consider them comprehensively as much as possible. A high detection power of 80% or more indicates that NHST with high accuracy was applied. However, even when it falls below 80%, it is important to consider the limitations of the study, because the results are not completely useless.","PeriodicalId":74445,"journal":{"name":"Physical therapy research","volume":"25 2","pages":"49-55"},"PeriodicalIF":0.0000,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9437930/pdf/ptr-25-49.pdf","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physical therapy research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1298/ptr.R0019","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/5/13 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 1

Abstract

Clinical research based on epidemiological study designs requires a good understanding of statistical analysis. This paper discusses the common misconceptions of p-values so that researchers and readers of research papers will be able to properly present and understand the results of null hypothesis significance testing (NHST). The p-values calculated by NHST are categorized as three different types: "significant at p <0.05," "significant at p <0.01," or "not significant." If specified, they may be written as p = 0.124. The 95% confidence interval (CI) of the supplementary statistics is presented regardless of the p-value, and the range of the CI is observed and discussed to determine whether the results are clinically valid. The effect size (ES), which is a measure of the magnitude of the effect, is also referenced and discussed. However, the ES should not be overestimated. It is important to examine the actual descriptive statistics and consider them comprehensively as much as possible. A high detection power of 80% or more indicates that NHST with high accuracy was applied. However, even when it falls below 80%, it is important to consider the limitations of the study, because the results are not completely useless.

Abstract Image