Frequency of statistical mistakes and associated article characteristics: a cross-sectional analysis of dermatology journals.

Abstract

Statistical mistakes can undermine research credibility. Identifying common errors may help researchers avoid them in future studies. This study evaluated the frequency and types of statistical mistakes in dermatology journal articles and identified article characteristics that predict these errors. A cross-sectional analysis was conducted on articles published in the 2023 volumes of 8 dermatology journals. Articles were screened for statistical tests, with a target sample of 200 selected pseudorandomly. Multivariable logistic regressions assessed predictors of statistical mistakes, including journal impact factor, statistician involvement, funding source, first author highest degree, and statistical package. Of the 189 articles analyzed, 78% contained at least one statistical mistake. Reporting mistakes were found in 67% and test selection errors in 46%. The absence of statistician involvement (aOR 2.49, P=0.03) and low journal impact factor (aOR 3.82, P=0.02) predicted the presence of at least one mistake. This sample from 8 journals is not representative of all dermatology literature. Original data were not available for testing of test assumptions, so appropriate test selection was determined using statistical conventions. Statistical mistakes are prevalent in dermatology literature. Researchers should review statistical best practices and consider involving a statistician in their work.