Evolution of the level of evidence and impact factor for the journal OTSR (Orthopaedics & Traumatology: Surgery & Research), is it correlated?

Introduction: Orthopedics, traumatology, and surgery are constantly evolving disciplines that require high-quality scientific evidence to drive improvements. Two indicators can be used to assess the quality and impact of scientific publications: the level of evidence and the impact factor. However, the impact factor is an indicator that is widely criticized because it can be influenced and not be in agreement with the quality of the published article. The aim of this study were: 1) to evaluate, between 2010 and 2023, the evolution of the level of evidence of articles published in Orthopaedics & Traumatology: Surgery & Research (OTSR) journal, 2) to determine whether there is a correlation between this evolution and that of the journal's impact factor.

Hypotheses: The increase in the impact factor of OTSR in recent years was associated with an improvement in the level of evidence of the studies published, signifying a gain in scientific quality.

Methods: Retrospective study of articles published in OTSR between 2010 and 2023. The articles were extracted from the PubMed and Google Scholar databases. The papers included were separated in four subgroups according to following years: 2010-2011, 2015-2016, 2019-2020, and 2022-2023. For each article included, were collected: the number of authors and number of citations, the types of article and the methodological design and the level of evidence. The total number of articles published each year and the corresponding impact factor were also recorded. Letters, tributes, editorials, errors, and retractions of publication were excluded, as were articles published outside the target years. This study compared these data with the journal Impact Factor.

Results: The results show a significant increase in the number of articles (171 articles published in 2010 against 324 in 2023), an improvement in the average level of evidence (0.63% = 1/158 of level 1 or 2 articles published in 2010 compared to 1.98% = 6/303 of level 1 and 7.26% = 22/303 of level 2 published in 2023), as well as an increase in the impact factor of OTSR (0.5 in 2010 against 2.3 in 2023). A strong correlation between the two targeted indicators was identified (Rs= -0.98; p < 0.00)1, suggesting that improving the scientific quality of published articles contributes to enhancing the visibility and reputation of OTSR, suggesting that the improvement in the level of evidence of articles published in OTSR was associated with an increase in its impact factor.

Conclusion: The results obtained show a trend toward an improvement in the methodological quality of articles published in OTSR, as well as an increase in its impact factor, with a strong correlation between these two elements. In addition, the increase in the number of annual publications reflects a growing editorial dynamic in the field of orthopedics, which is essential for progress.

Level of evidence: IV; Original article Retrospective.