What Sets Indexed Orthopaedic Journals Apart? A Comparative Analysis of Quality Metrics Between Indexed Orthopaedic Journals and Nonindexed Orthopaedic Journals.

Introduction: The PubMed database is used by many organizations as the benchmark for quality publications. This study aimed to identify quality metrics distinguishing orthopaedic journals indexed in PubMed from nonindexed journals. A second aim was to compare metrics of orthopaedic journals indexed in other major databases vs. nonindexed journals. We hypothesized that indexed orthopaedic journals would have several measurable attributes differentiating them from nonindexed journals.

Methods: A list of all current orthopaedic journals in publication in 2021 was compiled. The journals were characterized based on their index status in PubMed, Master Journal List, Journal Citation Reports (JCR), MEDLINE, or Directory of Open Access Journals. Various journal attributes were collected and compared by indexed status. Each variable's association with indexed journals was determined through statistical analysis.

Results: Of 478 evaluated journals, 271 were indexed by PubMed. Univariate analysis demonstrated significant associations between PubMed indexing and society affiliation, physician editorial leadership, print version availability, subscription availability, impact factor (IF) listed in JCR, use of Creative Commons licenses, Committee on Publication Ethics (COPE) membership, journals that require an article processing charge (APC), and earlier year of first issue (all with p < 0.001). Logistic regression of journals listed in any index demonstrates that COPE membership had the highest impact on indexed status (odds ratio = 34.19; 95% confidence interval 5.69-105.59; p < 0.001). The regression model also demonstrated that society affiliation, subscription availability, MD designation on website for editors, year of first issue, and number of physician editors have significant associations with indexed journals.

Conclusion: COPE membership was the most distinguishing characteristic of indexed orthopaedic journals. Physician editorial leadership and society affiliation were also strong predictors of a journal having an indexed status. In addition, having a print version and/or subscription available, use of Creative Commons licenses, higher IF, longer publication history, and higher APC charge were associated more frequently with indexed journals. Authors should consider these factors when submitting articles to a journal and use caution submitting to journals which do not meet these quality metrics.