Eric H Lin, Brandon A Young, Cailan L Feingold, Edward Lee Major, Joseph N Liu, Austin V Stone
{"title":"Evaluating Quotation Accuracy in Shoulder and Elbow Literature.","authors":"Eric H Lin, Brandon A Young, Cailan L Feingold, Edward Lee Major, Joseph N Liu, Austin V Stone","doi":"10.1016/j.jse.2025.02.041","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Citations in studies provide recognition of existing ideas and knowledge in research. This study aims to evaluate the quotation accuracy of citations in the orthopedic shoulder and elbow literature in both subscription and open access journals.</p><p><strong>Methods: </strong>The Journal of Shoulder and Elbow Surgery (JSES) and JSES Open Access/International were queried for five published articles in each of the first issues of 2018, 2021, and 2024. Articles were excluded if they were systematic reviews, meta-analyses, editorial commentaries, or letters to the editor. Within the full-text of each article, two independent reviewers evaluated the accuracy of each in-text citation. Quotation inaccuracies were categorized into one of seven types of inaccuracies. Inter-rater reliability was measured using Cohen's kappa. A two-proportion z-test was used to compare inaccuracy rates between journals. Univariate linear regressions and analysis of variance (ANOVA) were used to compare inaccuracy rates and different study characteristics.</p><p><strong>Results: </strong>There were 433 cited studies and 715 in-text citations in the 15 JSES articles and 496 cited studies and 856 in-text citations in the JSES Open Access/International articles. Cohen's kappa was 0.79, which is substantial agreement. There were significantly fewer quotation errors in the subscription JSES than JSES Open Access/International (16.9% vs. 22.5%, z=-2.78, p=0.006). The overall combined quotation inaccuracy rate was 20.0% (314/1571). The most common types of inaccuracy were failure to support assertion (36.3%) and assertions unrelated to referenced articles (22.0%). There was no significant correlation between quotation inaccuracy rate and number of authors, year, and number of citations. There were significantly higher quotation inaccuracy rates in studies with better level of evidence (p=0.035).</p><p><strong>Conclusion: </strong>Quotation inaccuracies were higher in open access journals compared to subscription journals in orthopedic shoulder and elbow literature with no improvement with time. Both authors and journals should take care to evaluate citations to ensure accurate presentation of referenced literature.</p>","PeriodicalId":50051,"journal":{"name":"Journal of Shoulder and Elbow Surgery","volume":" ","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2025-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Shoulder and Elbow Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.jse.2025.02.041","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Citations in studies provide recognition of existing ideas and knowledge in research. This study aims to evaluate the quotation accuracy of citations in the orthopedic shoulder and elbow literature in both subscription and open access journals.
Methods: The Journal of Shoulder and Elbow Surgery (JSES) and JSES Open Access/International were queried for five published articles in each of the first issues of 2018, 2021, and 2024. Articles were excluded if they were systematic reviews, meta-analyses, editorial commentaries, or letters to the editor. Within the full-text of each article, two independent reviewers evaluated the accuracy of each in-text citation. Quotation inaccuracies were categorized into one of seven types of inaccuracies. Inter-rater reliability was measured using Cohen's kappa. A two-proportion z-test was used to compare inaccuracy rates between journals. Univariate linear regressions and analysis of variance (ANOVA) were used to compare inaccuracy rates and different study characteristics.
Results: There were 433 cited studies and 715 in-text citations in the 15 JSES articles and 496 cited studies and 856 in-text citations in the JSES Open Access/International articles. Cohen's kappa was 0.79, which is substantial agreement. There were significantly fewer quotation errors in the subscription JSES than JSES Open Access/International (16.9% vs. 22.5%, z=-2.78, p=0.006). The overall combined quotation inaccuracy rate was 20.0% (314/1571). The most common types of inaccuracy were failure to support assertion (36.3%) and assertions unrelated to referenced articles (22.0%). There was no significant correlation between quotation inaccuracy rate and number of authors, year, and number of citations. There were significantly higher quotation inaccuracy rates in studies with better level of evidence (p=0.035).
Conclusion: Quotation inaccuracies were higher in open access journals compared to subscription journals in orthopedic shoulder and elbow literature with no improvement with time. Both authors and journals should take care to evaluate citations to ensure accurate presentation of referenced literature.
期刊介绍：
The official publication for eight leading specialty organizations, this authoritative journal is the only publication to focus exclusively on medical, surgical, and physical techniques for treating injury/disease of the upper extremity, including the shoulder girdle, arm, and elbow. Clinically oriented and peer-reviewed, the Journal provides an international forum for the exchange of information on new techniques, instruments, and materials. Journal of Shoulder and Elbow Surgery features vivid photos, professional illustrations, and explicit diagrams that demonstrate surgical approaches and depict implant devices. Topics covered include fractures, dislocations, diseases and injuries of the rotator cuff, imaging techniques, arthritis, arthroscopy, arthroplasty, and rehabilitation.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
