Richard E Donatelli, Ji-Ae Park, Yasser Murdi Abdullah Alghamdi, Nikolaos Pandis, Shin-Jae Lee
{"title":"Assessment of reliability in orthodontic literature.","authors":"Richard E Donatelli, Ji-Ae Park, Yasser Murdi Abdullah Alghamdi, Nikolaos Pandis, Shin-Jae Lee","doi":"10.2319/081021-625.1","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>To map the statistical methods applied to assess reliability in orthodontic publications and to identify possible trends over time.</p><p><strong>Materials and methods: </strong>Original research articles published in 2009 and 2019 in a subset of orthodontic journals were downloaded. Publication characteristics, including publication year, number of authors, single vs multicenter study, geographic origin of the study, statistician involvement, study category, subject category, types of reliability assessment, and statistical methods applied to assess reliability, were recorded. Descriptive statistics, Chi-square tests, and logistic regression analyses were performed to investigate associations between reliability analysis and study characteristics.</p><p><strong>Results: </strong>A total of 768 original research articles were analyzed. The most prevalent study category was observational (69%) with a statistician involved in 16% of studies. Overall, reliability was assessed in 47% of studies, and the most frequent methods applied to assess reliability were intraclass correlation coefficients or kappa statistics (60.4%). The odds of applying appropriate methods were greater in 2019 than in 2009 (odds ratio [OR]: 2.43; 95% confidence interval [CI]: 1.75, 3.37; P < .001). Involvement of a statistician resulted in greater odds of applying appropriate methods compared to no statistician involvement (OR: 1.88; 95% CI: 1.23, 2.87; P < .01).</p><p><strong>Conclusions: </strong>Over the past decade (2009 vs 2019), reliability assessment became more common in the orthodontic literature, and studies applying correct statistical methods to assess reliability significantly increased. This trend was more apparent in studies that involved a statistician, which may highlight the role of the statistician.</p>","PeriodicalId":50790,"journal":{"name":"Angle Orthodontist","volume":"92 3","pages":"409-414"},"PeriodicalIF":3.2000,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9020402/pdf/i1945-7103-92-3-409.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Angle Orthodontist","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2319/081021-625.1","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives: To map the statistical methods applied to assess reliability in orthodontic publications and to identify possible trends over time.
Materials and methods: Original research articles published in 2009 and 2019 in a subset of orthodontic journals were downloaded. Publication characteristics, including publication year, number of authors, single vs multicenter study, geographic origin of the study, statistician involvement, study category, subject category, types of reliability assessment, and statistical methods applied to assess reliability, were recorded. Descriptive statistics, Chi-square tests, and logistic regression analyses were performed to investigate associations between reliability analysis and study characteristics.
Results: A total of 768 original research articles were analyzed. The most prevalent study category was observational (69%) with a statistician involved in 16% of studies. Overall, reliability was assessed in 47% of studies, and the most frequent methods applied to assess reliability were intraclass correlation coefficients or kappa statistics (60.4%). The odds of applying appropriate methods were greater in 2019 than in 2009 (odds ratio [OR]: 2.43; 95% confidence interval [CI]: 1.75, 3.37; P < .001). Involvement of a statistician resulted in greater odds of applying appropriate methods compared to no statistician involvement (OR: 1.88; 95% CI: 1.23, 2.87; P < .01).
Conclusions: Over the past decade (2009 vs 2019), reliability assessment became more common in the orthodontic literature, and studies applying correct statistical methods to assess reliability significantly increased. This trend was more apparent in studies that involved a statistician, which may highlight the role of the statistician.
期刊介绍:
The Angle Orthodontist is the official publication of the Edward H. Angle Society of Orthodontists and is published bimonthly in January, March, May, July, September and November by The EH Angle Education and Research Foundation Inc.
The Angle Orthodontist is the only major journal in orthodontics with a non-commercial, non-profit publisher -- The E. H. Angle Education and Research Foundation. We value our freedom to operate exclusively in the best interests of our readers and authors. Our website www.angle.org is completely free and open to all visitors.