Julian Scherer, Andrei Joaquim, Alex Vaccaro, Rishi Kanna, Mohammad El-Sharkawi, Masahiko Takahata, Mohamed M Aly, Gaston Camino-Willhuber, Ulrich Spiegl, Cumhur Oner, Jose A Canseco, Ratko Yurac, Lorin Michael Benneker, Eugen Cezar Popescu, Richard Bransford, Harvinder Singh Chhabra, Frank Kandziora, Marko H Neva, Klaus John Schnake
{"title":"AO Spine-DGOU Osteoporotic Fracture Classification System: Internal Validation by the AO Spine Knowledge Forum Trauma.","authors":"Julian Scherer, Andrei Joaquim, Alex Vaccaro, Rishi Kanna, Mohammad El-Sharkawi, Masahiko Takahata, Mohamed M Aly, Gaston Camino-Willhuber, Ulrich Spiegl, Cumhur Oner, Jose A Canseco, Ratko Yurac, Lorin Michael Benneker, Eugen Cezar Popescu, Richard Bransford, Harvinder Singh Chhabra, Frank Kandziora, Marko H Neva, Klaus John Schnake","doi":"10.1177/21925682241288187","DOIUrl":null,"url":null,"abstract":"<p><strong>Study design: </strong>Cross-sectional survey.</p><p><strong>Objectives: </strong>Injury classifications are important tools to identify fracture patterns, guide treatment-decisions and aid to identify optimal treatment plans. The AO Spine-DGOU Osteoporotic Fracture (OF) classification system was developed, and the aim of this study was to assess the reliability of this new classification system.</p><p><strong>Methods: </strong>23 Members of the AO Spine Knowledge Forum Trauma participated in the validation process. Participants were asked to rate 33 cases according to the OF classification at 2 time points, 4 weeks apart (assessment 1 and 2). The kappa statistic (κ) was calculated to assess inter-observer reliability and intra-rater reproducibility. The gold master key for each case was determined by approval of at least 5 out of 7 members of the DGOU.</p><p><strong>Results: </strong>A total of 1386 ratings (21 raters) were performed. The overall inter-rater agreement was moderate with a combined kappa statistic for the OF classification of 0.496 in assessment 1 and 0.482 in assessment 2. The combined percentage of correct ratings (compared to gold-standard) in assessment 1 was 71.4% and 67.4% in assessment 2. The average intra-rater reproducibility was substantial (κ = 0.74, median 0.76, range 0.55 to 1.00, SD 0.13) for the assessed fracture types.</p><p><strong>Conclusions: </strong>The assessed overall inter-rater reliability was moderate and substantial in some instances. The average intra-rater reproducibility is substantial. It seems that appropriate training of the classification system can enhance inter- and intra-rater reliability.</p>","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":null,"pages":null},"PeriodicalIF":4.6000,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11559773/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/21925682241288187","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
引用次数: 0
Abstract
Study design: Cross-sectional survey.
Objectives: Injury classifications are important tools to identify fracture patterns, guide treatment-decisions and aid to identify optimal treatment plans. The AO Spine-DGOU Osteoporotic Fracture (OF) classification system was developed, and the aim of this study was to assess the reliability of this new classification system.
Methods: 23 Members of the AO Spine Knowledge Forum Trauma participated in the validation process. Participants were asked to rate 33 cases according to the OF classification at 2 time points, 4 weeks apart (assessment 1 and 2). The kappa statistic (κ) was calculated to assess inter-observer reliability and intra-rater reproducibility. The gold master key for each case was determined by approval of at least 5 out of 7 members of the DGOU.
Results: A total of 1386 ratings (21 raters) were performed. The overall inter-rater agreement was moderate with a combined kappa statistic for the OF classification of 0.496 in assessment 1 and 0.482 in assessment 2. The combined percentage of correct ratings (compared to gold-standard) in assessment 1 was 71.4% and 67.4% in assessment 2. The average intra-rater reproducibility was substantial (κ = 0.74, median 0.76, range 0.55 to 1.00, SD 0.13) for the assessed fracture types.
Conclusions: The assessed overall inter-rater reliability was moderate and substantial in some instances. The average intra-rater reproducibility is substantial. It seems that appropriate training of the classification system can enhance inter- and intra-rater reliability.