Umar Hussain , Faizan Ul Hassan , Muhammad Abdullah Kamran , Abdullah A. Alnazeh , Imran Ullah , Shamsul Alam
{"title":"颈椎成熟分期的观察者间和观察者内一致性:系统回顾和荟萃分析","authors":"Umar Hussain , Faizan Ul Hassan , Muhammad Abdullah Kamran , Abdullah A. Alnazeh , Imran Ullah , Shamsul Alam","doi":"10.1016/j.ortho.2024.100874","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><p>The accurate assessment of active growth is pivotal for the correction of skeletal malocclusion in growing patients. Cervical vertebral maturation (CVM) staging is easy and devoid of unnecessary radiation, but its inter- and intra-observer agreement is still debatable.</p></div><div><h3>Objective</h3><p>This study aims to assess inter-observer (reliability) and intra-observer agreement (reproducibility) for CVM staging.</p></div><div><h3>Methods</h3><p>A comprehensive literature search across five databases up to October 2023 was conducted. Inclusion criteria comprised observational studies that specifically reported intra-rater, inter-rater, or both agreements as their primary objectives for cervical vertebral maturation (CVM) staging. Studies with a sample size exceeding 15 participants were considered for inclusion. After duplicate study selection, data extraction, and risk-of-bias assessment, random-effects meta-analyses of kappa (k)/correlation coefficient (r) and their 95% confidence intervals (CIs) were performed, followed by meta-regressions, sensitivity analyses, and subgroup analyses.</p></div><div><h3>Results</h3><p>Seventeen observational studies (comprising 1437 lateral cephalograms and 110 assessors) were included. The reliability (8 studies; k<!--> <!-->=<!--> <!-->0.62 [95% CI: 0.44, 0.78]) and reproducibility (9 studies; k<!--> <!-->=<!--> <!-->0.708 [95% CI: 0.59, 0.82]) were substantial. The inter-observer correlation was almost perfect (in 9 studies; r<!--> <!-->=<!--> <!-->0.86 [95% CI: 0.82, 0.89]) while intra-observer correlation was substantial (in 2 studies; r<!--> <!-->=<!--> <!-->0.75 [95% CI: 0.62, 0.84]). Tracing of lateral cephalograms significantly increased inter-observer reliability (β<!--> <!-->=<!--> <!-->0.29 [0.57, 0.0031]) but cropping and time of assessment (initial vs. follow-up) had no significant impact. The reliability (<em>P</em> <!--><<!--> <!-->0.001) and reproducibility (<em>P</em> <!-->=<!--> <!-->0.049) of high-quality studies were superior to those observed in low-quality studies.</p></div><div><h3>Conclusion</h3><p>Assessment of the CVM staging is accurate and reproducible to a satisfactory level. The accuracy and reproducibility of CVM are higher in studies utilizing traced cephalograms and those with a low-risk of bias.</p></div><div><h3>Registration</h3><p>PROSPERO registration (CRD42023468521).</p><p>Data is openly available at <span>https://doi.org/10.5281/zenodo.10599129</span><svg><path></path></svg>.</p></div>","PeriodicalId":45449,"journal":{"name":"International Orthodontics","volume":"22 3","pages":"Article 100874"},"PeriodicalIF":1.8000,"publicationDate":"2024-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Inter-observer and intra-observer agreement of cervical vertebral maturation staging: A systematic review and meta-analysis\",\"authors\":\"Umar Hussain , Faizan Ul Hassan , Muhammad Abdullah Kamran , Abdullah A. Alnazeh , Imran Ullah , Shamsul Alam\",\"doi\":\"10.1016/j.ortho.2024.100874\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Introduction</h3><p>The accurate assessment of active growth is pivotal for the correction of skeletal malocclusion in growing patients. Cervical vertebral maturation (CVM) staging is easy and devoid of unnecessary radiation, but its inter- and intra-observer agreement is still debatable.</p></div><div><h3>Objective</h3><p>This study aims to assess inter-observer (reliability) and intra-observer agreement (reproducibility) for CVM staging.</p></div><div><h3>Methods</h3><p>A comprehensive literature search across five databases up to October 2023 was conducted. Inclusion criteria comprised observational studies that specifically reported intra-rater, inter-rater, or both agreements as their primary objectives for cervical vertebral maturation (CVM) staging. Studies with a sample size exceeding 15 participants were considered for inclusion. After duplicate study selection, data extraction, and risk-of-bias assessment, random-effects meta-analyses of kappa (k)/correlation coefficient (r) and their 95% confidence intervals (CIs) were performed, followed by meta-regressions, sensitivity analyses, and subgroup analyses.</p></div><div><h3>Results</h3><p>Seventeen observational studies (comprising 1437 lateral cephalograms and 110 assessors) were included. The reliability (8 studies; k<!--> <!-->=<!--> <!-->0.62 [95% CI: 0.44, 0.78]) and reproducibility (9 studies; k<!--> <!-->=<!--> <!-->0.708 [95% CI: 0.59, 0.82]) were substantial. The inter-observer correlation was almost perfect (in 9 studies; r<!--> <!-->=<!--> <!-->0.86 [95% CI: 0.82, 0.89]) while intra-observer correlation was substantial (in 2 studies; r<!--> <!-->=<!--> <!-->0.75 [95% CI: 0.62, 0.84]). Tracing of lateral cephalograms significantly increased inter-observer reliability (β<!--> <!-->=<!--> <!-->0.29 [0.57, 0.0031]) but cropping and time of assessment (initial vs. follow-up) had no significant impact. The reliability (<em>P</em> <!--><<!--> <!-->0.001) and reproducibility (<em>P</em> <!-->=<!--> <!-->0.049) of high-quality studies were superior to those observed in low-quality studies.</p></div><div><h3>Conclusion</h3><p>Assessment of the CVM staging is accurate and reproducible to a satisfactory level. The accuracy and reproducibility of CVM are higher in studies utilizing traced cephalograms and those with a low-risk of bias.</p></div><div><h3>Registration</h3><p>PROSPERO registration (CRD42023468521).</p><p>Data is openly available at <span>https://doi.org/10.5281/zenodo.10599129</span><svg><path></path></svg>.</p></div>\",\"PeriodicalId\":45449,\"journal\":{\"name\":\"International Orthodontics\",\"volume\":\"22 3\",\"pages\":\"Article 100874\"},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2024-04-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Orthodontics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1761722724000305\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"DENTISTRY, ORAL SURGERY & MEDICINE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Orthodontics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1761722724000305","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
Inter-observer and intra-observer agreement of cervical vertebral maturation staging: A systematic review and meta-analysis
Introduction
The accurate assessment of active growth is pivotal for the correction of skeletal malocclusion in growing patients. Cervical vertebral maturation (CVM) staging is easy and devoid of unnecessary radiation, but its inter- and intra-observer agreement is still debatable.
Objective
This study aims to assess inter-observer (reliability) and intra-observer agreement (reproducibility) for CVM staging.
Methods
A comprehensive literature search across five databases up to October 2023 was conducted. Inclusion criteria comprised observational studies that specifically reported intra-rater, inter-rater, or both agreements as their primary objectives for cervical vertebral maturation (CVM) staging. Studies with a sample size exceeding 15 participants were considered for inclusion. After duplicate study selection, data extraction, and risk-of-bias assessment, random-effects meta-analyses of kappa (k)/correlation coefficient (r) and their 95% confidence intervals (CIs) were performed, followed by meta-regressions, sensitivity analyses, and subgroup analyses.
Results
Seventeen observational studies (comprising 1437 lateral cephalograms and 110 assessors) were included. The reliability (8 studies; k = 0.62 [95% CI: 0.44, 0.78]) and reproducibility (9 studies; k = 0.708 [95% CI: 0.59, 0.82]) were substantial. The inter-observer correlation was almost perfect (in 9 studies; r = 0.86 [95% CI: 0.82, 0.89]) while intra-observer correlation was substantial (in 2 studies; r = 0.75 [95% CI: 0.62, 0.84]). Tracing of lateral cephalograms significantly increased inter-observer reliability (β = 0.29 [0.57, 0.0031]) but cropping and time of assessment (initial vs. follow-up) had no significant impact. The reliability (P < 0.001) and reproducibility (P = 0.049) of high-quality studies were superior to those observed in low-quality studies.
Conclusion
Assessment of the CVM staging is accurate and reproducible to a satisfactory level. The accuracy and reproducibility of CVM are higher in studies utilizing traced cephalograms and those with a low-risk of bias.
Registration
PROSPERO registration (CRD42023468521).
Data is openly available at https://doi.org/10.5281/zenodo.10599129.
期刊介绍:
Une revue de référence dans le domaine de orthodontie et des disciplines frontières Your reference in dentofacial orthopedics International Orthodontics adresse aux orthodontistes, aux dentistes, aux stomatologistes, aux chirurgiens maxillo-faciaux et aux plasticiens de la face, ainsi quà leurs assistant(e)s. International Orthodontics is addressed to orthodontists, dentists, stomatologists, maxillofacial surgeons and facial plastic surgeons, as well as their assistants.