Training protocol and calibration of the International Caries Detection and Assessment System in a school-based clinical trial of elementary school-age children.
Jose-Miguel Yamal, Dania Mofleh, Ru-Jye Chuang, Mengxi Wang, Kila Johnson, Alejandra Garcia-Quintana, Tolulope Titiloye, Suchitra Nelson, Shreela V Sharma
{"title":"Training protocol and calibration of the International Caries Detection and Assessment System in a school-based clinical trial of elementary school-age children.","authors":"Jose-Miguel Yamal, Dania Mofleh, Ru-Jye Chuang, Mengxi Wang, Kila Johnson, Alejandra Garcia-Quintana, Tolulope Titiloye, Suchitra Nelson, Shreela V Sharma","doi":"10.1111/jphd.12648","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>This paper demonstrates International Caries Detection and Assessment System (ICDAS) training procedures and inter/intra-examiner reliability for lesion severity, activity, and filling criteria in an elementary school setting.</p><p><strong>Methods: </strong>ICDAS training was conducted in December 2021 prior to a school-based cluster-randomized controlled trial. A total of 59 children (6-8 years old) in grades 1-2 from one school in Houston, Texas were recruited. Two licensed dentists received a 5-day training from an ICDAS trainer at the participating school. Thirty-eight children were evaluated at least once by each dental trainee, and 18 had repeat examinations. The ICDAS criteria were used to classify dental caries lesion severity (0-6), lesion activity (active/inactive), and filling material (0-9) of all visually available primary and permanent tooth surfaces. Inter and intra-examiner reliability between each dental trainee and the \"gold standard\" trainer was evaluated using Kappa statistics.</p><p><strong>Results: </strong>For lesion severity, the examination indicated an inter-rater weighted Kappa of 0.77 (95% CI 0.71-0.82) and 0.82 (95% CI 0.77-0.87) for each trainee examiner compared to the gold standard examiner. The Kappas increased slightly from the first to second examinations (lesion-weighted Kappa: 0.76 to 0.84 and 0.82 to 0.84). The intra-rater reliability indicated excellent reliability for lesion and filling (0.83 to 0.94) and moderate for activity (0.58).</p><p><strong>Conclusions: </strong>ICDAS training/calibration were essential to ensure accuracy and reliability of dental caries measurements. The study demonstrated that ICDAS training of dentists with no prior criteria experience is feasible in a community setting and can lead to high reliability and repeatability.</p>","PeriodicalId":94108,"journal":{"name":"Journal of public health dentistry","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of public health dentistry","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1111/jphd.12648","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives: This paper demonstrates International Caries Detection and Assessment System (ICDAS) training procedures and inter/intra-examiner reliability for lesion severity, activity, and filling criteria in an elementary school setting.
Methods: ICDAS training was conducted in December 2021 prior to a school-based cluster-randomized controlled trial. A total of 59 children (6-8 years old) in grades 1-2 from one school in Houston, Texas were recruited. Two licensed dentists received a 5-day training from an ICDAS trainer at the participating school. Thirty-eight children were evaluated at least once by each dental trainee, and 18 had repeat examinations. The ICDAS criteria were used to classify dental caries lesion severity (0-6), lesion activity (active/inactive), and filling material (0-9) of all visually available primary and permanent tooth surfaces. Inter and intra-examiner reliability between each dental trainee and the "gold standard" trainer was evaluated using Kappa statistics.
Results: For lesion severity, the examination indicated an inter-rater weighted Kappa of 0.77 (95% CI 0.71-0.82) and 0.82 (95% CI 0.77-0.87) for each trainee examiner compared to the gold standard examiner. The Kappas increased slightly from the first to second examinations (lesion-weighted Kappa: 0.76 to 0.84 and 0.82 to 0.84). The intra-rater reliability indicated excellent reliability for lesion and filling (0.83 to 0.94) and moderate for activity (0.58).
Conclusions: ICDAS training/calibration were essential to ensure accuracy and reliability of dental caries measurements. The study demonstrated that ICDAS training of dentists with no prior criteria experience is feasible in a community setting and can lead to high reliability and repeatability.
目的:本文展示了国际龋齿检测和评估系统(ICDAS)的培训程序和检查人员之间/内部对小学环境中龋齿严重程度、活动性和填充标准的可靠性。方法:ICDAS培训于2021年12月在一项基于学校的集群随机对照试验之前进行。在德克萨斯州休斯顿的一所学校,共有59名1-2年级的儿童(6-8岁)被招募。两名持牌牙医在参与学校接受ICDAS培训师为期五天的培训。38名儿童由每位牙科实习生至少评估一次,18名进行了重复检查。采用ICDAS标准对所有肉眼可见的原牙和恒牙表面的龋损伤严重程度(0-6)、病变活动性(活跃/不活跃)和填充材料(0-9)进行分类。使用Kappa统计评估每位牙科学员与“金标准”培训师之间的审查员之间和审查员内部的信度。结果:对于病变严重程度,与金标准检查员相比,检查显示每个培训检查员的评分间加权Kappa为0.77 (95% CI 0.71-0.82)和0.82 (95% CI 0.77-0.87)。从第一次到第二次检查,Kappa略有增加(病变加权Kappa: 0.76至0.84,0.82至0.84)。内部信度显示病变和填充的信度良好(0.83 ~ 0.94),活动的信度中等(0.58)。结论:ICDAS培训/校准对确保龋病测量的准确性和可靠性至关重要。该研究表明,ICDAS培训没有先前标准经验的牙医在社区环境中是可行的,并且可以导致高可靠性和可重复性。