Performance of two different artificial intelligence (AI) methods for assessing carpal bone age compared to the standard Greulich and Pyle method.

Abstract

Purpose: Evaluate the agreement between bone age assessments conducted by two distinct machine learning system and standard Greulich and Pyle method.

Materials and methods: Carpal radiographs of 225 patients (mean age 8 years and 10 months, SD = 3 years and 1 month) were retrospectively analysed at two separate institutions (October 2018 and May 2022) by both expert radiologists and radiologists in training as well as by two distinct AI software programmes, 16-bit AI^tm and BoneXpert® in a blinded manner.

Results: The bone age range estimated by the 16-bit AI^tm system in our sample varied between 1 year and 1 month and 15 years and 8 months (mean bone age 9 years and 5 months SD = 3 years and 3 months). BoneXpert® estimated bone age ranged between 8 months and 15 years and 7 months (mean bone age 8 years and 11 months SD = 3 years and 3 months). The average bone age estimated by the Greulich and Pyle method was between 11 months and 14 years, 9 months (mean bone age 8 years and 4 months SD = 3 years and 3 months). Radiologists' assessments using the Greulich and Pyle method were significantly correlated (Pearson's r > 0.80, p < 0.001). There was no statistical difference between BoneXpert® and 16-bit AI^tm (mean difference = - 0.19, 95%CI = (- 0.45; 0.08)), and the agreement between two measurements varies between - 3.45 (95%CI = (- 3.95; - 3.03) and 3.07 (95%CI - 3.03; 3.57).

Conclusions: Both AI methods and GP provide correlated results, although the measurements made by AI were closer to each other compared to the GP method.