ACOUSLIC-AI challenge report: Fetal abdominal circumference measurement on blind-sweep ultrasound data from low-income countries

Abstract

Fetal growth restriction, affecting up to 10% of pregnancies, is a critical factor contributing to perinatal mortality and morbidity. Ultrasound measurements of the fetal abdominal circumference (AC) are a key aspect of monitoring fetal growth. However, the routine practice of biometric obstetric ultrasounds is limited in low-resource settings due to the high cost of sonography equipment and the scarcity of trained sonographers. To address this issue, we organized the ACOUSLIC-AI (Abdominal Circumference Operator-agnostic UltraSound measurement in Low-Income Countries) challenge to investigate the feasibility of automatically estimating fetal AC from blind-sweep ultrasound scans acquired by novice operators using low-cost devices. Training data, collected from three Public Health Units (PHUs) in Sierra Leone are made publicly available. Private validation and test sets, containing data from two PHUs in Tanzania and a European hospital, are provided through the Grand-Challenge platform. All sets were annotated by experienced readers. Sixteen international teams participated in this challenge, with six teams submitting to the Final Test Phase. In this article, we present the results of the three top-performing AI models from the ACOUSLIC-AI challenge, which are publicly accessible. We evaluate their performance in fetal abdomen frame selection, segmentation, abdominal circumference measurement, and compare their performance against clinical standards for fetal AC measurement. Clinical comparisons demonstrated that the limits of agreement (LoA) for A2 in fetal AC measurements are comparable to the interobserver LoA reported in the literature. The algorithms developed as part of the ACOUSLIC-AI challenge provide a benchmark for future algorithms on the selection and segmentation of fetal abdomen frames to further minimize fetal abdominal circumference measurement variability.