Leveraging Clinically Relevant Biometric Constraints to Supervise a Deep Learning Model for the Accurate Caliper Placement to Obtain Sonographic Measurements of the Fetal Brain
H. Shankar, Ashwin Narayan, S. Jain, D. Singh, P. Vyas, N. Hegde, P. Kar, A. Lad, J. Thang, J. Atada, D. Nguyen, PS Roopa, A. Vasudeva, P. Radhakrishnan, S. Devalla
{"title":"Leveraging Clinically Relevant Biometric Constraints to Supervise a Deep Learning Model for the Accurate Caliper Placement to Obtain Sonographic Measurements of the Fetal Brain","authors":"H. Shankar, Ashwin Narayan, S. Jain, D. Singh, P. Vyas, N. Hegde, P. Kar, A. Lad, J. Thang, J. Atada, D. Nguyen, PS Roopa, A. Vasudeva, P. Radhakrishnan, S. Devalla","doi":"10.1109/ISBI52829.2022.9761493","DOIUrl":null,"url":null,"abstract":"Multiple studies have demonstrated that obtaining standardized fetal brain biometry from mid-trimester ultrasonography (USG) examination is key for the reliable assessment of fetal neurodevelopment and the screening of central nervous system (CNS) anomalies. Obtaining these measurements is highly subjective, expertise-driven, and requires years of training experience, limiting quality prenatal care for all pregnant mothers. In this study, we propose a deep learning (DL) approach to compute 3 key fetal brain biometry from the 2D USG images of the transcerebellar plane (TC) through the accurate and automated caliper placement (2 per biometry) by modeling it as a landmark detection problem. We leveraged clinically relevant biometric constraints (relationship between caliper points) and domain-relevant data augmentation to improve the accuracy of a U-Net DL model (trained/tested on: 596 images, 473 subjects/143 images, 143 subjects). We performed multiple experiments demonstrating the effect of the DL backbone, data augmentation, generalizability and benchmarked against a recent state-of-the-art approach through extensive clinical validation (DL vs. 7 experienced clinicians). For all cases, the mean errors in the placement of the individual caliper points and the computed biometry were comparable to error rates among clinicians. The clinical translation of the proposed framework can assist novice users from low-resource settings in the reliable and standardized assessment of fetal brain sonograms.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"62 1","pages":"1-5"},"PeriodicalIF":0.0000,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISBI52829.2022.9761493","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Multiple studies have demonstrated that obtaining standardized fetal brain biometry from mid-trimester ultrasonography (USG) examination is key for the reliable assessment of fetal neurodevelopment and the screening of central nervous system (CNS) anomalies. Obtaining these measurements is highly subjective, expertise-driven, and requires years of training experience, limiting quality prenatal care for all pregnant mothers. In this study, we propose a deep learning (DL) approach to compute 3 key fetal brain biometry from the 2D USG images of the transcerebellar plane (TC) through the accurate and automated caliper placement (2 per biometry) by modeling it as a landmark detection problem. We leveraged clinically relevant biometric constraints (relationship between caliper points) and domain-relevant data augmentation to improve the accuracy of a U-Net DL model (trained/tested on: 596 images, 473 subjects/143 images, 143 subjects). We performed multiple experiments demonstrating the effect of the DL backbone, data augmentation, generalizability and benchmarked against a recent state-of-the-art approach through extensive clinical validation (DL vs. 7 experienced clinicians). For all cases, the mean errors in the placement of the individual caliper points and the computed biometry were comparable to error rates among clinicians. The clinical translation of the proposed framework can assist novice users from low-resource settings in the reliable and standardized assessment of fetal brain sonograms.
多项研究表明,通过妊娠中期超声检查获得标准化的胎儿脑生物特征是可靠评估胎儿神经发育和筛查中枢神经系统异常的关键。获得这些测量是高度主观的,专业知识驱动的,需要多年的培训经验,限制了所有孕妇的优质产前护理。在这项研究中,我们提出了一种深度学习(DL)方法,通过将其建模为一个地标检测问题,通过精确和自动的卡钳放置(每个生物测量2个),从经小脑平面(TC)的2D USG图像中计算3个关键的胎儿大脑生物特征。我们利用临床相关的生物特征约束(卡尺点之间的关系)和领域相关的数据增强来提高U-Net DL模型的准确性(训练/测试:596张图像,473名受试者/143张图像,143名受试者)。通过广泛的临床验证(DL vs. 7名经验丰富的临床医生),我们进行了多个实验,证明了DL主干、数据增强、可推广性的效果,并针对最新的最先进方法进行了基准测试。对于所有病例,卡钳点和计算生物计量的平均错误率与临床医生的错误率相当。该框架的临床翻译可以帮助来自低资源环境的新手用户对胎儿脑超声进行可靠和标准化的评估。