Assessing adherence to TRIPOD+AI guidelines in machine learning models for predicting small for gestational age and fetal growth restriction: a systematic review

IF 3.6 2区 医学 Q1 OBSTETRICS & GYNECOLOGY
Giulia Zamagni MSc , Camilla Fregona MD , Moira Barbieri MD , Maria Sole Scalia MD , Lorenzo Monasta DSc , Christoph Lees MD, PhD , Tamara Stampalija MD, PhD , Giulia Barbati PhD
{"title":"Assessing adherence to TRIPOD+AI guidelines in machine learning models for predicting small for gestational age and fetal growth restriction: a systematic review","authors":"Giulia Zamagni MSc ,&nbsp;Camilla Fregona MD ,&nbsp;Moira Barbieri MD ,&nbsp;Maria Sole Scalia MD ,&nbsp;Lorenzo Monasta DSc ,&nbsp;Christoph Lees MD, PhD ,&nbsp;Tamara Stampalija MD, PhD ,&nbsp;Giulia Barbati PhD","doi":"10.1016/j.ajogmf.2025.101862","DOIUrl":null,"url":null,"abstract":"<div><h3>Objectives</h3><div>Fetal growth restriction (FGR) significantly contribute to perinatal morbidity, mortality, and long-term adverse health outcomes. While small for gestational age (SGA) is often used as a proxy for FGR, it does not necessarily indicate pathological growth restriction. Given the increasing interest in machine learning (ML) for predicting FGR/SGA, this study systematically reviews ML applications in this domain, evaluating their methodological rigor and reporting quality, following standardized guidelines.</div></div><div><h3>Data Sources</h3><div>The systematic search was conducted in MEDLINE and Scopus on June 21, 2024, following PRISMA 2020 guidelines.</div></div><div><h3>Study Eligibility Criteria</h3><div>Eligible studies implemented ML models for FGR/SGA prediction using routinely available clinical variables and reported at least one area under the receiver operating characteristic (AUROC) and/or accuracy. Exclusions included preprints, conference abstracts, systematic reviews, animal studies, and models relying exclusively on biomarkers or genomics, as not part of the clinical practice.</div></div><div><h3>Study Appraisal and Synthesis Methods</h3><div>Two independent reviewers screened articles with the help of the Rayyan software. Risk of bias was assessed using the PROBAST checklist. Adherence to the guidelines on the transparent reporting of a multivariable prediction model for individual prognosis or diagnosis+artificial intelligence (TRIPOD+AI) was evaluated across methods, results, and discussion sections using a 4-point Likert scale. Sample size adequacy was assessed for each study, accounting for outcome type, predictors, and outcome prevalence.</div></div><div><h3>Results</h3><div>The search identified 272 studies, with 20 meeting the inclusion criteria. Definitions of FGR/SGA were inconsistent, particularly in technical journals. Adherence to TRIPOD+AI guidelines was variable, as no model reported on fairness or heterogeneity across relevant subgroups, and only 15% reported on calibration. Only 30% of studies met the minimum sample size required for ML models, indicating potential overfitting and limited generalizability.</div></div><div><h3>Conclusion</h3><div>Despite the potential of ML models in predicting FGR/SGA, key limitations persist, including inconsistent outcome definitions, underpowered models, and suboptimal reporting of calibration and clinical applicability. Future studies should emphasize standardized definitions, robust sample sizes, and comprehensive reporting to enhance model reliability and clinical translation.</div></div><div><h3>Video Abstract</h3><div><span><span><span><span><video><source></source></video></span><span><span>Download: <span>Download video (4MB)</span></span></span></span><span><span><p><span>Video</span>. </p></span></span></span></span></div></div>","PeriodicalId":36186,"journal":{"name":"American Journal of Obstetrics & Gynecology Mfm","volume":"8 2","pages":"Article 101862"},"PeriodicalIF":3.6000,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American Journal of Obstetrics & Gynecology Mfm","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2589933325002605","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/11/28 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"OBSTETRICS & GYNECOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Objectives

Fetal growth restriction (FGR) significantly contribute to perinatal morbidity, mortality, and long-term adverse health outcomes. While small for gestational age (SGA) is often used as a proxy for FGR, it does not necessarily indicate pathological growth restriction. Given the increasing interest in machine learning (ML) for predicting FGR/SGA, this study systematically reviews ML applications in this domain, evaluating their methodological rigor and reporting quality, following standardized guidelines.

Data Sources

The systematic search was conducted in MEDLINE and Scopus on June 21, 2024, following PRISMA 2020 guidelines.

Study Eligibility Criteria

Eligible studies implemented ML models for FGR/SGA prediction using routinely available clinical variables and reported at least one area under the receiver operating characteristic (AUROC) and/or accuracy. Exclusions included preprints, conference abstracts, systematic reviews, animal studies, and models relying exclusively on biomarkers or genomics, as not part of the clinical practice.

Study Appraisal and Synthesis Methods

Two independent reviewers screened articles with the help of the Rayyan software. Risk of bias was assessed using the PROBAST checklist. Adherence to the guidelines on the transparent reporting of a multivariable prediction model for individual prognosis or diagnosis+artificial intelligence (TRIPOD+AI) was evaluated across methods, results, and discussion sections using a 4-point Likert scale. Sample size adequacy was assessed for each study, accounting for outcome type, predictors, and outcome prevalence.

Results

The search identified 272 studies, with 20 meeting the inclusion criteria. Definitions of FGR/SGA were inconsistent, particularly in technical journals. Adherence to TRIPOD+AI guidelines was variable, as no model reported on fairness or heterogeneity across relevant subgroups, and only 15% reported on calibration. Only 30% of studies met the minimum sample size required for ML models, indicating potential overfitting and limited generalizability.

Conclusion

Despite the potential of ML models in predicting FGR/SGA, key limitations persist, including inconsistent outcome definitions, underpowered models, and suboptimal reporting of calibration and clinical applicability. Future studies should emphasize standardized definitions, robust sample sizes, and comprehensive reporting to enhance model reliability and clinical translation.

Video Abstract

Download: Download video (4MB)

Video.

Abstract Image

评估在预测胎龄和胎儿生长受限的机器学习模型中对TRIPOD+AI指南的依从性:一项系统综述。
目的:胎儿生长受限(FGR)显著影响围产期发病率、死亡率和长期不良健康结果。虽然小胎龄(SGA)经常被用作FGR的替代指标,但它并不一定表明病理性生长受限。鉴于人们对预测FGR/SGA的机器学习(ML)越来越感兴趣,本研究系统地回顾了该领域的ML应用,评估了其方法的严谨性和报告质量,并遵循了标准化的指导方针。数据来源:按照PRISMA 2020指南,于2024年6月21日在MEDLINE和Scopus中进行系统检索。研究资格标准:符合条件的研究使用常规可用的临床变量实施ML模型进行FGR/SGA预测,并报告至少一个区域低于受试者操作特征(AUROC)和/或准确性。排除包括预印本、会议摘要、系统综述、动物研究和完全依赖生物标志物或基因组学的模型,而不是临床实践的一部分。研究评价和综合方法:两位独立审稿人在Rayyan软件的帮助下对文章进行筛选。使用PROBAST检查表评估偏倚风险。采用4点李克特量表对个体预后或诊断多变量预测模型透明报告指南 + 人工智能(TRIPOD+AI)的依从性进行了方法、结果和讨论部分的评估。对每项研究的样本量充分性进行评估,考虑结果类型、预测因素和结果患病率。结果:检索确定了272项研究,其中20项符合纳入标准。FGR/SGA的定义不一致,特别是在技术期刊上。对TRIPOD+AI指南的依从性是可变的,因为没有模型报告相关亚组的公平性或异质性,只有15%的模型报告了校准。只有30%的研究满足ML模型所需的最小样本量,表明潜在的过拟合和有限的推广能力。结论:尽管ML模型在预测FGR/SGA方面具有潜力,但主要的局限性仍然存在,包括结果定义不一致、模型功能不足、校准报告和临床适用性不理想。未来的研究应强调标准化的定义、稳健的样本量和全面的报告,以提高模型的可靠性和临床翻译。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
7.40
自引率
3.20%
发文量
254
审稿时长
40 days
期刊介绍: The American Journal of Obstetrics and Gynecology (AJOG) is a highly esteemed publication with two companion titles. One of these is the American Journal of Obstetrics and Gynecology Maternal-Fetal Medicine (AJOG MFM), which is dedicated to the latest research in the field of maternal-fetal medicine, specifically concerning high-risk pregnancies. The journal encompasses a wide range of topics, including: Maternal Complications: It addresses significant studies that have the potential to change clinical practice regarding complications faced by pregnant women. Fetal Complications: The journal covers prenatal diagnosis, ultrasound, and genetic issues related to the fetus, providing insights into the management and care of fetal health. Prenatal Care: It discusses the best practices in prenatal care to ensure the health and well-being of both the mother and the unborn child. Intrapartum Care: It provides guidance on the care provided during the childbirth process, which is critical for the safety of both mother and baby. Postpartum Issues: The journal also tackles issues that arise after childbirth, focusing on the postpartum period and its implications for maternal health. AJOG MFM serves as a reliable forum for peer-reviewed research, with a preference for randomized trials and meta-analyses. The goal is to equip researchers and clinicians with the most current information and evidence-based strategies to effectively manage high-risk pregnancies and to provide the best possible care for mothers and their unborn children.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书