Robustness of Nomogram Versus Deep Learning Models for Hepatocarcinoma Grading: Insights From a Bilateral Cross-Center Validation.

IF 2.8 3区 医学 Q2 ACOUSTICS
Zhijin Zhao, Weibin Zhang, Yuli Zhu, Qihui Guo, Qi Zhang, Hong Ding
{"title":"Robustness of Nomogram Versus Deep Learning Models for Hepatocarcinoma Grading: Insights From a Bilateral Cross-Center Validation.","authors":"Zhijin Zhao, Weibin Zhang, Yuli Zhu, Qihui Guo, Qi Zhang, Hong Ding","doi":"10.1016/j.ultrasmedbio.2026.09.014","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>This study aimed to compare the performance of nomograms and deep learning (DL) models in predicting the pre-operative pathological grade of hepatocellular carcinoma (HCC) using clinical data and ultrasound images, with an emphasis on model robustness and generalizability across institutions.</p><p><strong>Methods: </strong>We retrospectively analyzed 2404 pre-operative ultrasound images from 601 patients with pathologically confirmed HCC across two medical centers. Two distinct modeling strategies were employed: two nomograms integrating ultrasound imaging features (B-mode and contrast-enhanced ultrasound [CEUS]) with clinical variables, and a series of DL models based on B-mode, CEUS at arterial phases, portal phases and delayed phases, and a combined B + CEUS modality. Independent predictors of pathological grade were identified using univariate, Least Absolute Shrinkage and Selection Operator and logistic regression and incorporated into the nomograms. To rigorously assess generalizability, bilateral training and a cross-center validation strategy were implemented: data from Center 1 were split 7:3 for training and internal validation, while all data from Center 2 served as an external test set. This process was reversed (i.e., training on Center 2 and testing on Center 1) to complete the bilateral cross-center validation. Model performance was evaluated using the area under the curve (AUC), calibration curves and decision curve analysis.</p><p><strong>Results: </strong>The nomograms demonstrated strong and consistent performance in predicting HCC pathological grade, with AUCs of 0.771 (internal validation) and 0.762 (external validation) when trained on Center 1 data, and AUCs of 0.814 (internal) and 0.818 (external) when trained on Center 2 data. In contrast, DL models showed high internal performance (AUCs: 0.632-0.809 for Center 1; 0.692-0.767 for Center 2) but experienced significant degradation on external validation (AUCs: 0.599-0.646 and 0.620-0.657, respectively).</p><p><strong>Conclusion: </strong>The nomogram exhibited superior robustness and generalizability compared to DL models in heterogeneous clinical populations. These findings highlight the practical advantage of interpretable statistical models in settings with variable data distributions and reinforce the value of feature-based approaches when data diversity is limited.</p>","PeriodicalId":49399,"journal":{"name":"Ultrasound in Medicine and Biology","volume":" ","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2026-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ultrasound in Medicine and Biology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.ultrasmedbio.2026.09.014","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ACOUSTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose: This study aimed to compare the performance of nomograms and deep learning (DL) models in predicting the pre-operative pathological grade of hepatocellular carcinoma (HCC) using clinical data and ultrasound images, with an emphasis on model robustness and generalizability across institutions.

Methods: We retrospectively analyzed 2404 pre-operative ultrasound images from 601 patients with pathologically confirmed HCC across two medical centers. Two distinct modeling strategies were employed: two nomograms integrating ultrasound imaging features (B-mode and contrast-enhanced ultrasound [CEUS]) with clinical variables, and a series of DL models based on B-mode, CEUS at arterial phases, portal phases and delayed phases, and a combined B + CEUS modality. Independent predictors of pathological grade were identified using univariate, Least Absolute Shrinkage and Selection Operator and logistic regression and incorporated into the nomograms. To rigorously assess generalizability, bilateral training and a cross-center validation strategy were implemented: data from Center 1 were split 7:3 for training and internal validation, while all data from Center 2 served as an external test set. This process was reversed (i.e., training on Center 2 and testing on Center 1) to complete the bilateral cross-center validation. Model performance was evaluated using the area under the curve (AUC), calibration curves and decision curve analysis.

Results: The nomograms demonstrated strong and consistent performance in predicting HCC pathological grade, with AUCs of 0.771 (internal validation) and 0.762 (external validation) when trained on Center 1 data, and AUCs of 0.814 (internal) and 0.818 (external) when trained on Center 2 data. In contrast, DL models showed high internal performance (AUCs: 0.632-0.809 for Center 1; 0.692-0.767 for Center 2) but experienced significant degradation on external validation (AUCs: 0.599-0.646 and 0.620-0.657, respectively).

Conclusion: The nomogram exhibited superior robustness and generalizability compared to DL models in heterogeneous clinical populations. These findings highlight the practical advantage of interpretable statistical models in settings with variable data distributions and reinforce the value of feature-based approaches when data diversity is limited.

Nomogram与深度学习模型在肝癌分级中的稳健性:来自双侧交叉中心验证的见解。
目的:本研究旨在比较nomogram和深度学习(DL)模型在利用临床数据和超声图像预测肝细胞癌(HCC)术前病理分级方面的表现,重点是模型的鲁棒性和跨机构的通用性。方法:我们回顾性分析两个医疗中心601例病理证实的HCC患者的2404张术前超声图像。采用了两种不同的建模策略:将超声成像特征(B超和增强超声[CEUS])与临床变量相结合的两种形态图,以及基于B超、动脉期、门脉期和延迟期CEUS的一系列DL模型,以及B + 复合CEUS模式。使用单变量、最小绝对收缩、选择算子和逻辑回归确定病理分级的独立预测因子,并将其纳入norm图。为了严格评估通用性,我们实施了双边训练和跨中心验证策略:来自中心1的数据被分割为7:3用于训练和内部验证,而来自中心2的所有数据作为外部测试集。这一过程被逆转(即,在中心2上进行训练,在中心1上进行测试)以完成双侧交叉中心验证。采用曲线下面积(AUC)、标定曲线和决策曲线分析对模型性能进行评价。结果:nomogram在预测HCC病理分级方面表现出强大而一致的性能,在中心1数据上训练的auc为0.771(内部验证)和0.762(外部验证),在中心2数据上训练的auc为0.814(内部)和0.818(外部)。相比之下,DL模型显示出较高的内部性能(中心1的auc: 0.632-0.809;中心2的auc: 0.692-0.767),但在外部验证上有明显的下降(auc: 0.599-0.646和0.620-0.657)。结论:在异质临床人群中,与DL模型相比,nomogram具有更强的稳健性和通用性。这些发现突出了可解释统计模型在可变数据分布环境中的实际优势,并在数据多样性有限时强化了基于特征的方法的价值。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
6.20
自引率
6.90%
发文量
325
审稿时长
70 days
期刊介绍: Ultrasound in Medicine and Biology is the official journal of the World Federation for Ultrasound in Medicine and Biology. The journal publishes original contributions that demonstrate a novel application of an existing ultrasound technology in clinical diagnostic, interventional and therapeutic applications, new and improved clinical techniques, the physics, engineering and technology of ultrasound in medicine and biology, and the interactions between ultrasound and biological systems, including bioeffects. Papers that simply utilize standard diagnostic ultrasound as a measuring tool will be considered out of scope. Extended critical reviews of subjects of contemporary interest in the field are also published, in addition to occasional editorial articles, clinical and technical notes, book reviews, letters to the editor and a calendar of forthcoming meetings. It is the aim of the journal fully to meet the information and publication requirements of the clinicians, scientists, engineers and other professionals who constitute the biomedical ultrasonic community.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书