Comparison of Machine Learning Models Using Diffusion-Weighted Images for Pathological Grade of Intrahepatic Mass-Forming Cholangiocarcinoma

IF 2.9 2区 工程技术 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING
Li-Hong Xing, Shu-Ping Wang, Li-Yong Zhuo, Yu Zhang, Jia-Ning Wang, Ze-Peng Ma, Ying-Jia Zhao, Shuang-Rui Yuan, Qian-He Zu, Xiao-Ping Yin
{"title":"Comparison of Machine Learning Models Using Diffusion-Weighted Images for Pathological Grade of Intrahepatic Mass-Forming Cholangiocarcinoma","authors":"Li-Hong Xing, Shu-Ping Wang, Li-Yong Zhuo, Yu Zhang, Jia-Ning Wang, Ze-Peng Ma, Ying-Jia Zhao, Shuang-Rui Yuan, Qian-He Zu, Xiao-Ping Yin","doi":"10.1007/s10278-024-01103-z","DOIUrl":null,"url":null,"abstract":"<p>Is the radiomic approach, utilizing diffusion-weighted imaging (DWI), capable of predicting the various pathological grades of intrahepatic mass-forming cholangiocarcinoma (IMCC)? Furthermore, which model demonstrates superior performance among the diverse algorithms currently available? The objective of our study is to develop DWI radiomic models based on different machine learning algorithms and identify the optimal prediction model. We undertook a retrospective analysis of the DWI data of 77 patients with IMCC confirmed by pathological testing. Fifty-seven patients initially included in the study were randomly assigned to either the training set or the validation set in a ratio of 7:3. We established four different classifier models, namely random forest (RF), support vector machines (SVM), logistic regression (LR), and gradient boosting decision tree (GBDT), by manually contouring the region of interest and extracting prominent radiomic features. An external validation of the model was performed with the DWI data of 20 patients with IMCC who were subsequently included in the study. The area under the receiver operating curve (AUC), accuracy (ACC), precision (PRE), sensitivity (REC), and F1 score were used to evaluate the diagnostic performance of the model. Following the process of feature selection, a total of nine features were retained, with skewness being the most crucial radiomic feature demonstrating the highest diagnostic performance, followed by Gray Level Co-occurrence Matrix lmc1 (glcm-lmc1) and kurtosis, whose diagnostic performances were slightly inferior to skewness. Skewness and kurtosis showed a negative correlation with the pathological grading of IMCC, while glcm-lmc1 exhibited a positive correlation with the IMCC pathological grade. Compared with the other three models, the SVM radiomic model had the best diagnostic performance with an AUC of 0.957, an accuracy of 88.2%, a sensitivity of 85.7%, a precision of 85.7%, and an F1 score of 85.7% in the training set, as well as an AUC of 0.829, an accuracy of 76.5%, a sensitivity of 71.4%, a precision of 71.4%, and an F1 score of 71.4% in the external validation set. The DWI-based radiomic model proved to be efficacious in predicting the pathological grade of IMCC. The model with the SVM classifier algorithm had the best prediction efficiency and robustness. Consequently, this SVM-based model can be further explored as an option for a non-invasive preoperative prediction method in clinical practice.</p>","PeriodicalId":50214,"journal":{"name":"Journal of Digital Imaging","volume":"43 1","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Digital Imaging","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s10278-024-01103-z","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0

Abstract

Is the radiomic approach, utilizing diffusion-weighted imaging (DWI), capable of predicting the various pathological grades of intrahepatic mass-forming cholangiocarcinoma (IMCC)? Furthermore, which model demonstrates superior performance among the diverse algorithms currently available? The objective of our study is to develop DWI radiomic models based on different machine learning algorithms and identify the optimal prediction model. We undertook a retrospective analysis of the DWI data of 77 patients with IMCC confirmed by pathological testing. Fifty-seven patients initially included in the study were randomly assigned to either the training set or the validation set in a ratio of 7:3. We established four different classifier models, namely random forest (RF), support vector machines (SVM), logistic regression (LR), and gradient boosting decision tree (GBDT), by manually contouring the region of interest and extracting prominent radiomic features. An external validation of the model was performed with the DWI data of 20 patients with IMCC who were subsequently included in the study. The area under the receiver operating curve (AUC), accuracy (ACC), precision (PRE), sensitivity (REC), and F1 score were used to evaluate the diagnostic performance of the model. Following the process of feature selection, a total of nine features were retained, with skewness being the most crucial radiomic feature demonstrating the highest diagnostic performance, followed by Gray Level Co-occurrence Matrix lmc1 (glcm-lmc1) and kurtosis, whose diagnostic performances were slightly inferior to skewness. Skewness and kurtosis showed a negative correlation with the pathological grading of IMCC, while glcm-lmc1 exhibited a positive correlation with the IMCC pathological grade. Compared with the other three models, the SVM radiomic model had the best diagnostic performance with an AUC of 0.957, an accuracy of 88.2%, a sensitivity of 85.7%, a precision of 85.7%, and an F1 score of 85.7% in the training set, as well as an AUC of 0.829, an accuracy of 76.5%, a sensitivity of 71.4%, a precision of 71.4%, and an F1 score of 71.4% in the external validation set. The DWI-based radiomic model proved to be efficacious in predicting the pathological grade of IMCC. The model with the SVM classifier algorithm had the best prediction efficiency and robustness. Consequently, this SVM-based model can be further explored as an option for a non-invasive preoperative prediction method in clinical practice.

Abstract Image

使用弥散加权图像的机器学习模型对肝内肿块型胆管癌病理分级的比较
利用弥散加权成像(DWI)的放射学方法能否预测肝内肿块型胆管癌(IMCC)的各种病理分级?此外,在目前可用的各种算法中,哪种模型表现出更优越的性能?我们的研究目的是根据不同的机器学习算法开发 DWI 放射线组学模型,并确定最佳预测模型。我们对 77 例经病理检测确诊的 IMCC 患者的 DWI 数据进行了回顾性分析。最初纳入研究的 57 例患者按 7:3 的比例随机分配到训练集或验证集。我们建立了四种不同的分类器模型,即随机森林(RF)、支持向量机(SVM)、逻辑回归(LR)和梯度提升决策树(GBDT),方法是手动勾画感兴趣区轮廓并提取突出的放射学特征。随后,研究人员利用 20 名 IMCC 患者的 DWI 数据对模型进行了外部验证。接受者操作曲线下面积(AUC)、准确度(ACC)、精确度(PRE)、灵敏度(REC)和 F1 分数用于评估模型的诊断性能。经过特征选择,共保留了九个特征,其中偏度是最关键的放射学特征,具有最高的诊断性能,其次是灰度级共现矩阵 lmc1(glcm-lmc1)和峰度,其诊断性能略低于偏度。偏度和峰度与 IMCC 病理分级呈负相关,而 glcm-lmc1 与 IMCC 病理分级呈正相关。与其他三种模型相比,SVM放射学模型的诊断性能最好,训练集的AUC为0.957,准确率为88.2%,灵敏度为85.7%,精确度为85.7%,F1得分为85.7%;外部验证集的AUC为0.829,准确率为76.5%,灵敏度为71.4%,精确度为71.4%,F1得分为71.4%。事实证明,基于 DWI 的放射学模型能有效预测 IMCC 的病理分级。采用 SVM 分类器算法的模型具有最佳的预测效率和鲁棒性。因此,这种基于 SVM 的模型可作为临床实践中一种无创的术前预测方法进行进一步探索。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Digital Imaging
Journal of Digital Imaging 医学-核医学
CiteScore
7.50
自引率
6.80%
发文量
192
审稿时长
6-12 weeks
期刊介绍: The Journal of Digital Imaging (JDI) is the official peer-reviewed journal of the Society for Imaging Informatics in Medicine (SIIM). JDI’s goal is to enhance the exchange of knowledge encompassed by the general topic of Imaging Informatics in Medicine such as research and practice in clinical, engineering, and information technologies and techniques in all medical imaging environments. JDI topics are of interest to researchers, developers, educators, physicians, and imaging informatics professionals. Suggested Topics PACS and component systems; imaging informatics for the enterprise; image-enabled electronic medical records; RIS and HIS; digital image acquisition; image processing; image data compression; 3D, visualization, and multimedia; speech recognition; computer-aided diagnosis; facilities design; imaging vocabularies and ontologies; Transforming the Radiological Interpretation Process (TRIP™); DICOM and other standards; workflow and process modeling and simulation; quality assurance; archive integrity and security; teleradiology; digital mammography; and radiological informatics education.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信