Yan Deng, Linlin Zheng, Min Zhang, Lilong Xu, Qiang Li, Ling Zhou, Qian Wang, Yuejiang Gong, Shiyan Li
{"title":"A Comparison of Different Radiomics Methods Predicting Cervical Lymph Node Metastasis in Papillary Thyroid Carcinoma.","authors":"Yan Deng, Linlin Zheng, Min Zhang, Lilong Xu, Qiang Li, Ling Zhou, Qian Wang, Yuejiang Gong, Shiyan Li","doi":"10.1002/jcu.70102","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>The preoperative identification of cervical lymph node metastasis in papillary thyroid carcinoma is essential in tailoring surgical treatment. We aim to develop an ultrasound-based handcrafted radiomics model, a deep learning radiomics model, and a combined model for better predicting cervical lymph node metastasis in papillary thyroid carcinoma patients.</p><p><strong>Methods: </strong>A retrospective cohort of 441 patients was included (308 in the training set, 133 in the testing set). Handcrafted radiomics features, manually selected by physicians, were extracted using Pyradiomics software, whereas deep learning radiomics features were extracted from a pretrained DenseNet121 network, a fully automatic process that eliminates the need for manual selection. A combined model integrating radiomics signatures from the above models was developed. ROC analysis was used to evaluate the performance of three models. DeLong's tests were conducted to compare the AUC values of the different models in the training and testing sets.</p><p><strong>Results: </strong>In the training set, the AUC value of the combined model (0.790) was significantly higher than that of the handcrafted radiomics (0.743, p = 0.021) and deep learning radiomics (0.730, p = 0.003) models. In the testing set, although the AUC value of the combined model (0.761) was higher than that of the handcrafted radiomics model (0.734, p = 0.368) and deep learning radiomics model (0.719, p = 0.228), statistical significance was not reached. The handcrafted radiomics model exhibited high accuracy in both the training and testing sets (0.714 and 0.707), while the deep learning radiomics model showed accuracy below 0.7 in both the training and testing sets (0.698 and 0.662).</p><p><strong>Conclusions: </strong>The combined model based on conventional ultrasound images enhances the predictive performance compared to different radiomics models alone.</p>","PeriodicalId":15386,"journal":{"name":"Journal of Clinical Ultrasound","volume":" ","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2025-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Clinical Ultrasound","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1002/jcu.70102","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ACOUSTICS","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives: The preoperative identification of cervical lymph node metastasis in papillary thyroid carcinoma is essential in tailoring surgical treatment. We aim to develop an ultrasound-based handcrafted radiomics model, a deep learning radiomics model, and a combined model for better predicting cervical lymph node metastasis in papillary thyroid carcinoma patients.
Methods: A retrospective cohort of 441 patients was included (308 in the training set, 133 in the testing set). Handcrafted radiomics features, manually selected by physicians, were extracted using Pyradiomics software, whereas deep learning radiomics features were extracted from a pretrained DenseNet121 network, a fully automatic process that eliminates the need for manual selection. A combined model integrating radiomics signatures from the above models was developed. ROC analysis was used to evaluate the performance of three models. DeLong's tests were conducted to compare the AUC values of the different models in the training and testing sets.
Results: In the training set, the AUC value of the combined model (0.790) was significantly higher than that of the handcrafted radiomics (0.743, p = 0.021) and deep learning radiomics (0.730, p = 0.003) models. In the testing set, although the AUC value of the combined model (0.761) was higher than that of the handcrafted radiomics model (0.734, p = 0.368) and deep learning radiomics model (0.719, p = 0.228), statistical significance was not reached. The handcrafted radiomics model exhibited high accuracy in both the training and testing sets (0.714 and 0.707), while the deep learning radiomics model showed accuracy below 0.7 in both the training and testing sets (0.698 and 0.662).
Conclusions: The combined model based on conventional ultrasound images enhances the predictive performance compared to different radiomics models alone.
期刊介绍:
The Journal of Clinical Ultrasound (JCU) is an international journal dedicated to the worldwide dissemination of scientific information on diagnostic and therapeutic applications of medical sonography.
The scope of the journal includes--but is not limited to--the following areas: sonography of the gastrointestinal tract, genitourinary tract, vascular system, nervous system, head and neck, chest, breast, musculoskeletal system, and other superficial structures; Doppler applications; obstetric and pediatric applications; and interventional sonography. Studies comparing sonography with other imaging modalities are encouraged, as are studies evaluating the economic impact of sonography. Also within the journal''s scope are innovations and improvements in instrumentation and examination techniques and the use of contrast agents.
JCU publishes original research articles, case reports, pictorial essays, technical notes, and letters to the editor. The journal is also dedicated to being an educational resource for its readers, through the publication of review articles and various scientific contributions from members of the editorial board and other world-renowned experts in sonography.