Jie Shan MD , Yifei Yang MD , Hualian Liu PhD , Zhaoyao Sun PhD , Mingming Chen MD , Zhichao Zhu MD
{"title":"机器学习利用对比度增强超声波特征区分良性和恶性腮腺肿瘤","authors":"Jie Shan MD , Yifei Yang MD , Hualian Liu PhD , Zhaoyao Sun PhD , Mingming Chen MD , Zhichao Zhu MD","doi":"10.1016/j.joms.2024.10.018","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>Contrast-enhanced ultrasound (CEUS) is frequently used to distinguish benign parotid tumors (BPTs) from malignant parotid tumors (MPTs). Introducing machine learning may enable clinicians to preoperatively diagnose parotid tumors precisely.</div></div><div><h3>Purpose</h3><div>We aimed to estimate the diagnostic capability of machine learning in differentiating BPTs from MPTs.</div></div><div><h3>Study Design, Setting, and Sample</h3><div>A retrospective cohort study was conducted at the Third Affiliated Hospital of Soochow University. Patients who underwent parotidectomy and CEUS for untreated parotid tumors were included. Patients with recurrent tumors, inadequate specimens, or chemoradiotherapy were excluded.</div></div><div><h3>Predictor Variable</h3><div>Predictor variable was preoperative diagnosis coded as BPTs and MPTs based on the support vector machine (SVM) algorithms, laboratory, and CEUS variables.</div></div><div><h3>Main Outcome Variable(s)</h3><div>Outcome variable was pathological diagnosis coded as BPTs and MPTs.</div></div><div><h3>Covariates</h3><div>Covariate was demographics.</div></div><div><h3>Analyses</h3><div>A senior surgeon labeled patients' tumors as BPTs or MPTs, creating a clinical diagnosis. Patients were randomly divided into training (70%) and testing (30%) sets. After developing the SVM models using the training set, we evaluated their diagnostic performance on the testing set with the area under the receiver-operating characteristic curve (AUC), accuracy, positive predictive value, negative predictive value, sensitivity, and specificity. Delong's test was used to compare the AUC of SVM models, laboratory, and CEUS variables.</div></div><div><h3>Results</h3><div>The sample included 48 patients, and the testing set comprised 12 (25%) BPTs and 3 (6.25%) MPTs. Three CEUS variables (width, arrival time, and time to peak) and 3 laboratory variables (lymphocyte count, D-dimer, prognostic nutritional index) were identified through recursive feature elimination. Tested on the testing set, the SVM models with linear, polynomial, and radial kernels showed identical performance (AUC = 0.972, accuracy = 93.3%, positive predictive value = 75%, negative predictive value = 100%, sensitivity = 100%, specificity = 91.7%). They had larger AUC than SVM with sigmoid kernel (<em>P</em> = .18), width (<em>P</em> = .03), lymphocyte count (<em>P</em> = .02), D-dimer (<em>P</em> < .01), prognostic nutritional index (<em>P</em> = .03), arrival time (<em>P</em> = .02), time to peak (<em>P</em> = .04), CEUS diagnosis (<em>P</em> < .01), and clinical diagnosis (<em>P</em> < .01).</div></div><div><h3>Conclusion and Relevance</h3><div>The SVM algorithm differentiated BPTs from MPTs better than laboratory and CEUS variables.</div></div>","PeriodicalId":16612,"journal":{"name":"Journal of Oral and Maxillofacial Surgery","volume":"83 2","pages":"Pages 208-221"},"PeriodicalIF":2.3000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Machine Learning Differentiates Between Benign and Malignant Parotid Tumors With Contrast-Enhanced Ultrasound Features\",\"authors\":\"Jie Shan MD , Yifei Yang MD , Hualian Liu PhD , Zhaoyao Sun PhD , Mingming Chen MD , Zhichao Zhu MD\",\"doi\":\"10.1016/j.joms.2024.10.018\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Background</h3><div>Contrast-enhanced ultrasound (CEUS) is frequently used to distinguish benign parotid tumors (BPTs) from malignant parotid tumors (MPTs). Introducing machine learning may enable clinicians to preoperatively diagnose parotid tumors precisely.</div></div><div><h3>Purpose</h3><div>We aimed to estimate the diagnostic capability of machine learning in differentiating BPTs from MPTs.</div></div><div><h3>Study Design, Setting, and Sample</h3><div>A retrospective cohort study was conducted at the Third Affiliated Hospital of Soochow University. Patients who underwent parotidectomy and CEUS for untreated parotid tumors were included. Patients with recurrent tumors, inadequate specimens, or chemoradiotherapy were excluded.</div></div><div><h3>Predictor Variable</h3><div>Predictor variable was preoperative diagnosis coded as BPTs and MPTs based on the support vector machine (SVM) algorithms, laboratory, and CEUS variables.</div></div><div><h3>Main Outcome Variable(s)</h3><div>Outcome variable was pathological diagnosis coded as BPTs and MPTs.</div></div><div><h3>Covariates</h3><div>Covariate was demographics.</div></div><div><h3>Analyses</h3><div>A senior surgeon labeled patients' tumors as BPTs or MPTs, creating a clinical diagnosis. Patients were randomly divided into training (70%) and testing (30%) sets. After developing the SVM models using the training set, we evaluated their diagnostic performance on the testing set with the area under the receiver-operating characteristic curve (AUC), accuracy, positive predictive value, negative predictive value, sensitivity, and specificity. Delong's test was used to compare the AUC of SVM models, laboratory, and CEUS variables.</div></div><div><h3>Results</h3><div>The sample included 48 patients, and the testing set comprised 12 (25%) BPTs and 3 (6.25%) MPTs. Three CEUS variables (width, arrival time, and time to peak) and 3 laboratory variables (lymphocyte count, D-dimer, prognostic nutritional index) were identified through recursive feature elimination. Tested on the testing set, the SVM models with linear, polynomial, and radial kernels showed identical performance (AUC = 0.972, accuracy = 93.3%, positive predictive value = 75%, negative predictive value = 100%, sensitivity = 100%, specificity = 91.7%). They had larger AUC than SVM with sigmoid kernel (<em>P</em> = .18), width (<em>P</em> = .03), lymphocyte count (<em>P</em> = .02), D-dimer (<em>P</em> < .01), prognostic nutritional index (<em>P</em> = .03), arrival time (<em>P</em> = .02), time to peak (<em>P</em> = .04), CEUS diagnosis (<em>P</em> < .01), and clinical diagnosis (<em>P</em> < .01).</div></div><div><h3>Conclusion and Relevance</h3><div>The SVM algorithm differentiated BPTs from MPTs better than laboratory and CEUS variables.</div></div>\",\"PeriodicalId\":16612,\"journal\":{\"name\":\"Journal of Oral and Maxillofacial Surgery\",\"volume\":\"83 2\",\"pages\":\"Pages 208-221\"},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2025-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Oral and Maxillofacial Surgery\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0278239124009145\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"DENTISTRY, ORAL SURGERY & MEDICINE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Oral and Maxillofacial Surgery","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0278239124009145","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
Machine Learning Differentiates Between Benign and Malignant Parotid Tumors With Contrast-Enhanced Ultrasound Features
Background
Contrast-enhanced ultrasound (CEUS) is frequently used to distinguish benign parotid tumors (BPTs) from malignant parotid tumors (MPTs). Introducing machine learning may enable clinicians to preoperatively diagnose parotid tumors precisely.
Purpose
We aimed to estimate the diagnostic capability of machine learning in differentiating BPTs from MPTs.
Study Design, Setting, and Sample
A retrospective cohort study was conducted at the Third Affiliated Hospital of Soochow University. Patients who underwent parotidectomy and CEUS for untreated parotid tumors were included. Patients with recurrent tumors, inadequate specimens, or chemoradiotherapy were excluded.
Predictor Variable
Predictor variable was preoperative diagnosis coded as BPTs and MPTs based on the support vector machine (SVM) algorithms, laboratory, and CEUS variables.
Main Outcome Variable(s)
Outcome variable was pathological diagnosis coded as BPTs and MPTs.
Covariates
Covariate was demographics.
Analyses
A senior surgeon labeled patients' tumors as BPTs or MPTs, creating a clinical diagnosis. Patients were randomly divided into training (70%) and testing (30%) sets. After developing the SVM models using the training set, we evaluated their diagnostic performance on the testing set with the area under the receiver-operating characteristic curve (AUC), accuracy, positive predictive value, negative predictive value, sensitivity, and specificity. Delong's test was used to compare the AUC of SVM models, laboratory, and CEUS variables.
Results
The sample included 48 patients, and the testing set comprised 12 (25%) BPTs and 3 (6.25%) MPTs. Three CEUS variables (width, arrival time, and time to peak) and 3 laboratory variables (lymphocyte count, D-dimer, prognostic nutritional index) were identified through recursive feature elimination. Tested on the testing set, the SVM models with linear, polynomial, and radial kernels showed identical performance (AUC = 0.972, accuracy = 93.3%, positive predictive value = 75%, negative predictive value = 100%, sensitivity = 100%, specificity = 91.7%). They had larger AUC than SVM with sigmoid kernel (P = .18), width (P = .03), lymphocyte count (P = .02), D-dimer (P < .01), prognostic nutritional index (P = .03), arrival time (P = .02), time to peak (P = .04), CEUS diagnosis (P < .01), and clinical diagnosis (P < .01).
Conclusion and Relevance
The SVM algorithm differentiated BPTs from MPTs better than laboratory and CEUS variables.
期刊介绍:
This monthly journal offers comprehensive coverage of new techniques, important developments and innovative ideas in oral and maxillofacial surgery. Practice-applicable articles help develop the methods used to handle dentoalveolar surgery, facial injuries and deformities, TMJ disorders, oral cancer, jaw reconstruction, anesthesia and analgesia. The journal also includes specifics on new instruments and diagnostic equipment and modern therapeutic drugs and devices. Journal of Oral and Maxillofacial Surgery is recommended for first or priority subscription by the Dental Section of the Medical Library Association.