Weiguo Hu, Jie Zhang, Dingyi Zhou, Shu Xia, Xingxiang Pu, Jianzhong Cao, Mingzhu Zou, Zhangfan Mao, Qibin Song, Xiaodong Zhang
{"title":"A comparison study of artificial intelligence performance against physicians in benign–malignant classification of pulmonary nodules","authors":"Weiguo Hu, Jie Zhang, Dingyi Zhou, Shu Xia, Xingxiang Pu, Jianzhong Cao, Mingzhu Zou, Zhangfan Mao, Qibin Song, Xiaodong Zhang","doi":"10.1515/oncologie-2023-0319","DOIUrl":null,"url":null,"abstract":"\n \n \n To compare and evaluate the performance of artificial intelligence (AI) against physicians in classifying benign and malignant pulmonary nodules from computerized tomography (CT) images.\n \n \n \n A total of 506 CT images with pulmonary nodules were retrospectively collected. The AI was trained using in-house software. For comparing the diagnostic performance of artificial intelligence and different groups of physicians in pulmonary nodules, statistical methods of receiver operating characteristic (ROC) curve and area under the curve (AUC) were analyzed. The nodules in CT images were analyzed in a case-by-case manner.\n \n \n \n The diagnostic accuracy of AI surpassed that of all groups of physicians, exhibiting an AUC of 0.88 alongside a sensitivity of 0.80, specificity of 0.84, and accuracy of 0.83. The area under the curve (AUC) of seven groups of physicians varies between 0.63 and 0.84. The sensitivity of the physicians within these groups varies between 0.4 and 0.76. The specificity of different groups ranges from 0.8 to 0.85. Furthermore, the accuracy of the seven groups ranges from 0.7 to 0.82. The professional insights for enhancing deep learning models were obtained through an examination conducted on a per-case basis.\n \n \n \n AI demonstrated great potential in the benign–malignant classification of pulmonary nodules with higher accuracy. More accurate information will be provided by AI when making clinical decisions.\n","PeriodicalId":54687,"journal":{"name":"Oncologie","volume":null,"pages":null},"PeriodicalIF":1.4000,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Oncologie","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1515/oncologie-2023-0319","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
To compare and evaluate the performance of artificial intelligence (AI) against physicians in classifying benign and malignant pulmonary nodules from computerized tomography (CT) images.
A total of 506 CT images with pulmonary nodules were retrospectively collected. The AI was trained using in-house software. For comparing the diagnostic performance of artificial intelligence and different groups of physicians in pulmonary nodules, statistical methods of receiver operating characteristic (ROC) curve and area under the curve (AUC) were analyzed. The nodules in CT images were analyzed in a case-by-case manner.
The diagnostic accuracy of AI surpassed that of all groups of physicians, exhibiting an AUC of 0.88 alongside a sensitivity of 0.80, specificity of 0.84, and accuracy of 0.83. The area under the curve (AUC) of seven groups of physicians varies between 0.63 and 0.84. The sensitivity of the physicians within these groups varies between 0.4 and 0.76. The specificity of different groups ranges from 0.8 to 0.85. Furthermore, the accuracy of the seven groups ranges from 0.7 to 0.82. The professional insights for enhancing deep learning models were obtained through an examination conducted on a per-case basis.
AI demonstrated great potential in the benign–malignant classification of pulmonary nodules with higher accuracy. More accurate information will be provided by AI when making clinical decisions.
期刊介绍:
Oncologie is aimed to the publication of high quality original research articles, review papers, case report, etc. with an active interest in vivo or vitro study of cancer biology. Study relating to the pathology, diagnosis, and advanced treatment of all types of cancers, as well as research from any of the disciplines related to this field of interest. The journal has English and French bilingual publication.