{"title":"基于深度学习模型的胸部x线图像结核检测与感染区可视化","authors":"Vinayak Sharma , Nillmani , Sachin Kumar Gupta , Kaushal Kumar Shukla","doi":"10.1016/j.imed.2023.06.001","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><p>Tuberculosis (TB) is among the most frequent causes of infectious-disease-related mortality. Despite being treatable by antibiotics, tuberculosis often goes misdiagnosed and untreated, especially in rural and low-resource areas. Chest X-rays are frequently used to aid diagnosis; however, this presents additional challenges because of the possibility of abnormal radiological appearance and a lack of radiologists in areas where the infection is most prevalent. Implementing deep-learning-based imaging techniques for computer-aided diagnosis has the potential to enable accurate diagnoses and lessen the burden on medical specialists. In the present work, we aimed to develop deep-learning-based segmentation and classification models for accurate and precise detection of tuberculosis in chest X-ray images, with visualization of infection using gradient-weighted class activation mapping (Grad-CAM) heatmaps.</p></div><div><h3>Methods</h3><p>First, we trained the UNet segmentation model using 704 chest X-ray radiographs taken from the Montgomery County and Shenzhen Hospital datasets. Next, we implemented the trained UNet model on 1,400 tuberculosis and control chest X-ray scans to segment the lung region. The images were taken from the National Institute of Allergy and Infectious Diseases (NIAID) TB portal program dataset. Then, we applied the deep learning Xception model to classify the segmented lung region into tuberculosis and normal classes. We further investigated the visualization capabilities of the model using Grad-CAM to view tuberculosis abnormalities in chest X-rays and discuss them from radiological perspectives.</p></div><div><h3>Results</h3><p>For segmentation by the UNet model, we achieved accuracy, Jaccard index, Dice coefficient, and area under the curve (AUC) values of 96.35%, 90.38%, 94.88%, and 0.99, respectively. For classification by the Xception model, we achieved classification accuracy, precision, recall, F1-score, and AUC values of 99.29%, 99.30%, 99.29%, 99.29%, and 0.999, respectively. The Grad-CAM heatmap images from the tuberculosis class showed similar heatmap patterns, where lesions were primarily present in the upper part of the lungs.</p></div><div><h3>Conclusion</h3><p>The findings may verify our system's efficacy and superiority to clinician precision in tuberculosis diagnosis using chest X-rays and raise the possibility of a valuable setup, particularly in environments with a scarcity of radiological expertise.</p></div>","PeriodicalId":73400,"journal":{"name":"Intelligent medicine","volume":"4 2","pages":"Pages 104-113"},"PeriodicalIF":4.4000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667102623000438/pdfft?md5=d246bb40260ebc3532cade5021bab478&pid=1-s2.0-S2667102623000438-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Deep learning models for tuberculosis detection and infected region visualization in chest X-ray images\",\"authors\":\"Vinayak Sharma , Nillmani , Sachin Kumar Gupta , Kaushal Kumar Shukla\",\"doi\":\"10.1016/j.imed.2023.06.001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Objective</h3><p>Tuberculosis (TB) is among the most frequent causes of infectious-disease-related mortality. Despite being treatable by antibiotics, tuberculosis often goes misdiagnosed and untreated, especially in rural and low-resource areas. Chest X-rays are frequently used to aid diagnosis; however, this presents additional challenges because of the possibility of abnormal radiological appearance and a lack of radiologists in areas where the infection is most prevalent. Implementing deep-learning-based imaging techniques for computer-aided diagnosis has the potential to enable accurate diagnoses and lessen the burden on medical specialists. In the present work, we aimed to develop deep-learning-based segmentation and classification models for accurate and precise detection of tuberculosis in chest X-ray images, with visualization of infection using gradient-weighted class activation mapping (Grad-CAM) heatmaps.</p></div><div><h3>Methods</h3><p>First, we trained the UNet segmentation model using 704 chest X-ray radiographs taken from the Montgomery County and Shenzhen Hospital datasets. Next, we implemented the trained UNet model on 1,400 tuberculosis and control chest X-ray scans to segment the lung region. The images were taken from the National Institute of Allergy and Infectious Diseases (NIAID) TB portal program dataset. Then, we applied the deep learning Xception model to classify the segmented lung region into tuberculosis and normal classes. We further investigated the visualization capabilities of the model using Grad-CAM to view tuberculosis abnormalities in chest X-rays and discuss them from radiological perspectives.</p></div><div><h3>Results</h3><p>For segmentation by the UNet model, we achieved accuracy, Jaccard index, Dice coefficient, and area under the curve (AUC) values of 96.35%, 90.38%, 94.88%, and 0.99, respectively. For classification by the Xception model, we achieved classification accuracy, precision, recall, F1-score, and AUC values of 99.29%, 99.30%, 99.29%, 99.29%, and 0.999, respectively. The Grad-CAM heatmap images from the tuberculosis class showed similar heatmap patterns, where lesions were primarily present in the upper part of the lungs.</p></div><div><h3>Conclusion</h3><p>The findings may verify our system's efficacy and superiority to clinician precision in tuberculosis diagnosis using chest X-rays and raise the possibility of a valuable setup, particularly in environments with a scarcity of radiological expertise.</p></div>\",\"PeriodicalId\":73400,\"journal\":{\"name\":\"Intelligent medicine\",\"volume\":\"4 2\",\"pages\":\"Pages 104-113\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2024-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2667102623000438/pdfft?md5=d246bb40260ebc3532cade5021bab478&pid=1-s2.0-S2667102623000438-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Intelligent medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2667102623000438\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intelligent medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2667102623000438","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
摘要
目的结核病(TB)是传染病导致死亡的最常见原因之一。尽管结核病可以通过抗生素治疗,但却经常被误诊和误治,尤其是在农村和资源匮乏地区。胸部 X 射线检查常用于辅助诊断,但这也带来了额外的挑战,因为可能会出现放射学外观异常,而且在感染最流行的地区缺乏放射科医生。采用基于深度学习的成像技术进行计算机辅助诊断有可能实现准确诊断,减轻医学专家的负担。在本研究中,我们旨在开发基于深度学习的分割和分类模型,以便在胸部 X 光图像中准确、精确地检测结核病,并利用梯度加权类激活映射(Grad-CAM)热图将感染可视化。接着,我们在 1,400 张肺结核和对照组胸部 X 光片上使用训练好的 UNet 模型来分割肺部区域。这些图像来自美国国家过敏与传染病研究所(NIAID)结核病门户网站项目数据集。然后,我们应用深度学习 Xception 模型将分割后的肺部区域分为肺结核和正常两类。我们使用 Grad-CAM 进一步研究了该模型的可视化功能,以查看胸部 X 光片中的结核病异常,并从放射学的角度对其进行讨论。结果对于 UNet 模型的分割,我们获得的准确率、Jaccard 指数、Dice 系数和曲线下面积(AUC)值分别为 96.35%、90.38%、94.88% 和 0.99。在 Xception 模型的分类中,我们的分类准确率、精确度、召回率、F1 分数和 AUC 值分别达到了 99.29%、99.30%、99.29%、99.29% 和 0.999。肺结核类的 Grad-CAM 热图图像显示了类似的热图模式,病变主要出现在肺的上半部分。
Deep learning models for tuberculosis detection and infected region visualization in chest X-ray images
Objective
Tuberculosis (TB) is among the most frequent causes of infectious-disease-related mortality. Despite being treatable by antibiotics, tuberculosis often goes misdiagnosed and untreated, especially in rural and low-resource areas. Chest X-rays are frequently used to aid diagnosis; however, this presents additional challenges because of the possibility of abnormal radiological appearance and a lack of radiologists in areas where the infection is most prevalent. Implementing deep-learning-based imaging techniques for computer-aided diagnosis has the potential to enable accurate diagnoses and lessen the burden on medical specialists. In the present work, we aimed to develop deep-learning-based segmentation and classification models for accurate and precise detection of tuberculosis in chest X-ray images, with visualization of infection using gradient-weighted class activation mapping (Grad-CAM) heatmaps.
Methods
First, we trained the UNet segmentation model using 704 chest X-ray radiographs taken from the Montgomery County and Shenzhen Hospital datasets. Next, we implemented the trained UNet model on 1,400 tuberculosis and control chest X-ray scans to segment the lung region. The images were taken from the National Institute of Allergy and Infectious Diseases (NIAID) TB portal program dataset. Then, we applied the deep learning Xception model to classify the segmented lung region into tuberculosis and normal classes. We further investigated the visualization capabilities of the model using Grad-CAM to view tuberculosis abnormalities in chest X-rays and discuss them from radiological perspectives.
Results
For segmentation by the UNet model, we achieved accuracy, Jaccard index, Dice coefficient, and area under the curve (AUC) values of 96.35%, 90.38%, 94.88%, and 0.99, respectively. For classification by the Xception model, we achieved classification accuracy, precision, recall, F1-score, and AUC values of 99.29%, 99.30%, 99.29%, 99.29%, and 0.999, respectively. The Grad-CAM heatmap images from the tuberculosis class showed similar heatmap patterns, where lesions were primarily present in the upper part of the lungs.
Conclusion
The findings may verify our system's efficacy and superiority to clinician precision in tuberculosis diagnosis using chest X-rays and raise the possibility of a valuable setup, particularly in environments with a scarcity of radiological expertise.