基于深度学习模型的胸部x线图像结核检测与感染区可视化

IF 4.4 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Vinayak Sharma , Nillmani , Sachin Kumar Gupta , Kaushal Kumar Shukla
{"title":"基于深度学习模型的胸部x线图像结核检测与感染区可视化","authors":"Vinayak Sharma ,&nbsp;Nillmani ,&nbsp;Sachin Kumar Gupta ,&nbsp;Kaushal Kumar Shukla","doi":"10.1016/j.imed.2023.06.001","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><p>Tuberculosis (TB) is among the most frequent causes of infectious-disease-related mortality. Despite being treatable by antibiotics, tuberculosis often goes misdiagnosed and untreated, especially in rural and low-resource areas. Chest X-rays are frequently used to aid diagnosis; however, this presents additional challenges because of the possibility of abnormal radiological appearance and a lack of radiologists in areas where the infection is most prevalent. Implementing deep-learning-based imaging techniques for computer-aided diagnosis has the potential to enable accurate diagnoses and lessen the burden on medical specialists. In the present work, we aimed to develop deep-learning-based segmentation and classification models for accurate and precise detection of tuberculosis in chest X-ray images, with visualization of infection using gradient-weighted class activation mapping (Grad-CAM) heatmaps.</p></div><div><h3>Methods</h3><p>First, we trained the UNet segmentation model using 704 chest X-ray radiographs taken from the Montgomery County and Shenzhen Hospital datasets. Next, we implemented the trained UNet model on 1,400 tuberculosis and control chest X-ray scans to segment the lung region. The images were taken from the National Institute of Allergy and Infectious Diseases (NIAID) TB portal program dataset. Then, we applied the deep learning Xception model to classify the segmented lung region into tuberculosis and normal classes. We further investigated the visualization capabilities of the model using Grad-CAM to view tuberculosis abnormalities in chest X-rays and discuss them from radiological perspectives.</p></div><div><h3>Results</h3><p>For segmentation by the UNet model, we achieved accuracy, Jaccard index, Dice coefficient, and area under the curve (AUC) values of 96.35%, 90.38%, 94.88%, and 0.99, respectively. For classification by the Xception model, we achieved classification accuracy, precision, recall, F1-score, and AUC values of 99.29%, 99.30%, 99.29%, 99.29%, and 0.999, respectively. The Grad-CAM heatmap images from the tuberculosis class showed similar heatmap patterns, where lesions were primarily present in the upper part of the lungs.</p></div><div><h3>Conclusion</h3><p>The findings may verify our system's efficacy and superiority to clinician precision in tuberculosis diagnosis using chest X-rays and raise the possibility of a valuable setup, particularly in environments with a scarcity of radiological expertise.</p></div>","PeriodicalId":73400,"journal":{"name":"Intelligent medicine","volume":"4 2","pages":"Pages 104-113"},"PeriodicalIF":4.4000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667102623000438/pdfft?md5=d246bb40260ebc3532cade5021bab478&pid=1-s2.0-S2667102623000438-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Deep learning models for tuberculosis detection and infected region visualization in chest X-ray images\",\"authors\":\"Vinayak Sharma ,&nbsp;Nillmani ,&nbsp;Sachin Kumar Gupta ,&nbsp;Kaushal Kumar Shukla\",\"doi\":\"10.1016/j.imed.2023.06.001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Objective</h3><p>Tuberculosis (TB) is among the most frequent causes of infectious-disease-related mortality. Despite being treatable by antibiotics, tuberculosis often goes misdiagnosed and untreated, especially in rural and low-resource areas. Chest X-rays are frequently used to aid diagnosis; however, this presents additional challenges because of the possibility of abnormal radiological appearance and a lack of radiologists in areas where the infection is most prevalent. Implementing deep-learning-based imaging techniques for computer-aided diagnosis has the potential to enable accurate diagnoses and lessen the burden on medical specialists. In the present work, we aimed to develop deep-learning-based segmentation and classification models for accurate and precise detection of tuberculosis in chest X-ray images, with visualization of infection using gradient-weighted class activation mapping (Grad-CAM) heatmaps.</p></div><div><h3>Methods</h3><p>First, we trained the UNet segmentation model using 704 chest X-ray radiographs taken from the Montgomery County and Shenzhen Hospital datasets. Next, we implemented the trained UNet model on 1,400 tuberculosis and control chest X-ray scans to segment the lung region. The images were taken from the National Institute of Allergy and Infectious Diseases (NIAID) TB portal program dataset. Then, we applied the deep learning Xception model to classify the segmented lung region into tuberculosis and normal classes. We further investigated the visualization capabilities of the model using Grad-CAM to view tuberculosis abnormalities in chest X-rays and discuss them from radiological perspectives.</p></div><div><h3>Results</h3><p>For segmentation by the UNet model, we achieved accuracy, Jaccard index, Dice coefficient, and area under the curve (AUC) values of 96.35%, 90.38%, 94.88%, and 0.99, respectively. For classification by the Xception model, we achieved classification accuracy, precision, recall, F1-score, and AUC values of 99.29%, 99.30%, 99.29%, 99.29%, and 0.999, respectively. The Grad-CAM heatmap images from the tuberculosis class showed similar heatmap patterns, where lesions were primarily present in the upper part of the lungs.</p></div><div><h3>Conclusion</h3><p>The findings may verify our system's efficacy and superiority to clinician precision in tuberculosis diagnosis using chest X-rays and raise the possibility of a valuable setup, particularly in environments with a scarcity of radiological expertise.</p></div>\",\"PeriodicalId\":73400,\"journal\":{\"name\":\"Intelligent medicine\",\"volume\":\"4 2\",\"pages\":\"Pages 104-113\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2024-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2667102623000438/pdfft?md5=d246bb40260ebc3532cade5021bab478&pid=1-s2.0-S2667102623000438-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Intelligent medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2667102623000438\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intelligent medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2667102623000438","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

目的结核病(TB)是传染病导致死亡的最常见原因之一。尽管结核病可以通过抗生素治疗,但却经常被误诊和误治,尤其是在农村和资源匮乏地区。胸部 X 射线检查常用于辅助诊断,但这也带来了额外的挑战,因为可能会出现放射学外观异常,而且在感染最流行的地区缺乏放射科医生。采用基于深度学习的成像技术进行计算机辅助诊断有可能实现准确诊断,减轻医学专家的负担。在本研究中,我们旨在开发基于深度学习的分割和分类模型,以便在胸部 X 光图像中准确、精确地检测结核病,并利用梯度加权类激活映射(Grad-CAM)热图将感染可视化。接着,我们在 1,400 张肺结核和对照组胸部 X 光片上使用训练好的 UNet 模型来分割肺部区域。这些图像来自美国国家过敏与传染病研究所(NIAID)结核病门户网站项目数据集。然后,我们应用深度学习 Xception 模型将分割后的肺部区域分为肺结核和正常两类。我们使用 Grad-CAM 进一步研究了该模型的可视化功能,以查看胸部 X 光片中的结核病异常,并从放射学的角度对其进行讨论。结果对于 UNet 模型的分割,我们获得的准确率、Jaccard 指数、Dice 系数和曲线下面积(AUC)值分别为 96.35%、90.38%、94.88% 和 0.99。在 Xception 模型的分类中,我们的分类准确率、精确度、召回率、F1 分数和 AUC 值分别达到了 99.29%、99.30%、99.29%、99.29% 和 0.999。肺结核类的 Grad-CAM 热图图像显示了类似的热图模式,病变主要出现在肺的上半部分。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep learning models for tuberculosis detection and infected region visualization in chest X-ray images

Objective

Tuberculosis (TB) is among the most frequent causes of infectious-disease-related mortality. Despite being treatable by antibiotics, tuberculosis often goes misdiagnosed and untreated, especially in rural and low-resource areas. Chest X-rays are frequently used to aid diagnosis; however, this presents additional challenges because of the possibility of abnormal radiological appearance and a lack of radiologists in areas where the infection is most prevalent. Implementing deep-learning-based imaging techniques for computer-aided diagnosis has the potential to enable accurate diagnoses and lessen the burden on medical specialists. In the present work, we aimed to develop deep-learning-based segmentation and classification models for accurate and precise detection of tuberculosis in chest X-ray images, with visualization of infection using gradient-weighted class activation mapping (Grad-CAM) heatmaps.

Methods

First, we trained the UNet segmentation model using 704 chest X-ray radiographs taken from the Montgomery County and Shenzhen Hospital datasets. Next, we implemented the trained UNet model on 1,400 tuberculosis and control chest X-ray scans to segment the lung region. The images were taken from the National Institute of Allergy and Infectious Diseases (NIAID) TB portal program dataset. Then, we applied the deep learning Xception model to classify the segmented lung region into tuberculosis and normal classes. We further investigated the visualization capabilities of the model using Grad-CAM to view tuberculosis abnormalities in chest X-rays and discuss them from radiological perspectives.

Results

For segmentation by the UNet model, we achieved accuracy, Jaccard index, Dice coefficient, and area under the curve (AUC) values of 96.35%, 90.38%, 94.88%, and 0.99, respectively. For classification by the Xception model, we achieved classification accuracy, precision, recall, F1-score, and AUC values of 99.29%, 99.30%, 99.29%, 99.29%, and 0.999, respectively. The Grad-CAM heatmap images from the tuberculosis class showed similar heatmap patterns, where lesions were primarily present in the upper part of the lungs.

Conclusion

The findings may verify our system's efficacy and superiority to clinician precision in tuberculosis diagnosis using chest X-rays and raise the possibility of a valuable setup, particularly in environments with a scarcity of radiological expertise.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Intelligent medicine
Intelligent medicine Surgery, Radiology and Imaging, Artificial Intelligence, Biomedical Engineering
CiteScore
5.20
自引率
0.00%
发文量
19
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信