Predicting lung cancer treatment response from CT images using deep learning

IF 3 4区 计算机科学 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Shweta Tyagi, Sanjay N. Talbar
{"title":"Predicting lung cancer treatment response from CT images using deep learning","authors":"Shweta Tyagi,&nbsp;Sanjay N. Talbar","doi":"10.1002/ima.22883","DOIUrl":null,"url":null,"abstract":"<p>Lung cancer is the deadliest type of cancer and is one of the most frequently occurring cancers. It is primarily diagnosed in later stages when treatment becomes difficult. For better treatment and higher chances of survival, the treatment response of lung cancer patients needs to be analyzed to check whether the patients are responding to the treatment or not. This analysis can be done with the help of follow-up computed tomography (CT) imaging before and after the treatment. However, manually analyzing the baseline and post-treatment CT scan images of so many lung cancer patients is a tedious task. This study proposes an intuitive approach based on deep learning to analyze lung cancer through CT scan images before and after the treatment. In this approach, we utilized a segmentation network to segment the lung tumor in the follow-up CT images. The segmented tumor is then analyzed to check the treatment effect, as suggested by the Response Evaluation Criteria in Solid Tumors (RECIST) guidelines. The segmentation network combines a vision transformer and a convolutional neural network. The segmentation network is first trained on a public dataset and then fine-tuned on the local dataset to improve the segmentation performance. For this study, we have collected a lung cancer dataset from an Indian hospital. The dataset is divided into two parts dataset I and dataset II. Dataset I consists of 100 CT scans, which we use to fine-tune the proposed segmentation network. Dataset II comprises 220 CT scans of 110 patients, consisting of baseline and post-treatment scans. We use dataset II for testing. We achieved significant performance.</p>","PeriodicalId":14027,"journal":{"name":"International Journal of Imaging Systems and Technology","volume":"33 5","pages":"1577-1592"},"PeriodicalIF":3.0000,"publicationDate":"2023-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Imaging Systems and Technology","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/ima.22883","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Lung cancer is the deadliest type of cancer and is one of the most frequently occurring cancers. It is primarily diagnosed in later stages when treatment becomes difficult. For better treatment and higher chances of survival, the treatment response of lung cancer patients needs to be analyzed to check whether the patients are responding to the treatment or not. This analysis can be done with the help of follow-up computed tomography (CT) imaging before and after the treatment. However, manually analyzing the baseline and post-treatment CT scan images of so many lung cancer patients is a tedious task. This study proposes an intuitive approach based on deep learning to analyze lung cancer through CT scan images before and after the treatment. In this approach, we utilized a segmentation network to segment the lung tumor in the follow-up CT images. The segmented tumor is then analyzed to check the treatment effect, as suggested by the Response Evaluation Criteria in Solid Tumors (RECIST) guidelines. The segmentation network combines a vision transformer and a convolutional neural network. The segmentation network is first trained on a public dataset and then fine-tuned on the local dataset to improve the segmentation performance. For this study, we have collected a lung cancer dataset from an Indian hospital. The dataset is divided into two parts dataset I and dataset II. Dataset I consists of 100 CT scans, which we use to fine-tune the proposed segmentation network. Dataset II comprises 220 CT scans of 110 patients, consisting of baseline and post-treatment scans. We use dataset II for testing. We achieved significant performance.

利用深度学习从CT图像预测癌症治疗反应
癌症是癌症最致命的类型,也是最常见的癌症之一。当治疗变得困难时,它主要在后期被诊断出来。为了更好的治疗和更高的生存机会,需要分析癌症患者的治疗反应,以检查患者是否对治疗有反应。这种分析可以在治疗前后的后续计算机断层扫描(CT)成像的帮助下进行。然而,手动分析如此多的癌症患者的基线和治疗后CT扫描图像是一项乏味的任务。本研究提出了一种基于深度学习的直观方法,通过治疗前后的CT扫描图像来分析癌症。在这种方法中,我们使用分割网络来分割后续CT图像中的肺部肿瘤。然后根据实体瘤反应评估标准(RECIST)指南的建议,对分割的肿瘤进行分析以检查治疗效果。分割网络结合了视觉变换器和卷积神经网络。首先在公共数据集上训练分割网络,然后在本地数据集上进行微调以提高分割性能。在这项研究中,我们从一家印度医院收集了一个癌症数据集。数据集分为数据集I和数据集II两部分。数据集I由100个CT扫描组成,我们使用这些扫描来微调所提出的分割网络。数据集II包括110名患者的220次CT扫描,包括基线扫描和治疗后扫描。我们使用数据集II进行测试。我们取得了显著的业绩。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
International Journal of Imaging Systems and Technology
International Journal of Imaging Systems and Technology 工程技术-成像科学与照相技术
CiteScore
6.90
自引率
6.10%
发文量
138
审稿时长
3 months
期刊介绍: The International Journal of Imaging Systems and Technology (IMA) is a forum for the exchange of ideas and results relevant to imaging systems, including imaging physics and informatics. The journal covers all imaging modalities in humans and animals. IMA accepts technically sound and scientifically rigorous research in the interdisciplinary field of imaging, including relevant algorithmic research and hardware and software development, and their applications relevant to medical research. The journal provides a platform to publish original research in structural and functional imaging. The journal is also open to imaging studies of the human body and on animals that describe novel diagnostic imaging and analyses methods. Technical, theoretical, and clinical research in both normal and clinical populations is encouraged. Submissions describing methods, software, databases, replication studies as well as negative results are also considered. The scope of the journal includes, but is not limited to, the following in the context of biomedical research: Imaging and neuro-imaging modalities: structural MRI, functional MRI, PET, SPECT, CT, ultrasound, EEG, MEG, NIRS etc.; Neuromodulation and brain stimulation techniques such as TMS and tDCS; Software and hardware for imaging, especially related to human and animal health; Image segmentation in normal and clinical populations; Pattern analysis and classification using machine learning techniques; Computational modeling and analysis; Brain connectivity and connectomics; Systems-level characterization of brain function; Neural networks and neurorobotics; Computer vision, based on human/animal physiology; Brain-computer interface (BCI) technology; Big data, databasing and data mining.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信