Channel-Spatial Attention Guided CycleGAN for CBCT-Based Synthetic CT Generation to Enable Adaptive Radiotherapy

IF 4.2 2区 计算机科学 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Yangchuan Liu;Shimin Liao;Yechen Zhu;Fuxing Deng;Zijian Zhang;Xin Gao;Tingting Cheng
{"title":"Channel-Spatial Attention Guided CycleGAN for CBCT-Based Synthetic CT Generation to Enable Adaptive Radiotherapy","authors":"Yangchuan Liu;Shimin Liao;Yechen Zhu;Fuxing Deng;Zijian Zhang;Xin Gao;Tingting Cheng","doi":"10.1109/TCI.2024.3402372","DOIUrl":null,"url":null,"abstract":"Cone-beam computed tomography (CBCT) is the most commonly used 3D imaging modality in image-guided radiotherapy. However, severe artifacts and inaccurate Hounsfield units render CBCT images directly unusable for dose calculations in radiotherapy planning. The deformed pCT (dpCT) image produced by aligning the planning CT (pCT) image with the CBCT image can be viewed as the corrected CBCT image. However, when the interval between pCT and CBCT scans is long, the alignment error increases, which reduces the accuracy of dose calculations based on dpCT images. This study introduces a channel-spatial attention-guided cycle-consistent generative adversarial network (cycleGAN) called TranSE-cycleGAN, which learns mapping from CBCT to dpCT images and generates synthetic CT (sCT) images similar to dpCT images to achieve CBCT image correction. To enhance the network's ability to extract global features that reflect the overall noise and artifact distribution of the image, a TranSE branch, which is composed of a SELayer and an improved window-based transformer, was added parallel to the original residual convolution branch to the cycleGAN generator. To evaluate the proposed network, we collected data from 51 patients with head-and-neck cancer who underwent both pCT and CBCT scans. Among these, 45 were used for network training, and 6 were used for network testing. The results of the comparison experiments with cycleGAN and respath-cycleGAN demonstrate that the proposed TranSE-cycleGAN excels not only in image quality evaluation metrics, including mean absolute error, root mean square error, peak signal-to-noise ratio, and structural similarity but also in the Gamma index pass rate, a metric for dose accuracy evaluation. The superiority of the proposed method indicates its potential value in adaptive radiotherapy.","PeriodicalId":56022,"journal":{"name":"IEEE Transactions on Computational Imaging","volume":"10 ","pages":"818-831"},"PeriodicalIF":4.2000,"publicationDate":"2024-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Imaging","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10535271/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Cone-beam computed tomography (CBCT) is the most commonly used 3D imaging modality in image-guided radiotherapy. However, severe artifacts and inaccurate Hounsfield units render CBCT images directly unusable for dose calculations in radiotherapy planning. The deformed pCT (dpCT) image produced by aligning the planning CT (pCT) image with the CBCT image can be viewed as the corrected CBCT image. However, when the interval between pCT and CBCT scans is long, the alignment error increases, which reduces the accuracy of dose calculations based on dpCT images. This study introduces a channel-spatial attention-guided cycle-consistent generative adversarial network (cycleGAN) called TranSE-cycleGAN, which learns mapping from CBCT to dpCT images and generates synthetic CT (sCT) images similar to dpCT images to achieve CBCT image correction. To enhance the network's ability to extract global features that reflect the overall noise and artifact distribution of the image, a TranSE branch, which is composed of a SELayer and an improved window-based transformer, was added parallel to the original residual convolution branch to the cycleGAN generator. To evaluate the proposed network, we collected data from 51 patients with head-and-neck cancer who underwent both pCT and CBCT scans. Among these, 45 were used for network training, and 6 were used for network testing. The results of the comparison experiments with cycleGAN and respath-cycleGAN demonstrate that the proposed TranSE-cycleGAN excels not only in image quality evaluation metrics, including mean absolute error, root mean square error, peak signal-to-noise ratio, and structural similarity but also in the Gamma index pass rate, a metric for dose accuracy evaluation. The superiority of the proposed method indicates its potential value in adaptive radiotherapy.
通道空间注意力引导的 CycleGAN 用于基于 CBCT 的合成 CT 生成,以实现自适应放疗
锥形束计算机断层扫描(CBCT)是图像引导放射治疗中最常用的三维成像模式。然而,严重的伪影和不准确的 Hounsfield 单位使 CBCT 图像无法直接用于放疗计划中的剂量计算。将计划 CT(pCT)图像与 CBCT 图像对齐后生成的变形 pCT(dpCT)图像可视为修正后的 CBCT 图像。然而,当 pCT 扫描和 CBCT 扫描之间的间隔时间较长时,配准误差就会增大,从而降低了基于 dpCT 图像的剂量计算的准确性。本研究引入了一种名为 TranSE-cycleGAN 的通道空间注意力引导循环一致性对抗生成网络(cycleGAN),它能学习从 CBCT 到 dpCT 图像的映射,并生成与 dpCT 图像相似的合成 CT(sCT)图像,以实现 CBCT 图像校正。为了增强网络提取全局特征的能力,以反映图像的整体噪声和伪影分布,我们在 cycleGAN 生成器的原始残差卷积分支上添加了一个 TranSE 分支,该分支由 SELayer 和改进的基于窗口的变换器组成。为了评估所提出的网络,我们收集了 51 名头颈癌患者的数据,这些患者同时接受了 pCT 和 CBCT 扫描。其中 45 例用于网络训练,6 例用于网络测试。与 cycleGAN 和 respath-cycleGAN 的对比实验结果表明,所提出的 TranSE-cycleGAN 不仅在图像质量评价指标(包括平均绝对误差、均方根误差、峰值信噪比和结构相似性)方面表现出色,而且在剂量准确性评价指标--伽马指数通过率方面也表现出色。建议方法的优越性表明了它在自适应放射治疗中的潜在价值。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Computational Imaging
IEEE Transactions on Computational Imaging Mathematics-Computational Mathematics
CiteScore
8.20
自引率
7.40%
发文量
59
期刊介绍: The IEEE Transactions on Computational Imaging will publish articles where computation plays an integral role in the image formation process. Papers will cover all areas of computational imaging ranging from fundamental theoretical methods to the latest innovative computational imaging system designs. Topics of interest will include advanced algorithms and mathematical techniques, model-based data inversion, methods for image and signal recovery from sparse and incomplete data, techniques for non-traditional sensing of image data, methods for dynamic information acquisition and extraction from imaging sensors, software and hardware for efficient computation in imaging systems, and highly novel imaging system design.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信