Transformer Network with Self-Supervised Learning for Stenosis Detection in CT Angiography

Yonglin Bian, Danni Ai, Tao Han, Lu Lin, Jian Yang
{"title":"Transformer Network with Self-Supervised Learning for Stenosis Detection in CT Angiography","authors":"Yonglin Bian, Danni Ai, Tao Han, Lu Lin, Jian Yang","doi":"10.1145/3577117.3577147","DOIUrl":null,"url":null,"abstract":"Coronary artery stenosis is a common coronary artery disease (CAD) that may pose high risk to the life of patients. However, the poor imaging quality at lesions causes difficulties for automatic detection of stenosis in cardiac CT angiography. Previous supervised learning methods improve the robustness of detection by introducing networks with strong context modeling capabilities such as RNN and Transformer, yet requiring large-scale dataset for a high performance. In this paper, we propose a novel self-supervised Transformer network for stenosis detection in multi-planar reformatted (MPR) images reconstructed with the centerlines of the coronary arteries. A Transformer with cross-shaped attention, which can capture the global information of coronary branches efficiently in the MPR images, is introduced into the proposed network. Moreover, an auxiliary self-supervised learning task that encourages the Transformer network to learn spatial relations within an image is introduced. Extensive experiments are conducted on a dataset of 78 patients annotated by experienced radiologists. The results illustrate that the proposed method achieved better results in F1 (0.79) than other state-of-the-art methods.","PeriodicalId":309874,"journal":{"name":"Proceedings of the 6th International Conference on Advances in Image Processing","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 6th International Conference on Advances in Image Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3577117.3577147","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Coronary artery stenosis is a common coronary artery disease (CAD) that may pose high risk to the life of patients. However, the poor imaging quality at lesions causes difficulties for automatic detection of stenosis in cardiac CT angiography. Previous supervised learning methods improve the robustness of detection by introducing networks with strong context modeling capabilities such as RNN and Transformer, yet requiring large-scale dataset for a high performance. In this paper, we propose a novel self-supervised Transformer network for stenosis detection in multi-planar reformatted (MPR) images reconstructed with the centerlines of the coronary arteries. A Transformer with cross-shaped attention, which can capture the global information of coronary branches efficiently in the MPR images, is introduced into the proposed network. Moreover, an auxiliary self-supervised learning task that encourages the Transformer network to learn spatial relations within an image is introduced. Extensive experiments are conducted on a dataset of 78 patients annotated by experienced radiologists. The results illustrate that the proposed method achieved better results in F1 (0.79) than other state-of-the-art methods.
基于自监督学习的变压器网络在CT血管造影中的狭窄检测
冠状动脉狭窄是一种常见的冠状动脉疾病(CAD),可能对患者的生命构成高风险。然而,病变处的成像质量较差,给心脏CT血管造影中的狭窄自动检测带来困难。以前的监督学习方法通过引入具有强大上下文建模能力的网络(如RNN和Transformer)来提高检测的鲁棒性,但需要大规模的数据集才能获得高性能。本文提出了一种新的自监督变压器网络,用于冠状动脉中心线重构的多平面重构(MPR)图像的狭窄检测。在该网络中引入了一种具有十字形注意力的变压器,可以有效地捕获MPR图像中冠状动脉分支的全局信息。此外,还引入了一个辅助的自监督学习任务,鼓励Transformer网络学习图像中的空间关系。广泛的实验是在78名患者的数据集上进行的,这些患者由经验丰富的放射科医生注释。结果表明,该方法在F1(0.79)上取得了较好的结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信