使用变换器和相关距离对大型变形图像进行以特征为中心的配准。

IF 7 2区 医学 Q1 BIOLOGY
Heeyeon Kim , Minkyung Lee , Bohyoung Kim , Yeong-Gil Shin , Minyoung Chung
{"title":"使用变换器和相关距离对大型变形图像进行以特征为中心的配准。","authors":"Heeyeon Kim ,&nbsp;Minkyung Lee ,&nbsp;Bohyoung Kim ,&nbsp;Yeong-Gil Shin ,&nbsp;Minyoung Chung","doi":"10.1016/j.compbiomed.2024.109356","DOIUrl":null,"url":null,"abstract":"<div><div>In deformable medical image registration, both a robust backbone registration network and a suitable similarity metric are essential. This paper introduces a robust registration network combined with a feature-based loss function, specifically designed to handle large deformations and address the challenge of the absence of ground truth data. Tackling large deformations typically requires either expanding the receptive field or breaking down extensive deformations into smaller, more manageable ones. We address this challenge through two key network components: the coarse-to-fine estimation of the target displacement vector field (DVF) and the integration of the Transformer’s feature attention mechanism. To further enhance registration performance, we propose a novel feature correlation-based distance metric that leverages the symmetric properties of the correlation matrix to efficiently exploit feature correlations. Additionally, by utilizing the features extracted directly from the registration network, we eliminate the need for additional feature extraction networks. Experimental results demonstrate that our feature correlation-based loss function is particularly effective in achieving accurate registration in the absence of ground truth data. Our method has proven successful in both mono-modality abdomen CT registration and brain MRI atlas registration, leading to improvements in Dice similarity coefficient and other evaluation metrics.</div></div>","PeriodicalId":10578,"journal":{"name":"Computers in biology and medicine","volume":"184 ","pages":"Article 109356"},"PeriodicalIF":7.0000,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Feature-centric registration of large deformed images using transformers and correlation distance\",\"authors\":\"Heeyeon Kim ,&nbsp;Minkyung Lee ,&nbsp;Bohyoung Kim ,&nbsp;Yeong-Gil Shin ,&nbsp;Minyoung Chung\",\"doi\":\"10.1016/j.compbiomed.2024.109356\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In deformable medical image registration, both a robust backbone registration network and a suitable similarity metric are essential. This paper introduces a robust registration network combined with a feature-based loss function, specifically designed to handle large deformations and address the challenge of the absence of ground truth data. Tackling large deformations typically requires either expanding the receptive field or breaking down extensive deformations into smaller, more manageable ones. We address this challenge through two key network components: the coarse-to-fine estimation of the target displacement vector field (DVF) and the integration of the Transformer’s feature attention mechanism. To further enhance registration performance, we propose a novel feature correlation-based distance metric that leverages the symmetric properties of the correlation matrix to efficiently exploit feature correlations. Additionally, by utilizing the features extracted directly from the registration network, we eliminate the need for additional feature extraction networks. Experimental results demonstrate that our feature correlation-based loss function is particularly effective in achieving accurate registration in the absence of ground truth data. Our method has proven successful in both mono-modality abdomen CT registration and brain MRI atlas registration, leading to improvements in Dice similarity coefficient and other evaluation metrics.</div></div>\",\"PeriodicalId\":10578,\"journal\":{\"name\":\"Computers in biology and medicine\",\"volume\":\"184 \",\"pages\":\"Article 109356\"},\"PeriodicalIF\":7.0000,\"publicationDate\":\"2024-11-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers in biology and medicine\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0010482524014410\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"BIOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers in biology and medicine","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0010482524014410","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"BIOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

在可变形医学影像配准中,稳健的骨干配准网络和合适的相似度度量至关重要。本文介绍了一种与基于特征的损失函数相结合的鲁棒性配准网络,专门用于处理大变形和解决缺乏地面实况数据的难题。处理大变形通常需要扩大感受野或将大变形分解成更小、更易于处理的变形。我们通过两个关键的网络组件来应对这一挑战:从粗到细的目标位移矢量场(DVF)估算和 Transformer 特征关注机制的整合。为了进一步提高配准性能,我们提出了一种基于特征相关性的新型距离度量,该度量利用相关矩阵的对称特性来有效利用特征相关性。此外,通过直接利用从注册网络中提取的特征,我们不再需要额外的特征提取网络。实验结果表明,在没有地面实况数据的情况下,我们基于特征相关性的损失函数在实现精确配准方面特别有效。事实证明,我们的方法在单模态腹部 CT 配准和脑部 MRI 图集配准中都取得了成功,提高了 Dice 相似性系数和其他评价指标。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Feature-centric registration of large deformed images using transformers and correlation distance
In deformable medical image registration, both a robust backbone registration network and a suitable similarity metric are essential. This paper introduces a robust registration network combined with a feature-based loss function, specifically designed to handle large deformations and address the challenge of the absence of ground truth data. Tackling large deformations typically requires either expanding the receptive field or breaking down extensive deformations into smaller, more manageable ones. We address this challenge through two key network components: the coarse-to-fine estimation of the target displacement vector field (DVF) and the integration of the Transformer’s feature attention mechanism. To further enhance registration performance, we propose a novel feature correlation-based distance metric that leverages the symmetric properties of the correlation matrix to efficiently exploit feature correlations. Additionally, by utilizing the features extracted directly from the registration network, we eliminate the need for additional feature extraction networks. Experimental results demonstrate that our feature correlation-based loss function is particularly effective in achieving accurate registration in the absence of ground truth data. Our method has proven successful in both mono-modality abdomen CT registration and brain MRI atlas registration, leading to improvements in Dice similarity coefficient and other evaluation metrics.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computers in biology and medicine
Computers in biology and medicine 工程技术-工程:生物医学
CiteScore
11.70
自引率
10.40%
发文量
1086
审稿时长
74 days
期刊介绍: Computers in Biology and Medicine is an international forum for sharing groundbreaking advancements in the use of computers in bioscience and medicine. This journal serves as a medium for communicating essential research, instruction, ideas, and information regarding the rapidly evolving field of computer applications in these domains. By encouraging the exchange of knowledge, we aim to facilitate progress and innovation in the utilization of computers in biology and medicine.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信