Heeyeon Kim , Minkyung Lee , Bohyoung Kim , Yeong-Gil Shin , Minyoung Chung
{"title":"使用变换器和相关距离对大型变形图像进行以特征为中心的配准。","authors":"Heeyeon Kim , Minkyung Lee , Bohyoung Kim , Yeong-Gil Shin , Minyoung Chung","doi":"10.1016/j.compbiomed.2024.109356","DOIUrl":null,"url":null,"abstract":"<div><div>In deformable medical image registration, both a robust backbone registration network and a suitable similarity metric are essential. This paper introduces a robust registration network combined with a feature-based loss function, specifically designed to handle large deformations and address the challenge of the absence of ground truth data. Tackling large deformations typically requires either expanding the receptive field or breaking down extensive deformations into smaller, more manageable ones. We address this challenge through two key network components: the coarse-to-fine estimation of the target displacement vector field (DVF) and the integration of the Transformer’s feature attention mechanism. To further enhance registration performance, we propose a novel feature correlation-based distance metric that leverages the symmetric properties of the correlation matrix to efficiently exploit feature correlations. Additionally, by utilizing the features extracted directly from the registration network, we eliminate the need for additional feature extraction networks. Experimental results demonstrate that our feature correlation-based loss function is particularly effective in achieving accurate registration in the absence of ground truth data. Our method has proven successful in both mono-modality abdomen CT registration and brain MRI atlas registration, leading to improvements in Dice similarity coefficient and other evaluation metrics.</div></div>","PeriodicalId":10578,"journal":{"name":"Computers in biology and medicine","volume":"184 ","pages":"Article 109356"},"PeriodicalIF":7.0000,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Feature-centric registration of large deformed images using transformers and correlation distance\",\"authors\":\"Heeyeon Kim , Minkyung Lee , Bohyoung Kim , Yeong-Gil Shin , Minyoung Chung\",\"doi\":\"10.1016/j.compbiomed.2024.109356\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In deformable medical image registration, both a robust backbone registration network and a suitable similarity metric are essential. This paper introduces a robust registration network combined with a feature-based loss function, specifically designed to handle large deformations and address the challenge of the absence of ground truth data. Tackling large deformations typically requires either expanding the receptive field or breaking down extensive deformations into smaller, more manageable ones. We address this challenge through two key network components: the coarse-to-fine estimation of the target displacement vector field (DVF) and the integration of the Transformer’s feature attention mechanism. To further enhance registration performance, we propose a novel feature correlation-based distance metric that leverages the symmetric properties of the correlation matrix to efficiently exploit feature correlations. Additionally, by utilizing the features extracted directly from the registration network, we eliminate the need for additional feature extraction networks. Experimental results demonstrate that our feature correlation-based loss function is particularly effective in achieving accurate registration in the absence of ground truth data. Our method has proven successful in both mono-modality abdomen CT registration and brain MRI atlas registration, leading to improvements in Dice similarity coefficient and other evaluation metrics.</div></div>\",\"PeriodicalId\":10578,\"journal\":{\"name\":\"Computers in biology and medicine\",\"volume\":\"184 \",\"pages\":\"Article 109356\"},\"PeriodicalIF\":7.0000,\"publicationDate\":\"2024-11-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers in biology and medicine\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0010482524014410\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"BIOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers in biology and medicine","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0010482524014410","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"BIOLOGY","Score":null,"Total":0}
Feature-centric registration of large deformed images using transformers and correlation distance
In deformable medical image registration, both a robust backbone registration network and a suitable similarity metric are essential. This paper introduces a robust registration network combined with a feature-based loss function, specifically designed to handle large deformations and address the challenge of the absence of ground truth data. Tackling large deformations typically requires either expanding the receptive field or breaking down extensive deformations into smaller, more manageable ones. We address this challenge through two key network components: the coarse-to-fine estimation of the target displacement vector field (DVF) and the integration of the Transformer’s feature attention mechanism. To further enhance registration performance, we propose a novel feature correlation-based distance metric that leverages the symmetric properties of the correlation matrix to efficiently exploit feature correlations. Additionally, by utilizing the features extracted directly from the registration network, we eliminate the need for additional feature extraction networks. Experimental results demonstrate that our feature correlation-based loss function is particularly effective in achieving accurate registration in the absence of ground truth data. Our method has proven successful in both mono-modality abdomen CT registration and brain MRI atlas registration, leading to improvements in Dice similarity coefficient and other evaluation metrics.
期刊介绍:
Computers in Biology and Medicine is an international forum for sharing groundbreaking advancements in the use of computers in bioscience and medicine. This journal serves as a medium for communicating essential research, instruction, ideas, and information regarding the rapidly evolving field of computer applications in these domains. By encouraging the exchange of knowledge, we aim to facilitate progress and innovation in the utilization of computers in biology and medicine.