ConvexAdam: Self-Configuring Dual-Optimisation-Based 3D Multitask Medical Image Registration.

Hanna Siebert, Christoph Grossbrohmer, Lasse Hansen, Mattias P Heinrich
{"title":"ConvexAdam: Self-Configuring Dual-Optimisation-Based 3D Multitask Medical Image Registration.","authors":"Hanna Siebert, Christoph Grossbrohmer, Lasse Hansen, Mattias P Heinrich","doi":"10.1109/TMI.2024.3462248","DOIUrl":null,"url":null,"abstract":"<p><p>Registration of medical image data requires methods that can align anatomical structures precisely while applying smooth and plausible transformations. Ideally, these methods should furthermore operate quickly and apply to a wide variety of tasks. Deep learning-based image registration methods usually entail an elaborate learning procedure with the need for extensive training data. However, they often struggle with versatility when aiming to apply the same approach across various anatomical regions and different imaging modalities. In this work, we present a method that extracts semantic or hand-crafted image features and uses a coupled convex optimisation followed by Adam-based instance optimisation for multitask medical image registration. We make use of pre-trained semantic feature extraction models for the individual datasets and combine them with our fast dual optimisation procedure for deformation field computation. Furthermore, we propose a very fast automatic hyperparameter selection procedure that explores many settings and ranks them on validation data to provide a self-configuring image registration framework. With our approach, we can align image data for various tasks with little learning. We conduct experiments on all available Learn2Reg challenge datasets and obtain results that are to be positioned in the upper ranks of the challenge leaderboards. github.com/multimodallearning/convexAdam.</p>","PeriodicalId":94033,"journal":{"name":"IEEE transactions on medical imaging","volume":"PP ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on medical imaging","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/TMI.2024.3462248","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Registration of medical image data requires methods that can align anatomical structures precisely while applying smooth and plausible transformations. Ideally, these methods should furthermore operate quickly and apply to a wide variety of tasks. Deep learning-based image registration methods usually entail an elaborate learning procedure with the need for extensive training data. However, they often struggle with versatility when aiming to apply the same approach across various anatomical regions and different imaging modalities. In this work, we present a method that extracts semantic or hand-crafted image features and uses a coupled convex optimisation followed by Adam-based instance optimisation for multitask medical image registration. We make use of pre-trained semantic feature extraction models for the individual datasets and combine them with our fast dual optimisation procedure for deformation field computation. Furthermore, we propose a very fast automatic hyperparameter selection procedure that explores many settings and ranks them on validation data to provide a self-configuring image registration framework. With our approach, we can align image data for various tasks with little learning. We conduct experiments on all available Learn2Reg challenge datasets and obtain results that are to be positioned in the upper ranks of the challenge leaderboards. github.com/multimodallearning/convexAdam.

ConvexAdam:基于自配置双优化的三维多任务医学图像配准。
医学图像数据的配准需要能精确对准解剖结构的方法,同时应用平滑、合理的变换。理想情况下,这些方法应能快速运行,并适用于各种任务。基于深度学习的图像配准方法通常需要复杂的学习过程,并需要大量的训练数据。然而,当要在不同的解剖区域和不同的成像模式中应用同一种方法时,这些方法往往难以实现通用性。在这项工作中,我们提出了一种提取语义或手工制作图像特征的方法,并将耦合凸优化和基于亚当的实例优化用于多任务医学图像配准。我们利用为各个数据集预先训练好的语义特征提取模型,并将其与我们的快速双重优化程序相结合,进行变形场计算。此外,我们还提出了一种非常快速的自动超参数选择程序,该程序可探索多种设置,并根据验证数据对其进行排序,从而提供一个可自行配置的图像配准框架。利用我们的方法,我们只需很少的学习就能为各种任务配准图像数据。我们在所有可用的 Learn2Reg 挑战数据集上进行了实验,并取得了在挑战排行榜上名列前茅的结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信