FocusMorph: A novel multi-scale fusion network for 3D brain MR image registration

IF 7.5 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Tianyong Liu , Zhiqing Zhang , Guojia Fan , Nan Li , Chengwu Xu , Bin Li , Gang Zhao , Shoujun Zhou
{"title":"FocusMorph: A novel multi-scale fusion network for 3D brain MR image registration","authors":"Tianyong Liu ,&nbsp;Zhiqing Zhang ,&nbsp;Guojia Fan ,&nbsp;Nan Li ,&nbsp;Chengwu Xu ,&nbsp;Bin Li ,&nbsp;Gang Zhao ,&nbsp;Shoujun Zhou","doi":"10.1016/j.patcog.2025.111761","DOIUrl":null,"url":null,"abstract":"<div><div>In the field of medical image processing, registration algorithms are crucial tools, especially in assisting physicians with aligning medical images acquired at different time points or through different modalities. These techniques are particularly important for medical applications such as disease diagnosis, lesion detection, surgical planning, and treatment monitoring. However, although most deep learning-based methods are capable of extracting multiscale features, they may fail to produce outputs that are directly related to the fnal deformation feld. Additionally, many methods based on the U-Net structure overly rely on the last layer of high-resolution images, which represents a significant drawback. To address these issues, we propose a novel unsupervised deformable registration method named FocusMorph. This method centers on the FLatten Transformer block and employs a focused linear attention mechanism to enhance attentional expressivity while maintaining low complexity. We have also designed a layer-by-layer output fusion mechanism and a motion image encoder specifically for medical image registration, which aids in continuously tracking positional differences between motion images and effectively fusing them. Experimental results indicate that the FocusMorph method surpasses current leading medical image registration techniques on two distinct brain image datasets. It achieves improvements in the Dice coefficient by 2.6% and 1.5%, respectively, confirming its superior performance and significant potential in image registration. These findings not only highlight FocusMorph’s robust registration capabilities but also underscore its promising prospects in medical image processing.</div></div>","PeriodicalId":49713,"journal":{"name":"Pattern Recognition","volume":"167 ","pages":"Article 111761"},"PeriodicalIF":7.5000,"publicationDate":"2025-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Recognition","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0031320325004212","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

In the field of medical image processing, registration algorithms are crucial tools, especially in assisting physicians with aligning medical images acquired at different time points or through different modalities. These techniques are particularly important for medical applications such as disease diagnosis, lesion detection, surgical planning, and treatment monitoring. However, although most deep learning-based methods are capable of extracting multiscale features, they may fail to produce outputs that are directly related to the fnal deformation feld. Additionally, many methods based on the U-Net structure overly rely on the last layer of high-resolution images, which represents a significant drawback. To address these issues, we propose a novel unsupervised deformable registration method named FocusMorph. This method centers on the FLatten Transformer block and employs a focused linear attention mechanism to enhance attentional expressivity while maintaining low complexity. We have also designed a layer-by-layer output fusion mechanism and a motion image encoder specifically for medical image registration, which aids in continuously tracking positional differences between motion images and effectively fusing them. Experimental results indicate that the FocusMorph method surpasses current leading medical image registration techniques on two distinct brain image datasets. It achieves improvements in the Dice coefficient by 2.6% and 1.5%, respectively, confirming its superior performance and significant potential in image registration. These findings not only highlight FocusMorph’s robust registration capabilities but also underscore its promising prospects in medical image processing.

Abstract Image

FocusMorph:一种新的多尺度脑磁共振图像配准融合网络
在医学图像处理领域,配准算法是至关重要的工具,特别是在帮助医生对齐在不同时间点或通过不同方式获得的医学图像方面。这些技术对于疾病诊断、病变检测、手术计划和治疗监测等医学应用尤其重要。然而,尽管大多数基于深度学习的方法能够提取多尺度特征,但它们可能无法产生与最终变形场直接相关的输出。此外,许多基于U-Net结构的方法过度依赖最后一层高分辨率图像,这是一个显著的缺点。为了解决这些问题,我们提出了一种新的无监督可变形配准方法FocusMorph。该方法以FLatten Transformer块为中心,采用集中的线性注意机制,在保持低复杂度的同时增强注意表达能力。我们还设计了一种逐层输出融合机制和一种专门用于医学图像配准的运动图像编码器,它有助于连续跟踪运动图像之间的位置差异并有效地融合它们。实验结果表明,FocusMorph方法在两个不同的脑图像数据集上优于目前领先的医学图像配准技术。Dice系数分别提高了2.6%和1.5%,证实了其优越的性能和在图像配准方面的巨大潜力。这些发现不仅突出了FocusMorph强大的配准能力,而且强调了其在医学图像处理方面的广阔前景。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Pattern Recognition
Pattern Recognition 工程技术-工程:电子与电气
CiteScore
14.40
自引率
16.20%
发文量
683
审稿时长
5.6 months
期刊介绍: The field of Pattern Recognition is both mature and rapidly evolving, playing a crucial role in various related fields such as computer vision, image processing, text analysis, and neural networks. It closely intersects with machine learning and is being applied in emerging areas like biometrics, bioinformatics, multimedia data analysis, and data science. The journal Pattern Recognition, established half a century ago during the early days of computer science, has since grown significantly in scope and influence.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信