Zhengwei Wang , Xukun Zhang , Xiaoying Wang , Lihua Zhang
{"title":"Enhanced multi-modal abdominal image registration via structural awareness and region-specific optimization","authors":"Zhengwei Wang , Xukun Zhang , Xiaoying Wang , Lihua Zhang","doi":"10.1016/j.patrec.2024.11.026","DOIUrl":null,"url":null,"abstract":"<div><div>Multi-modal abdominal image registration is a critical step in achieving accurate diagnosis and treatment. However, the large field of view, complex organ structures, and significant anatomical variability in the abdominal region pose substantial challenges to precise multi-modal registration. To address these challenges, we propose a novel framework based on structural awareness and region-specific optimization, which progressively enhances registration accuracy through a hierarchical strategy. The core innovation lies in introducing the Modality Independent Structural Awareness (MISA) loss, which comprises two key components: first, it ensures structural consistency across modalities by deeply understanding the critical anatomical structures; second, it employs a region-specific weighting strategy to prioritize key anatomical regions, such as organ boundaries, thereby achieving high-precision, region-specific constraints in multi-modal registration. Experimental results demonstrate that our method outperforms state-of-the-art approaches on two public multi-modal abdominal datasets, particularly in accurately capturing complex anatomical structures and maintaining tissue consistency. Further analysis confirms that the MISA loss and its two innovative components are pivotal in enhancing multi-modal abdominal image registration accuracy.</div></div>","PeriodicalId":54638,"journal":{"name":"Pattern Recognition Letters","volume":"188 ","pages":"Pages 29-36"},"PeriodicalIF":3.9000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Recognition Letters","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167865524003398","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Multi-modal abdominal image registration is a critical step in achieving accurate diagnosis and treatment. However, the large field of view, complex organ structures, and significant anatomical variability in the abdominal region pose substantial challenges to precise multi-modal registration. To address these challenges, we propose a novel framework based on structural awareness and region-specific optimization, which progressively enhances registration accuracy through a hierarchical strategy. The core innovation lies in introducing the Modality Independent Structural Awareness (MISA) loss, which comprises two key components: first, it ensures structural consistency across modalities by deeply understanding the critical anatomical structures; second, it employs a region-specific weighting strategy to prioritize key anatomical regions, such as organ boundaries, thereby achieving high-precision, region-specific constraints in multi-modal registration. Experimental results demonstrate that our method outperforms state-of-the-art approaches on two public multi-modal abdominal datasets, particularly in accurately capturing complex anatomical structures and maintaining tissue consistency. Further analysis confirms that the MISA loss and its two innovative components are pivotal in enhancing multi-modal abdominal image registration accuracy.
期刊介绍:
Pattern Recognition Letters aims at rapid publication of concise articles of a broad interest in pattern recognition.
Subject areas include all the current fields of interest represented by the Technical Committees of the International Association of Pattern Recognition, and other developing themes involving learning and recognition.