Linfeng Li , Jiayang Liu , Shanxiong Chen , Jingjie Wang , Yongmei Li , Qihua Liao , Lin Zhang , Xihua Peng , Xu Pu
{"title":"Segmentation of acute ischemic stroke lesions based on deep feature fusion","authors":"Linfeng Li , Jiayang Liu , Shanxiong Chen , Jingjie Wang , Yongmei Li , Qihua Liao , Lin Zhang , Xihua Peng , Xu Pu","doi":"10.1016/j.inffus.2024.102724","DOIUrl":null,"url":null,"abstract":"<div><div>Acute ischemic stroke (AIS) is a common brain disease worldwide, and diagnosing AIS requires effectively utilizing information from multiple Computed Tomography Perfusion (CTP) maps. As far as we know, most methods independently process each CTP map or fail to fully utilize medical prior information when integrating the information from CTP maps. Considering the characteristics of AIS lesions, we propose a method for efficient information fusion of CTP maps to achieve accurate segmentation results. We propose Window Multi-Head Cross-Attention Net (WMHCA-Net), which employs a multi-path U-shaped architecture for encoding and decoding. After encoding, multiple independent windowed cross-attentions are used to deeply integrate information from different maps. During the decoding phase, a Channel Cross-Attention (CCA) module is utilized to enhance information recovery during upsampling. We also added a segmentation optimization module to optimize low-resolution segmentation results, improving the overall performance. Finally, experimental results demonstrate that our proposed method exhibits strong balance and excels across multiple metrics. It can provide more accurate AIS lesion segmentation results to assist doctors in evaluating patient conditions. Our code are available at <span><span>https://github.com/MTVLab/WMHCA-Net</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50367,"journal":{"name":"Information Fusion","volume":"114 ","pages":"Article 102724"},"PeriodicalIF":14.7000,"publicationDate":"2024-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Fusion","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1566253524005025","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Acute ischemic stroke (AIS) is a common brain disease worldwide, and diagnosing AIS requires effectively utilizing information from multiple Computed Tomography Perfusion (CTP) maps. As far as we know, most methods independently process each CTP map or fail to fully utilize medical prior information when integrating the information from CTP maps. Considering the characteristics of AIS lesions, we propose a method for efficient information fusion of CTP maps to achieve accurate segmentation results. We propose Window Multi-Head Cross-Attention Net (WMHCA-Net), which employs a multi-path U-shaped architecture for encoding and decoding. After encoding, multiple independent windowed cross-attentions are used to deeply integrate information from different maps. During the decoding phase, a Channel Cross-Attention (CCA) module is utilized to enhance information recovery during upsampling. We also added a segmentation optimization module to optimize low-resolution segmentation results, improving the overall performance. Finally, experimental results demonstrate that our proposed method exhibits strong balance and excels across multiple metrics. It can provide more accurate AIS lesion segmentation results to assist doctors in evaluating patient conditions. Our code are available at https://github.com/MTVLab/WMHCA-Net.
期刊介绍:
Information Fusion serves as a central platform for showcasing advancements in multi-sensor, multi-source, multi-process information fusion, fostering collaboration among diverse disciplines driving its progress. It is the leading outlet for sharing research and development in this field, focusing on architectures, algorithms, and applications. Papers dealing with fundamental theoretical analyses as well as those demonstrating their application to real-world problems will be welcome.