3D MedicalDet-Mamba:用于医疗对象检测和定位的混合Mamba-CNN网络

IF 2.5 4区 计算机科学 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Shanshan Li, Zijie Shen, Yuhan Zhang, Hua Lai, Song Tan, Wei Chen
{"title":"3D MedicalDet-Mamba:用于医疗对象检测和定位的混合Mamba-CNN网络","authors":"Shanshan Li,&nbsp;Zijie Shen,&nbsp;Yuhan Zhang,&nbsp;Hua Lai,&nbsp;Song Tan,&nbsp;Wei Chen","doi":"10.1002/ima.70139","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>3D object detection in medical imaging poses significant challenges due to the high dimensionality and complex spatial relationships of volumetric data. Recent advancements with convolutional neural network (CNN)- and transformer-based approaches have shown promise; however, CNNs struggle with capturing long-range dependencies, while transformers incur high computational and memory costs when handling high-resolution 3D medical images. Mamba-based models offer an efficient alternative by modeling long-range dependencies in a linear manner, reducing complexity while maintaining effective feature representation. This study introduces 3D MedicalDet-Mamba, a novel hybrid framework that integrates the complementary strengths of CNNs and Mamba for precise 3D medical object detection and localization. Specifically, we propose the locality-integrated Mamba (LIM) module, which combines parallel multi-kernel convolutions with Mamba-based blocks to capture both global dependencies and fine-grained local structures, ensuring a more comprehensive feature representation. Additionally, we introduce the inter-scale aggregation Mamba (ISAM) block, a Mamba-based component that leverages hexa-hierarchical 3D slice (HH3S) scanning to aggregate multi-scale voxel-level features. This mechanism enhances the separation of medical objects from complex backgrounds while improving global feature extraction efficiency. Experimental results on public datasets show that 3D MedicalDet-Mamba outperforms state-of-the-art methods in both detection and localization accuracy. Code is available at https://github.com/ssli23/3D-MedicalDet-Mamba.</p>\n </div>","PeriodicalId":14027,"journal":{"name":"International Journal of Imaging Systems and Technology","volume":"35 4","pages":""},"PeriodicalIF":2.5000,"publicationDate":"2025-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"3D MedicalDet-Mamba: A Hybrid Mamba-CNN Network for Medical Object Detection and Localization\",\"authors\":\"Shanshan Li,&nbsp;Zijie Shen,&nbsp;Yuhan Zhang,&nbsp;Hua Lai,&nbsp;Song Tan,&nbsp;Wei Chen\",\"doi\":\"10.1002/ima.70139\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>3D object detection in medical imaging poses significant challenges due to the high dimensionality and complex spatial relationships of volumetric data. Recent advancements with convolutional neural network (CNN)- and transformer-based approaches have shown promise; however, CNNs struggle with capturing long-range dependencies, while transformers incur high computational and memory costs when handling high-resolution 3D medical images. Mamba-based models offer an efficient alternative by modeling long-range dependencies in a linear manner, reducing complexity while maintaining effective feature representation. This study introduces 3D MedicalDet-Mamba, a novel hybrid framework that integrates the complementary strengths of CNNs and Mamba for precise 3D medical object detection and localization. Specifically, we propose the locality-integrated Mamba (LIM) module, which combines parallel multi-kernel convolutions with Mamba-based blocks to capture both global dependencies and fine-grained local structures, ensuring a more comprehensive feature representation. Additionally, we introduce the inter-scale aggregation Mamba (ISAM) block, a Mamba-based component that leverages hexa-hierarchical 3D slice (HH3S) scanning to aggregate multi-scale voxel-level features. This mechanism enhances the separation of medical objects from complex backgrounds while improving global feature extraction efficiency. Experimental results on public datasets show that 3D MedicalDet-Mamba outperforms state-of-the-art methods in both detection and localization accuracy. Code is available at https://github.com/ssli23/3D-MedicalDet-Mamba.</p>\\n </div>\",\"PeriodicalId\":14027,\"journal\":{\"name\":\"International Journal of Imaging Systems and Technology\",\"volume\":\"35 4\",\"pages\":\"\"},\"PeriodicalIF\":2.5000,\"publicationDate\":\"2025-06-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Imaging Systems and Technology\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/ima.70139\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Imaging Systems and Technology","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/ima.70139","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

由于体积数据的高维性和复杂的空间关系,医学成像中的三维目标检测面临着巨大的挑战。卷积神经网络(CNN)和基于变压器的方法的最新进展显示出了希望;然而,cnn在捕获远程依赖关系方面存在困难,而在处理高分辨率3D医学图像时,变压器会产生高计算和内存成本。基于mamba的模型通过以线性方式建模远程依赖关系提供了一种有效的替代方案,在保持有效特征表示的同时降低了复杂性。本研究介绍了3D MedicalDet-Mamba,这是一种新颖的混合框架,集成了cnn和Mamba的互补优势,用于精确的3D医疗对象检测和定位。具体而言,我们提出了位置集成Mamba (LIM)模块,该模块将并行多核卷积与基于Mamba的块相结合,以捕获全局依赖关系和细粒度局部结构,确保更全面的特征表示。此外,我们介绍了尺度间聚合曼巴(ISAM)块,这是一个基于曼巴的组件,它利用六层三维切片(HH3S)扫描来聚合多尺度体素级特征。该机制增强了医学对象与复杂背景的分离,同时提高了全局特征提取效率。在公共数据集上的实验结果表明,3D MedicalDet-Mamba在检测和定位精度方面都优于最先进的方法。代码可从https://github.com/ssli23/3D-MedicalDet-Mamba获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
3D MedicalDet-Mamba: A Hybrid Mamba-CNN Network for Medical Object Detection and Localization

3D object detection in medical imaging poses significant challenges due to the high dimensionality and complex spatial relationships of volumetric data. Recent advancements with convolutional neural network (CNN)- and transformer-based approaches have shown promise; however, CNNs struggle with capturing long-range dependencies, while transformers incur high computational and memory costs when handling high-resolution 3D medical images. Mamba-based models offer an efficient alternative by modeling long-range dependencies in a linear manner, reducing complexity while maintaining effective feature representation. This study introduces 3D MedicalDet-Mamba, a novel hybrid framework that integrates the complementary strengths of CNNs and Mamba for precise 3D medical object detection and localization. Specifically, we propose the locality-integrated Mamba (LIM) module, which combines parallel multi-kernel convolutions with Mamba-based blocks to capture both global dependencies and fine-grained local structures, ensuring a more comprehensive feature representation. Additionally, we introduce the inter-scale aggregation Mamba (ISAM) block, a Mamba-based component that leverages hexa-hierarchical 3D slice (HH3S) scanning to aggregate multi-scale voxel-level features. This mechanism enhances the separation of medical objects from complex backgrounds while improving global feature extraction efficiency. Experimental results on public datasets show that 3D MedicalDet-Mamba outperforms state-of-the-art methods in both detection and localization accuracy. Code is available at https://github.com/ssli23/3D-MedicalDet-Mamba.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
International Journal of Imaging Systems and Technology
International Journal of Imaging Systems and Technology 工程技术-成像科学与照相技术
CiteScore
6.90
自引率
6.10%
发文量
138
审稿时长
3 months
期刊介绍: The International Journal of Imaging Systems and Technology (IMA) is a forum for the exchange of ideas and results relevant to imaging systems, including imaging physics and informatics. The journal covers all imaging modalities in humans and animals. IMA accepts technically sound and scientifically rigorous research in the interdisciplinary field of imaging, including relevant algorithmic research and hardware and software development, and their applications relevant to medical research. The journal provides a platform to publish original research in structural and functional imaging. The journal is also open to imaging studies of the human body and on animals that describe novel diagnostic imaging and analyses methods. Technical, theoretical, and clinical research in both normal and clinical populations is encouraged. Submissions describing methods, software, databases, replication studies as well as negative results are also considered. The scope of the journal includes, but is not limited to, the following in the context of biomedical research: Imaging and neuro-imaging modalities: structural MRI, functional MRI, PET, SPECT, CT, ultrasound, EEG, MEG, NIRS etc.; Neuromodulation and brain stimulation techniques such as TMS and tDCS; Software and hardware for imaging, especially related to human and animal health; Image segmentation in normal and clinical populations; Pattern analysis and classification using machine learning techniques; Computational modeling and analysis; Brain connectivity and connectomics; Systems-level characterization of brain function; Neural networks and neurorobotics; Computer vision, based on human/animal physiology; Brain-computer interface (BCI) technology; Big data, databasing and data mining.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信