{"title":"3D MedicalDet-Mamba:用于医疗对象检测和定位的混合Mamba-CNN网络","authors":"Shanshan Li, Zijie Shen, Yuhan Zhang, Hua Lai, Song Tan, Wei Chen","doi":"10.1002/ima.70139","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>3D object detection in medical imaging poses significant challenges due to the high dimensionality and complex spatial relationships of volumetric data. Recent advancements with convolutional neural network (CNN)- and transformer-based approaches have shown promise; however, CNNs struggle with capturing long-range dependencies, while transformers incur high computational and memory costs when handling high-resolution 3D medical images. Mamba-based models offer an efficient alternative by modeling long-range dependencies in a linear manner, reducing complexity while maintaining effective feature representation. This study introduces 3D MedicalDet-Mamba, a novel hybrid framework that integrates the complementary strengths of CNNs and Mamba for precise 3D medical object detection and localization. Specifically, we propose the locality-integrated Mamba (LIM) module, which combines parallel multi-kernel convolutions with Mamba-based blocks to capture both global dependencies and fine-grained local structures, ensuring a more comprehensive feature representation. Additionally, we introduce the inter-scale aggregation Mamba (ISAM) block, a Mamba-based component that leverages hexa-hierarchical 3D slice (HH3S) scanning to aggregate multi-scale voxel-level features. This mechanism enhances the separation of medical objects from complex backgrounds while improving global feature extraction efficiency. Experimental results on public datasets show that 3D MedicalDet-Mamba outperforms state-of-the-art methods in both detection and localization accuracy. Code is available at https://github.com/ssli23/3D-MedicalDet-Mamba.</p>\n </div>","PeriodicalId":14027,"journal":{"name":"International Journal of Imaging Systems and Technology","volume":"35 4","pages":""},"PeriodicalIF":2.5000,"publicationDate":"2025-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"3D MedicalDet-Mamba: A Hybrid Mamba-CNN Network for Medical Object Detection and Localization\",\"authors\":\"Shanshan Li, Zijie Shen, Yuhan Zhang, Hua Lai, Song Tan, Wei Chen\",\"doi\":\"10.1002/ima.70139\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>3D object detection in medical imaging poses significant challenges due to the high dimensionality and complex spatial relationships of volumetric data. Recent advancements with convolutional neural network (CNN)- and transformer-based approaches have shown promise; however, CNNs struggle with capturing long-range dependencies, while transformers incur high computational and memory costs when handling high-resolution 3D medical images. Mamba-based models offer an efficient alternative by modeling long-range dependencies in a linear manner, reducing complexity while maintaining effective feature representation. This study introduces 3D MedicalDet-Mamba, a novel hybrid framework that integrates the complementary strengths of CNNs and Mamba for precise 3D medical object detection and localization. Specifically, we propose the locality-integrated Mamba (LIM) module, which combines parallel multi-kernel convolutions with Mamba-based blocks to capture both global dependencies and fine-grained local structures, ensuring a more comprehensive feature representation. Additionally, we introduce the inter-scale aggregation Mamba (ISAM) block, a Mamba-based component that leverages hexa-hierarchical 3D slice (HH3S) scanning to aggregate multi-scale voxel-level features. This mechanism enhances the separation of medical objects from complex backgrounds while improving global feature extraction efficiency. Experimental results on public datasets show that 3D MedicalDet-Mamba outperforms state-of-the-art methods in both detection and localization accuracy. Code is available at https://github.com/ssli23/3D-MedicalDet-Mamba.</p>\\n </div>\",\"PeriodicalId\":14027,\"journal\":{\"name\":\"International Journal of Imaging Systems and Technology\",\"volume\":\"35 4\",\"pages\":\"\"},\"PeriodicalIF\":2.5000,\"publicationDate\":\"2025-06-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Imaging Systems and Technology\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/ima.70139\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Imaging Systems and Technology","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/ima.70139","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
3D MedicalDet-Mamba: A Hybrid Mamba-CNN Network for Medical Object Detection and Localization
3D object detection in medical imaging poses significant challenges due to the high dimensionality and complex spatial relationships of volumetric data. Recent advancements with convolutional neural network (CNN)- and transformer-based approaches have shown promise; however, CNNs struggle with capturing long-range dependencies, while transformers incur high computational and memory costs when handling high-resolution 3D medical images. Mamba-based models offer an efficient alternative by modeling long-range dependencies in a linear manner, reducing complexity while maintaining effective feature representation. This study introduces 3D MedicalDet-Mamba, a novel hybrid framework that integrates the complementary strengths of CNNs and Mamba for precise 3D medical object detection and localization. Specifically, we propose the locality-integrated Mamba (LIM) module, which combines parallel multi-kernel convolutions with Mamba-based blocks to capture both global dependencies and fine-grained local structures, ensuring a more comprehensive feature representation. Additionally, we introduce the inter-scale aggregation Mamba (ISAM) block, a Mamba-based component that leverages hexa-hierarchical 3D slice (HH3S) scanning to aggregate multi-scale voxel-level features. This mechanism enhances the separation of medical objects from complex backgrounds while improving global feature extraction efficiency. Experimental results on public datasets show that 3D MedicalDet-Mamba outperforms state-of-the-art methods in both detection and localization accuracy. Code is available at https://github.com/ssli23/3D-MedicalDet-Mamba.
期刊介绍:
The International Journal of Imaging Systems and Technology (IMA) is a forum for the exchange of ideas and results relevant to imaging systems, including imaging physics and informatics. The journal covers all imaging modalities in humans and animals.
IMA accepts technically sound and scientifically rigorous research in the interdisciplinary field of imaging, including relevant algorithmic research and hardware and software development, and their applications relevant to medical research. The journal provides a platform to publish original research in structural and functional imaging.
The journal is also open to imaging studies of the human body and on animals that describe novel diagnostic imaging and analyses methods. Technical, theoretical, and clinical research in both normal and clinical populations is encouraged. Submissions describing methods, software, databases, replication studies as well as negative results are also considered.
The scope of the journal includes, but is not limited to, the following in the context of biomedical research:
Imaging and neuro-imaging modalities: structural MRI, functional MRI, PET, SPECT, CT, ultrasound, EEG, MEG, NIRS etc.;
Neuromodulation and brain stimulation techniques such as TMS and tDCS;
Software and hardware for imaging, especially related to human and animal health;
Image segmentation in normal and clinical populations;
Pattern analysis and classification using machine learning techniques;
Computational modeling and analysis;
Brain connectivity and connectomics;
Systems-level characterization of brain function;
Neural networks and neurorobotics;
Computer vision, based on human/animal physiology;
Brain-computer interface (BCI) technology;
Big data, databasing and data mining.