{"title":"MFA U-Net:用于医学图像分割的类似 U-Net 的多级特征分析网络","authors":"Yupeng Wang, Suyu Wang, Jian He","doi":"10.1007/s10044-024-01331-7","DOIUrl":null,"url":null,"abstract":"<p>The U-Net and its extensions have achieved good success in medical image segmentation. However, fine-grained segmentation of the objects at their fuzzy edges, which is commonly found in medical images, is still challenging. In this paper, we propose a U-Net like Multi-Stage Feature Analysis Network (MFA U-Net) for medical image segmentation, which focus on mining the reusability of the images and features from several perspectives. Firstly, a multi-channel dimensional feature extraction module is proposed, where the input image was reused by multiple branches of convolutions with different channels to generate supplement features to the original U shaped network. Next, a cascaded U-shaped network is designed for deeper feature mining and analysis, which enables progressive refinement of the features. In the neck of the cascaded network, a parallel hybrid convolution module is designed that concatenating several types of convolutional methods to enhance the semantic representation ability of the model. In short, by reusing of the input images and detected features in several stages, more effective features were extracted and the segmentation performances were improved. The proposed algorithm was evaluated by three mainstream 2D color medical image segmentation datasets and gets significant improvements compared with the traditional U-Net framework, as well as the latest improved ones. Compared to the baseline network, it gets the improvements of 0.93% (Dice) and 1.45% (IoU) on GlaS, 2.09% (Dice) and 2.87% (IoU) on MoNuSeg, and 0.17% (F1) and 1.72% (SE) on DRIVE.</p>","PeriodicalId":54639,"journal":{"name":"Pattern Analysis and Applications","volume":"11 1","pages":""},"PeriodicalIF":3.7000,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"MFA U-Net: a U-Net like multi-stage feature analysis network for medical image segmentation\",\"authors\":\"Yupeng Wang, Suyu Wang, Jian He\",\"doi\":\"10.1007/s10044-024-01331-7\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>The U-Net and its extensions have achieved good success in medical image segmentation. However, fine-grained segmentation of the objects at their fuzzy edges, which is commonly found in medical images, is still challenging. In this paper, we propose a U-Net like Multi-Stage Feature Analysis Network (MFA U-Net) for medical image segmentation, which focus on mining the reusability of the images and features from several perspectives. Firstly, a multi-channel dimensional feature extraction module is proposed, where the input image was reused by multiple branches of convolutions with different channels to generate supplement features to the original U shaped network. Next, a cascaded U-shaped network is designed for deeper feature mining and analysis, which enables progressive refinement of the features. In the neck of the cascaded network, a parallel hybrid convolution module is designed that concatenating several types of convolutional methods to enhance the semantic representation ability of the model. In short, by reusing of the input images and detected features in several stages, more effective features were extracted and the segmentation performances were improved. The proposed algorithm was evaluated by three mainstream 2D color medical image segmentation datasets and gets significant improvements compared with the traditional U-Net framework, as well as the latest improved ones. Compared to the baseline network, it gets the improvements of 0.93% (Dice) and 1.45% (IoU) on GlaS, 2.09% (Dice) and 2.87% (IoU) on MoNuSeg, and 0.17% (F1) and 1.72% (SE) on DRIVE.</p>\",\"PeriodicalId\":54639,\"journal\":{\"name\":\"Pattern Analysis and Applications\",\"volume\":\"11 1\",\"pages\":\"\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-09-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Pattern Analysis and Applications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s10044-024-01331-7\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Analysis and Applications","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s10044-024-01331-7","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
摘要
U-Net 及其扩展技术在医学图像分割方面取得了巨大成功。然而,对医学图像中常见的模糊边缘物体进行细粒度分割仍然具有挑战性。本文提出了一种类似于多阶段特征分析网络(MFA U-Net)的医学图像分割方法,主要从几个方面挖掘图像和特征的可重用性。首先,提出了一个多通道维度特征提取模块,通过不同通道的卷积分支对输入图像进行重用,以生成对原始 U 形网络的补充特征。接下来,设计了一个级联 U 型网络,用于更深层次的特征挖掘和分析,从而实现对特征的逐步细化。在级联网络的颈部,设计了一个并行混合卷积模块,将多种卷积方法串联起来,以增强模型的语义表征能力。总之,通过在多个阶段重复使用输入图像和检测到的特征,提取出了更有效的特征,提高了分割性能。通过三个主流二维彩色医学图像分割数据集对所提出的算法进行了评估,结果表明,与传统的 U-Net 框架以及最新改进的 U-Net 框架相比,所提出的算法有了显著的改进。与基线网络相比,该算法在 GlaS 上提高了 0.93%(Dice)和 1.45%(IoU),在 MoNuSeg 上提高了 2.09%(Dice)和 2.87%(IoU),在 DRIVE 上提高了 0.17%(F1)和 1.72%(SE)。
MFA U-Net: a U-Net like multi-stage feature analysis network for medical image segmentation
The U-Net and its extensions have achieved good success in medical image segmentation. However, fine-grained segmentation of the objects at their fuzzy edges, which is commonly found in medical images, is still challenging. In this paper, we propose a U-Net like Multi-Stage Feature Analysis Network (MFA U-Net) for medical image segmentation, which focus on mining the reusability of the images and features from several perspectives. Firstly, a multi-channel dimensional feature extraction module is proposed, where the input image was reused by multiple branches of convolutions with different channels to generate supplement features to the original U shaped network. Next, a cascaded U-shaped network is designed for deeper feature mining and analysis, which enables progressive refinement of the features. In the neck of the cascaded network, a parallel hybrid convolution module is designed that concatenating several types of convolutional methods to enhance the semantic representation ability of the model. In short, by reusing of the input images and detected features in several stages, more effective features were extracted and the segmentation performances were improved. The proposed algorithm was evaluated by three mainstream 2D color medical image segmentation datasets and gets significant improvements compared with the traditional U-Net framework, as well as the latest improved ones. Compared to the baseline network, it gets the improvements of 0.93% (Dice) and 1.45% (IoU) on GlaS, 2.09% (Dice) and 2.87% (IoU) on MoNuSeg, and 0.17% (F1) and 1.72% (SE) on DRIVE.
期刊介绍:
The journal publishes high quality articles in areas of fundamental research in intelligent pattern analysis and applications in computer science and engineering. It aims to provide a forum for original research which describes novel pattern analysis techniques and industrial applications of the current technology. In addition, the journal will also publish articles on pattern analysis applications in medical imaging. The journal solicits articles that detail new technology and methods for pattern recognition and analysis in applied domains including, but not limited to, computer vision and image processing, speech analysis, robotics, multimedia, document analysis, character recognition, knowledge engineering for pattern recognition, fractal analysis, and intelligent control. The journal publishes articles on the use of advanced pattern recognition and analysis methods including statistical techniques, neural networks, genetic algorithms, fuzzy pattern recognition, machine learning, and hardware implementations which are either relevant to the development of pattern analysis as a research area or detail novel pattern analysis applications. Papers proposing new classifier systems or their development, pattern analysis systems for real-time applications, fuzzy and temporal pattern recognition and uncertainty management in applied pattern recognition are particularly solicited.