{"title":"CC-TransXNet:用于从眼底图像自动分割视杯和视盘的混合 CNN 变换器网络。","authors":"Zhongzheng Yuan, Jinke Wang, Yukun Xu, Min Xu","doi":"10.1007/s11517-024-03244-3","DOIUrl":null,"url":null,"abstract":"<p><p>Accurate segmentation of the optic disk (OD) and optic cup (OC) regions of the optic nerve head is a critical step in glaucoma diagnosis. Existing architectures based on convolutional neural networks (CNNs) still suffer from insufficient global information and poor generalization ability to small sample datasets. Besides, advanced transformer-based models, although capable of capturing global image features, perform poorly in medical image segmentation due to numerous parameters and insufficient local spatial information. To address the above two problems, we propose an innovative W-shaped hybrid network framework, CC-TransXNet, which combines the advantages of CNN and transformer. Firstly, by employing TransXNet and improved ResNet as feature extraction modules, the network considers local and global features to enhance its generalization ability. Secondly, the convolutional block attention module (CBAM) is introduced in the residual structure to improve the ability to recognize the OD and OC by applying attention in both the channel and spatial dimensions. Thirdly, the Contextual Attention (CoT) self-attention mechanism is used in the skip connection to adaptively allocate attention to the contextual information, further enhancing the segmentation's accuracy. We conducted experiments on four publicly available datasets (REFUGE 2, RIM-ONE DL, GAMMA, and Drishti-GS). Compared with the traditional U-Net, CNN, and transformer-based networks, our proposed CC-TransXNet improves the segmentation accuracy and significantly enhances the generalization ability on small datasets. Moreover, CC-TransXNet effectively controls the number of parameters in the model through optimized design to avoid the risk of overfitting, proving its potential for efficient segmentation.</p>","PeriodicalId":49840,"journal":{"name":"Medical & Biological Engineering & Computing","volume":" ","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"CC-TransXNet: a hybrid CNN-transformer network for automatic segmentation of optic cup and optic disk from fundus images.\",\"authors\":\"Zhongzheng Yuan, Jinke Wang, Yukun Xu, Min Xu\",\"doi\":\"10.1007/s11517-024-03244-3\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Accurate segmentation of the optic disk (OD) and optic cup (OC) regions of the optic nerve head is a critical step in glaucoma diagnosis. Existing architectures based on convolutional neural networks (CNNs) still suffer from insufficient global information and poor generalization ability to small sample datasets. Besides, advanced transformer-based models, although capable of capturing global image features, perform poorly in medical image segmentation due to numerous parameters and insufficient local spatial information. To address the above two problems, we propose an innovative W-shaped hybrid network framework, CC-TransXNet, which combines the advantages of CNN and transformer. Firstly, by employing TransXNet and improved ResNet as feature extraction modules, the network considers local and global features to enhance its generalization ability. Secondly, the convolutional block attention module (CBAM) is introduced in the residual structure to improve the ability to recognize the OD and OC by applying attention in both the channel and spatial dimensions. Thirdly, the Contextual Attention (CoT) self-attention mechanism is used in the skip connection to adaptively allocate attention to the contextual information, further enhancing the segmentation's accuracy. We conducted experiments on four publicly available datasets (REFUGE 2, RIM-ONE DL, GAMMA, and Drishti-GS). Compared with the traditional U-Net, CNN, and transformer-based networks, our proposed CC-TransXNet improves the segmentation accuracy and significantly enhances the generalization ability on small datasets. Moreover, CC-TransXNet effectively controls the number of parameters in the model through optimized design to avoid the risk of overfitting, proving its potential for efficient segmentation.</p>\",\"PeriodicalId\":49840,\"journal\":{\"name\":\"Medical & Biological Engineering & Computing\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-11-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Medical & Biological Engineering & Computing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1007/s11517-024-03244-3\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical & Biological Engineering & Computing","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s11517-024-03244-3","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
CC-TransXNet: a hybrid CNN-transformer network for automatic segmentation of optic cup and optic disk from fundus images.
Accurate segmentation of the optic disk (OD) and optic cup (OC) regions of the optic nerve head is a critical step in glaucoma diagnosis. Existing architectures based on convolutional neural networks (CNNs) still suffer from insufficient global information and poor generalization ability to small sample datasets. Besides, advanced transformer-based models, although capable of capturing global image features, perform poorly in medical image segmentation due to numerous parameters and insufficient local spatial information. To address the above two problems, we propose an innovative W-shaped hybrid network framework, CC-TransXNet, which combines the advantages of CNN and transformer. Firstly, by employing TransXNet and improved ResNet as feature extraction modules, the network considers local and global features to enhance its generalization ability. Secondly, the convolutional block attention module (CBAM) is introduced in the residual structure to improve the ability to recognize the OD and OC by applying attention in both the channel and spatial dimensions. Thirdly, the Contextual Attention (CoT) self-attention mechanism is used in the skip connection to adaptively allocate attention to the contextual information, further enhancing the segmentation's accuracy. We conducted experiments on four publicly available datasets (REFUGE 2, RIM-ONE DL, GAMMA, and Drishti-GS). Compared with the traditional U-Net, CNN, and transformer-based networks, our proposed CC-TransXNet improves the segmentation accuracy and significantly enhances the generalization ability on small datasets. Moreover, CC-TransXNet effectively controls the number of parameters in the model through optimized design to avoid the risk of overfitting, proving its potential for efficient segmentation.
期刊介绍:
Founded in 1963, Medical & Biological Engineering & Computing (MBEC) continues to serve the biomedical engineering community, covering the entire spectrum of biomedical and clinical engineering. The journal presents exciting and vital experimental and theoretical developments in biomedical science and technology, and reports on advances in computer-based methodologies in these multidisciplinary subjects. The journal also incorporates new and evolving technologies including cellular engineering and molecular imaging.
MBEC publishes original research articles as well as reviews and technical notes. Its Rapid Communications category focuses on material of immediate value to the readership, while the Controversies section provides a forum to exchange views on selected issues, stimulating a vigorous and informed debate in this exciting and high profile field.
MBEC is an official journal of the International Federation of Medical and Biological Engineering (IFMBE).