{"title":"基于低参数特征过滤的医学图像分割网络","authors":"Zitong Ren , Zhiqing Guo , Liejun Wang, Lianghui Xu, Chao Liu","doi":"10.1016/j.asoc.2024.112399","DOIUrl":null,"url":null,"abstract":"<div><div>In recent years, the medical image segmentation method based on hybrid convolutional neural network (CNN) and Vision Transformer (ViT) has made great progress, but it still faces the challenge of unbalanced global and local modeling, and excessive parameters. In addition, ViT repeatedly uses the whole feature map to model the global information, thus generating irrelevant and weakly related information, which will weaken the performance of the model when facing small datasets and segmentation targets. Therefore, this paper proposes a feature screening network based on similarity, named Screening Feature (SF)-MixedNet. Specifically, this paper first proposes a new feature extractor, namely Correlation based Similarity Transformer (CSimFormer). On the basis of parameter pruning, it uses the Screening Feature Multi-head Self Attention (SF-MSA) to establish the remote dependency, and calculates the similarity between local elements through the Location-Sensitive Mechanism (LsM) to obtain the weight matrix. Then, the correlation between regional elements is mined by Region Matching and Selection (RMS) mechanism, and the obtained information is filtered according to the corresponding rules to reduce the side effects of redundant information. Extensive experiments on Synapse dataset, ACDC dataset and SegPC-2021 dataset show that the segmentation accuracy reaches 83.51%, 92.20% and 81.27% respectively. Especially in the Synapse dataset, our method is 6.31% higher than the baseline. The method proposed in this paper effectively improves the segmentation accuracy, provides more detailed information for medical diagnosis and promotes the development of medical artificial intelligence technology.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"167 ","pages":"Article 112399"},"PeriodicalIF":7.2000,"publicationDate":"2024-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Medical image segmentation network based on feature filtering with low number of parameters\",\"authors\":\"Zitong Ren , Zhiqing Guo , Liejun Wang, Lianghui Xu, Chao Liu\",\"doi\":\"10.1016/j.asoc.2024.112399\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In recent years, the medical image segmentation method based on hybrid convolutional neural network (CNN) and Vision Transformer (ViT) has made great progress, but it still faces the challenge of unbalanced global and local modeling, and excessive parameters. In addition, ViT repeatedly uses the whole feature map to model the global information, thus generating irrelevant and weakly related information, which will weaken the performance of the model when facing small datasets and segmentation targets. Therefore, this paper proposes a feature screening network based on similarity, named Screening Feature (SF)-MixedNet. Specifically, this paper first proposes a new feature extractor, namely Correlation based Similarity Transformer (CSimFormer). On the basis of parameter pruning, it uses the Screening Feature Multi-head Self Attention (SF-MSA) to establish the remote dependency, and calculates the similarity between local elements through the Location-Sensitive Mechanism (LsM) to obtain the weight matrix. Then, the correlation between regional elements is mined by Region Matching and Selection (RMS) mechanism, and the obtained information is filtered according to the corresponding rules to reduce the side effects of redundant information. Extensive experiments on Synapse dataset, ACDC dataset and SegPC-2021 dataset show that the segmentation accuracy reaches 83.51%, 92.20% and 81.27% respectively. Especially in the Synapse dataset, our method is 6.31% higher than the baseline. The method proposed in this paper effectively improves the segmentation accuracy, provides more detailed information for medical diagnosis and promotes the development of medical artificial intelligence technology.</div></div>\",\"PeriodicalId\":50737,\"journal\":{\"name\":\"Applied Soft Computing\",\"volume\":\"167 \",\"pages\":\"Article 112399\"},\"PeriodicalIF\":7.2000,\"publicationDate\":\"2024-10-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Soft Computing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1568494624011736\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Soft Computing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1568494624011736","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Medical image segmentation network based on feature filtering with low number of parameters
In recent years, the medical image segmentation method based on hybrid convolutional neural network (CNN) and Vision Transformer (ViT) has made great progress, but it still faces the challenge of unbalanced global and local modeling, and excessive parameters. In addition, ViT repeatedly uses the whole feature map to model the global information, thus generating irrelevant and weakly related information, which will weaken the performance of the model when facing small datasets and segmentation targets. Therefore, this paper proposes a feature screening network based on similarity, named Screening Feature (SF)-MixedNet. Specifically, this paper first proposes a new feature extractor, namely Correlation based Similarity Transformer (CSimFormer). On the basis of parameter pruning, it uses the Screening Feature Multi-head Self Attention (SF-MSA) to establish the remote dependency, and calculates the similarity between local elements through the Location-Sensitive Mechanism (LsM) to obtain the weight matrix. Then, the correlation between regional elements is mined by Region Matching and Selection (RMS) mechanism, and the obtained information is filtered according to the corresponding rules to reduce the side effects of redundant information. Extensive experiments on Synapse dataset, ACDC dataset and SegPC-2021 dataset show that the segmentation accuracy reaches 83.51%, 92.20% and 81.27% respectively. Especially in the Synapse dataset, our method is 6.31% higher than the baseline. The method proposed in this paper effectively improves the segmentation accuracy, provides more detailed information for medical diagnosis and promotes the development of medical artificial intelligence technology.
期刊介绍:
Applied Soft Computing is an international journal promoting an integrated view of soft computing to solve real life problems.The focus is to publish the highest quality research in application and convergence of the areas of Fuzzy Logic, Neural Networks, Evolutionary Computing, Rough Sets and other similar techniques to address real world complexities.
Applied Soft Computing is a rolling publication: articles are published as soon as the editor-in-chief has accepted them. Therefore, the web site will continuously be updated with new articles and the publication time will be short.