Shiwei Zhou , Haifeng Zhao , Leilei Ma , Dengdi Sun
{"title":"半监督医学图像分割的语义知识转移","authors":"Shiwei Zhou , Haifeng Zhao , Leilei Ma , Dengdi Sun","doi":"10.1016/j.engappai.2025.111235","DOIUrl":null,"url":null,"abstract":"<div><div>In semi-supervised medical image segmentation, due to possible differences in information content and distribution between labeled and unlabeled data, dealing with the two separately usually prevents knowledge transfer from labeled to unlabeled data. This prevents the model from effectively sharing learned information between the two types of data. To alleviate this problem, we train labeled and unlabeled data as a whole. Semantic mixing of labeled and unlabeled data is achieved by selecting and exchanging some of the region images of both through a mask to generate complementary input views. In addition, due to the limited labeled data, the unlabeled data has a weak ability to distinguish categories in the feature space. Traditional methods rely on pixel positions to generate positive and negative samples for contrastive learning to solve this problem, but relying on pixel position sampling can easily lead to semantic inconsistency, which affects the effect of feature learning; therefore, to address this problem, we propose an innovative labeled data-guided inter-class contrastive learning strategy, which extracts the category features from labeled and unlabeled data and exploits the accurate category information in the labeled data to guide contrastive learning, while introducing a similarity-based ranking weighting mechanism. Combining the two designs, we propose a new semantic knowledge transfer framework for semi-supervised medical image segmentation. Experiments demonstrate a significant improvement in our model compared to State of the Art (SOTA) on the Automatic Cardiac Diagnosis Challenge (ACDC) dataset and the Left Atrium (LA) dataset.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"158 ","pages":"Article 111235"},"PeriodicalIF":8.0000,"publicationDate":"2025-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Semantic knowledge transfer for semi-supervised medical image segmentation\",\"authors\":\"Shiwei Zhou , Haifeng Zhao , Leilei Ma , Dengdi Sun\",\"doi\":\"10.1016/j.engappai.2025.111235\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In semi-supervised medical image segmentation, due to possible differences in information content and distribution between labeled and unlabeled data, dealing with the two separately usually prevents knowledge transfer from labeled to unlabeled data. This prevents the model from effectively sharing learned information between the two types of data. To alleviate this problem, we train labeled and unlabeled data as a whole. Semantic mixing of labeled and unlabeled data is achieved by selecting and exchanging some of the region images of both through a mask to generate complementary input views. In addition, due to the limited labeled data, the unlabeled data has a weak ability to distinguish categories in the feature space. Traditional methods rely on pixel positions to generate positive and negative samples for contrastive learning to solve this problem, but relying on pixel position sampling can easily lead to semantic inconsistency, which affects the effect of feature learning; therefore, to address this problem, we propose an innovative labeled data-guided inter-class contrastive learning strategy, which extracts the category features from labeled and unlabeled data and exploits the accurate category information in the labeled data to guide contrastive learning, while introducing a similarity-based ranking weighting mechanism. Combining the two designs, we propose a new semantic knowledge transfer framework for semi-supervised medical image segmentation. Experiments demonstrate a significant improvement in our model compared to State of the Art (SOTA) on the Automatic Cardiac Diagnosis Challenge (ACDC) dataset and the Left Atrium (LA) dataset.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"158 \",\"pages\":\"Article 111235\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2025-06-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197625012369\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625012369","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Semantic knowledge transfer for semi-supervised medical image segmentation
In semi-supervised medical image segmentation, due to possible differences in information content and distribution between labeled and unlabeled data, dealing with the two separately usually prevents knowledge transfer from labeled to unlabeled data. This prevents the model from effectively sharing learned information between the two types of data. To alleviate this problem, we train labeled and unlabeled data as a whole. Semantic mixing of labeled and unlabeled data is achieved by selecting and exchanging some of the region images of both through a mask to generate complementary input views. In addition, due to the limited labeled data, the unlabeled data has a weak ability to distinguish categories in the feature space. Traditional methods rely on pixel positions to generate positive and negative samples for contrastive learning to solve this problem, but relying on pixel position sampling can easily lead to semantic inconsistency, which affects the effect of feature learning; therefore, to address this problem, we propose an innovative labeled data-guided inter-class contrastive learning strategy, which extracts the category features from labeled and unlabeled data and exploits the accurate category information in the labeled data to guide contrastive learning, while introducing a similarity-based ranking weighting mechanism. Combining the two designs, we propose a new semantic knowledge transfer framework for semi-supervised medical image segmentation. Experiments demonstrate a significant improvement in our model compared to State of the Art (SOTA) on the Automatic Cardiac Diagnosis Challenge (ACDC) dataset and the Left Atrium (LA) dataset.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.