半监督医学图像分割的语义知识转移

IF 8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Shiwei Zhou , Haifeng Zhao , Leilei Ma , Dengdi Sun
{"title":"半监督医学图像分割的语义知识转移","authors":"Shiwei Zhou ,&nbsp;Haifeng Zhao ,&nbsp;Leilei Ma ,&nbsp;Dengdi Sun","doi":"10.1016/j.engappai.2025.111235","DOIUrl":null,"url":null,"abstract":"<div><div>In semi-supervised medical image segmentation, due to possible differences in information content and distribution between labeled and unlabeled data, dealing with the two separately usually prevents knowledge transfer from labeled to unlabeled data. This prevents the model from effectively sharing learned information between the two types of data. To alleviate this problem, we train labeled and unlabeled data as a whole. Semantic mixing of labeled and unlabeled data is achieved by selecting and exchanging some of the region images of both through a mask to generate complementary input views. In addition, due to the limited labeled data, the unlabeled data has a weak ability to distinguish categories in the feature space. Traditional methods rely on pixel positions to generate positive and negative samples for contrastive learning to solve this problem, but relying on pixel position sampling can easily lead to semantic inconsistency, which affects the effect of feature learning; therefore, to address this problem, we propose an innovative labeled data-guided inter-class contrastive learning strategy, which extracts the category features from labeled and unlabeled data and exploits the accurate category information in the labeled data to guide contrastive learning, while introducing a similarity-based ranking weighting mechanism. Combining the two designs, we propose a new semantic knowledge transfer framework for semi-supervised medical image segmentation. Experiments demonstrate a significant improvement in our model compared to State of the Art (SOTA) on the Automatic Cardiac Diagnosis Challenge (ACDC) dataset and the Left Atrium (LA) dataset.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"158 ","pages":"Article 111235"},"PeriodicalIF":8.0000,"publicationDate":"2025-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Semantic knowledge transfer for semi-supervised medical image segmentation\",\"authors\":\"Shiwei Zhou ,&nbsp;Haifeng Zhao ,&nbsp;Leilei Ma ,&nbsp;Dengdi Sun\",\"doi\":\"10.1016/j.engappai.2025.111235\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In semi-supervised medical image segmentation, due to possible differences in information content and distribution between labeled and unlabeled data, dealing with the two separately usually prevents knowledge transfer from labeled to unlabeled data. This prevents the model from effectively sharing learned information between the two types of data. To alleviate this problem, we train labeled and unlabeled data as a whole. Semantic mixing of labeled and unlabeled data is achieved by selecting and exchanging some of the region images of both through a mask to generate complementary input views. In addition, due to the limited labeled data, the unlabeled data has a weak ability to distinguish categories in the feature space. Traditional methods rely on pixel positions to generate positive and negative samples for contrastive learning to solve this problem, but relying on pixel position sampling can easily lead to semantic inconsistency, which affects the effect of feature learning; therefore, to address this problem, we propose an innovative labeled data-guided inter-class contrastive learning strategy, which extracts the category features from labeled and unlabeled data and exploits the accurate category information in the labeled data to guide contrastive learning, while introducing a similarity-based ranking weighting mechanism. Combining the two designs, we propose a new semantic knowledge transfer framework for semi-supervised medical image segmentation. Experiments demonstrate a significant improvement in our model compared to State of the Art (SOTA) on the Automatic Cardiac Diagnosis Challenge (ACDC) dataset and the Left Atrium (LA) dataset.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"158 \",\"pages\":\"Article 111235\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2025-06-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197625012369\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625012369","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

在半监督医学图像分割中,由于标记数据和未标记数据的信息内容和分布可能存在差异,将两者分开处理通常会阻止知识从标记数据向未标记数据的转移。这阻止了模型在两种类型的数据之间有效地共享学习到的信息。为了缓解这个问题,我们将标记和未标记的数据作为一个整体进行训练。通过蒙版选择和交换部分区域图像来生成互补的输入视图,实现了标记和未标记数据的语义混合。此外,由于标注数据有限,未标注数据在特征空间中区分类别的能力较弱。传统方法依靠像素位置生成正负样本进行对比学习来解决这一问题,但依赖像素位置采样容易导致语义不一致,影响特征学习的效果;因此,针对这一问题,我们提出了一种创新的标记数据引导类间对比学习策略,该策略从标记数据和未标记数据中提取类别特征,利用标记数据中准确的类别信息来指导对比学习,同时引入基于相似度的排序加权机制。结合这两种设计,我们提出了一种新的用于半监督医学图像分割的语义知识转移框架。实验表明,与自动心脏诊断挑战(ACDC)数据集和左心房(LA)数据集上的最新技术(SOTA)相比,我们的模型有了显着改进。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Semantic knowledge transfer for semi-supervised medical image segmentation

Semantic knowledge transfer for semi-supervised medical image segmentation
In semi-supervised medical image segmentation, due to possible differences in information content and distribution between labeled and unlabeled data, dealing with the two separately usually prevents knowledge transfer from labeled to unlabeled data. This prevents the model from effectively sharing learned information between the two types of data. To alleviate this problem, we train labeled and unlabeled data as a whole. Semantic mixing of labeled and unlabeled data is achieved by selecting and exchanging some of the region images of both through a mask to generate complementary input views. In addition, due to the limited labeled data, the unlabeled data has a weak ability to distinguish categories in the feature space. Traditional methods rely on pixel positions to generate positive and negative samples for contrastive learning to solve this problem, but relying on pixel position sampling can easily lead to semantic inconsistency, which affects the effect of feature learning; therefore, to address this problem, we propose an innovative labeled data-guided inter-class contrastive learning strategy, which extracts the category features from labeled and unlabeled data and exploits the accurate category information in the labeled data to guide contrastive learning, while introducing a similarity-based ranking weighting mechanism. Combining the two designs, we propose a new semantic knowledge transfer framework for semi-supervised medical image segmentation. Experiments demonstrate a significant improvement in our model compared to State of the Art (SOTA) on the Automatic Cardiac Diagnosis Challenge (ACDC) dataset and the Left Atrium (LA) dataset.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Engineering Applications of Artificial Intelligence
Engineering Applications of Artificial Intelligence 工程技术-工程:电子与电气
CiteScore
9.60
自引率
10.00%
发文量
505
审稿时长
68 days
期刊介绍: Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信