Semi-Supervised 3-D Medical Image Segmentation Using Multiconsistency Learning With Fuzzy Perception-Guided Target Selection

IF 4.6 Q1 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING
Tao Lei;Wenbiao Song;Weichuan Zhang;Xiaogang Du;Chenxia Li;Lifeng He;Asoke K. Nandi
{"title":"Semi-Supervised 3-D Medical Image Segmentation Using Multiconsistency Learning With Fuzzy Perception-Guided Target Selection","authors":"Tao Lei;Wenbiao Song;Weichuan Zhang;Xiaogang Du;Chenxia Li;Lifeng He;Asoke K. Nandi","doi":"10.1109/TRPMS.2024.3473929","DOIUrl":null,"url":null,"abstract":"Semi-supervised learning methods based on the mean teacher model have achieved great success in the field of 3-D medical image segmentation. However, most of the existing methods provide auxiliary supervised signals only for reliable regions, but ignore the effect of fuzzy regions from unlabeled data during the process of consistency learning, which results in the loss of more valuable information. Besides, some of these methods only employ multitask learning to improve models’ performance, but ignore the role of consistency learning between tasks and models, thereby weakening geometric shape constraints. To address the above issues, in this article, we propose a semi-supervised 3-D medical image segmentation framework with multiconsistency learning for fuzzy perception-guided target selection. First, we design a fuzzy perception-guided target selection strategy from multiple perspectives and adopt the fusion method of fuzziness minimization and the fuzzy map momentum update to obtain a fuzzy region. By incorporating the fuzzy region into consistency learning, our model can effectively exploit more useful information from the fuzzy region of unlabeled data. Second, we design a multiconsistency learning strategy that employs intratask and intermodal mutual consistency learning as well as cross-model cross-task consistency learning to effectively learn the shape representation of fuzzy regions. The strategy can encourage the model to agree on predictions for different tasks in fuzzy regions. Experiments demonstrate that the proposed framework outperforms the current mainstream methods on two popular 3-D medical datasets, the left atrium segmentation dataset, and the brain tumor segmentation dataset. The code will be released at: <uri>https://github.com/SUST-reynole</uri>.","PeriodicalId":46807,"journal":{"name":"IEEE Transactions on Radiation and Plasma Medical Sciences","volume":"9 4","pages":"421-432"},"PeriodicalIF":4.6000,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10706819","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Radiation and Plasma Medical Sciences","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10706819/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0

Abstract

Semi-supervised learning methods based on the mean teacher model have achieved great success in the field of 3-D medical image segmentation. However, most of the existing methods provide auxiliary supervised signals only for reliable regions, but ignore the effect of fuzzy regions from unlabeled data during the process of consistency learning, which results in the loss of more valuable information. Besides, some of these methods only employ multitask learning to improve models’ performance, but ignore the role of consistency learning between tasks and models, thereby weakening geometric shape constraints. To address the above issues, in this article, we propose a semi-supervised 3-D medical image segmentation framework with multiconsistency learning for fuzzy perception-guided target selection. First, we design a fuzzy perception-guided target selection strategy from multiple perspectives and adopt the fusion method of fuzziness minimization and the fuzzy map momentum update to obtain a fuzzy region. By incorporating the fuzzy region into consistency learning, our model can effectively exploit more useful information from the fuzzy region of unlabeled data. Second, we design a multiconsistency learning strategy that employs intratask and intermodal mutual consistency learning as well as cross-model cross-task consistency learning to effectively learn the shape representation of fuzzy regions. The strategy can encourage the model to agree on predictions for different tasks in fuzzy regions. Experiments demonstrate that the proposed framework outperforms the current mainstream methods on two popular 3-D medical datasets, the left atrium segmentation dataset, and the brain tumor segmentation dataset. The code will be released at: https://github.com/SUST-reynole.
基于模糊感知引导的多一致性学习半监督三维医学图像分割
基于平均教师模型的半监督学习方法在三维医学图像分割领域取得了巨大成功。然而,现有的方法大多只对可靠区域提供辅助监督信号,而忽略了一致性学习过程中未标记数据模糊区域的影响,导致丢失更多有价值的信息。此外,其中一些方法仅利用多任务学习来提高模型的性能,而忽略了任务和模型之间一致性学习的作用,从而削弱了几何形状约束。为了解决上述问题,本文提出了一种基于多一致性学习的半监督三维医学图像分割框架,用于模糊感知引导下的目标选择。首先,从多个角度设计模糊感知引导下的目标选择策略,采用模糊最小化和模糊映射动量更新的融合方法得到模糊区域;通过将模糊区域纳入一致性学习,我们的模型可以有效地从未标记数据的模糊区域中挖掘出更多有用的信息。其次,我们设计了一种多一致性学习策略,该策略采用任务内和多模态相互一致性学习以及跨模型跨任务一致性学习来有效地学习模糊区域的形状表示。该策略可以促使模型对模糊区域内不同任务的预测达成一致。实验表明,该框架在两种流行的三维医学数据集(左心房分割数据集和脑肿瘤分割数据集)上优于目前的主流方法。代码将在https://github.com/SUST-reynole上发布。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Radiation and Plasma Medical Sciences
IEEE Transactions on Radiation and Plasma Medical Sciences RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING-
CiteScore
8.00
自引率
18.20%
发文量
109
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信