Unsupervised stain augmentation enhanced glomerular instance segmentation on pathology images.

IF 2.3 3区 医学 Q3 ENGINEERING, BIOMEDICAL
Fan Yang, Qiming He, Yanxia Wang, Siqi Zeng, Yingming Xu, Jing Ye, Yonghong He, Tian Guan, Zhe Wang, Jing Li
{"title":"Unsupervised stain augmentation enhanced glomerular instance segmentation on pathology images.","authors":"Fan Yang, Qiming He, Yanxia Wang, Siqi Zeng, Yingming Xu, Jing Ye, Yonghong He, Tian Guan, Zhe Wang, Jing Li","doi":"10.1007/s11548-024-03154-7","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>In pathology images, different stains highlight different glomerular structures, so a supervised deep learning-based glomerular instance segmentation model trained on individual stains performs poorly on other stains. However, it is difficult to obtain a training set with multiple stains because the labeling of pathology images is very time-consuming and tedious. Therefore, in this paper, we proposed an unsupervised stain augmentation-based method for segmentation of glomerular instances.</p><p><strong>Methods: </strong>In this study, we successfully realized the conversion between different staining methods such as PAS, MT and PASM by contrastive unpaired translation (CUT), thus improving the staining diversity of the training set. Moreover, we replaced the backbone of mask R-CNN with swin transformer to further improve the efficiency of feature extraction and thus achieve better performance in instance segmentation task.</p><p><strong>Results: </strong>To validate the method presented in this paper, we constructed a dataset from 216 WSIs of the three stains in this study. After conducting in-depth experiments, we verified that the instance segmentation method based on stain augmentation outperforms existing methods across all metrics for PAS, PASM, and MT stains. Furthermore, ablation experiments are performed in this paper to further demonstrate the effectiveness of the proposed module.</p><p><strong>Conclusion: </strong>This study successfully demonstrated the potential of unsupervised stain augmentation to improve glomerular segmentation in pathology analysis. Future research could extend this approach to other complex segmentation tasks in the pathology image domain to further explore the potential of applying stain augmentation techniques in different domains of pathology image analysis.</p>","PeriodicalId":51251,"journal":{"name":"International Journal of Computer Assisted Radiology and Surgery","volume":" ","pages":"225-236"},"PeriodicalIF":2.3000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Computer Assisted Radiology and Surgery","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s11548-024-03154-7","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/7 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose: In pathology images, different stains highlight different glomerular structures, so a supervised deep learning-based glomerular instance segmentation model trained on individual stains performs poorly on other stains. However, it is difficult to obtain a training set with multiple stains because the labeling of pathology images is very time-consuming and tedious. Therefore, in this paper, we proposed an unsupervised stain augmentation-based method for segmentation of glomerular instances.

Methods: In this study, we successfully realized the conversion between different staining methods such as PAS, MT and PASM by contrastive unpaired translation (CUT), thus improving the staining diversity of the training set. Moreover, we replaced the backbone of mask R-CNN with swin transformer to further improve the efficiency of feature extraction and thus achieve better performance in instance segmentation task.

Results: To validate the method presented in this paper, we constructed a dataset from 216 WSIs of the three stains in this study. After conducting in-depth experiments, we verified that the instance segmentation method based on stain augmentation outperforms existing methods across all metrics for PAS, PASM, and MT stains. Furthermore, ablation experiments are performed in this paper to further demonstrate the effectiveness of the proposed module.

Conclusion: This study successfully demonstrated the potential of unsupervised stain augmentation to improve glomerular segmentation in pathology analysis. Future research could extend this approach to other complex segmentation tasks in the pathology image domain to further explore the potential of applying stain augmentation techniques in different domains of pathology image analysis.

Abstract Image

病理图像上的无监督染色增强型肾小球实例分割。
目的:在病理图像中,不同的染色剂会突出显示不同的肾小球结构,因此在单个染色剂上训练的基于监督深度学习的肾小球实例分割模型在其他染色剂上表现不佳。然而,由于病理图像的标记非常耗时且繁琐,因此很难获得包含多种染色的训练集。因此,本文提出了一种基于无监督染色增强的肾小球实例分割方法:在本研究中,我们通过对比无配对翻译(CUT)成功实现了 PAS、MT 和 PASM 等不同染色方法之间的转换,从而提高了训练集的染色多样性。此外,我们还用swin变换器替换了掩膜R-CNN的骨干,进一步提高了特征提取的效率,从而在实例分割任务中取得了更好的性能:为了验证本文提出的方法,我们从本研究中三种污渍的 216 个 WSI 中构建了一个数据集。经过深入实验,我们验证了基于污点增强的实例分割方法在 PAS、PASM 和 MT 污点的所有指标上都优于现有方法。此外,本文还进行了消融实验,进一步证明了所提模块的有效性:本研究成功证明了无监督染色增强技术在病理分析中改善肾小球分割的潜力。未来的研究可以将这种方法扩展到病理图像领域的其他复杂分割任务,进一步探索在病理图像分析的不同领域应用染色增强技术的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
International Journal of Computer Assisted Radiology and Surgery
International Journal of Computer Assisted Radiology and Surgery ENGINEERING, BIOMEDICAL-RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING
CiteScore
5.90
自引率
6.70%
发文量
243
审稿时长
6-12 weeks
期刊介绍: The International Journal for Computer Assisted Radiology and Surgery (IJCARS) is a peer-reviewed journal that provides a platform for closing the gap between medical and technical disciplines, and encourages interdisciplinary research and development activities in an international environment.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信