Shunxing Bao, Junlin Guo, Ho Hin Lee, Ruining Deng, Can Cui, Lucas W Remedios, Quan Liu, Qi Yang, Kaiwen Xu, Xin Yu, Jia Li, Yike Li, Joseph T Roland, Qi Liu, Ken S Lau, Keith T Wilson, Lori A Coburn, Bennett A Landman, Yuankai Huo
{"title":"MITIGATING OVER-SATURATED FLUORESCENCE IMAGES THROUGH A SEMI-SUPERVISED GENERATIVE ADVERSARIAL NETWORK.","authors":"Shunxing Bao, Junlin Guo, Ho Hin Lee, Ruining Deng, Can Cui, Lucas W Remedios, Quan Liu, Qi Yang, Kaiwen Xu, Xin Yu, Jia Li, Yike Li, Joseph T Roland, Qi Liu, Ken S Lau, Keith T Wilson, Lori A Coburn, Bennett A Landman, Yuankai Huo","doi":"10.1109/isbi56570.2024.10635687","DOIUrl":null,"url":null,"abstract":"<p><p>Multiplex immunofluorescence (MxIF) imaging is a critical tool in biomedical research, offering detailed insights into cell composition and spatial context. As an example, DAPI staining identifies cell nuclei, while CD20 staining helps segment cell membranes in MxIF. However, a persistent challenge in MxIF is saturation artifacts, which hinder single-cell level analysis in areas with over-saturated pixels. Traditional gamma correction methods for fixing saturation are limited, often incorrectly assuming uniform distribution of saturation, which is rarely the case in practice. This paper introduces a novel approach to correct saturation artifacts from a data-driven perspective. We introduce a two-stage, high-resolution hybrid generative adversarial network (HDmixGAN), which merges unpaired (CycleGAN) and paired (pix2pixHD) network architectures. This approach is designed to capitalize on the available small-scale paired data and the more extensive unpaired data from costly MxIF data. Specifically, we generate pseudo-paired data from large-scale unpaired over-saturated datasets with a CycleGAN, and train a Pix2pixGAN using both small-scale real and large-scale synthetic data derived from multiple DAPI staining rounds in MxIF. This method was validated against various baselines in a downstream nuclei detection task, improving the F1 score by 6% over the baseline. This is, to our knowledge, the first focused effort to address multi-round saturation in MxIF images, offering a specialized solution for enhancing cell analysis accuracy through improved image quality. The source code and implementation of the proposed method are available at https://github.com/MASILab/DAPIArtifactRemoval.git.</p>","PeriodicalId":74566,"journal":{"name":"Proceedings. IEEE International Symposium on Biomedical Imaging","volume":"2024 ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11756911/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings. IEEE International Symposium on Biomedical Imaging","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/isbi56570.2024.10635687","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/8/22 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

多重免疫荧光(MxIF)成像是生物医学研究的重要工具,它能让人详细了解细胞的组成和空间环境。例如,DAPI 染色可识别细胞核,而 CD20 染色则有助于在 MxIF 中分割细胞膜。然而,饱和伪影是 MxIF 一直面临的挑战,它阻碍了对像素过度饱和区域进行单细胞级分析。传统的伽玛校正方法在修复饱和度方面存在局限性,常常错误地假设饱和度均匀分布,而实际情况却很少如此。本文从数据驱动的角度出发,介绍了一种修正饱和度伪影的新方法。我们介绍了一种两阶段高分辨率混合生成对抗网络 (HDmixGAN),它融合了非配对(CycleGAN)和配对(pix2pixHD)网络架构。这种方法旨在利用现有的小规模配对数据和来自昂贵的 MxIF 数据的更广泛的非配对数据。具体来说,我们利用 CycleGAN 从大规模非配对过饱和数据集生成伪配对数据,并利用 MxIF 中多轮 DAPI 染色得到的小规模真实数据和大规模合成数据训练 Pix2pixGAN。这种方法在下游细胞核检测任务中与各种基线方法进行了对比验证,比基线方法提高了 6% 的 F1 分数。据我们所知,这是首次集中解决 MxIF 图像中的多轮饱和问题,为通过提高图像质量来增强细胞分析准确性提供了专门的解决方案。建议方法的源代码和实现方法可在 https://github.com/MASILab/DAPIArtifactRemoval.git 上获取。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
MITIGATING OVER-SATURATED FLUORESCENCE IMAGES THROUGH A SEMI-SUPERVISED GENERATIVE ADVERSARIAL NETWORK.

Multiplex immunofluorescence (MxIF) imaging is a critical tool in biomedical research, offering detailed insights into cell composition and spatial context. As an example, DAPI staining identifies cell nuclei, while CD20 staining helps segment cell membranes in MxIF. However, a persistent challenge in MxIF is saturation artifacts, which hinder single-cell level analysis in areas with over-saturated pixels. Traditional gamma correction methods for fixing saturation are limited, often incorrectly assuming uniform distribution of saturation, which is rarely the case in practice. This paper introduces a novel approach to correct saturation artifacts from a data-driven perspective. We introduce a two-stage, high-resolution hybrid generative adversarial network (HDmixGAN), which merges unpaired (CycleGAN) and paired (pix2pixHD) network architectures. This approach is designed to capitalize on the available small-scale paired data and the more extensive unpaired data from costly MxIF data. Specifically, we generate pseudo-paired data from large-scale unpaired over-saturated datasets with a CycleGAN, and train a Pix2pixGAN using both small-scale real and large-scale synthetic data derived from multiple DAPI staining rounds in MxIF. This method was validated against various baselines in a downstream nuclei detection task, improving the F1 score by 6% over the baseline. This is, to our knowledge, the first focused effort to address multi-round saturation in MxIF images, offering a specialized solution for enhancing cell analysis accuracy through improved image quality. The source code and implementation of the proposed method are available at https://github.com/MASILab/DAPIArtifactRemoval.git.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信