CoLM: Contrastive learning and multiple instance learning network for lung cancer classification of surgical options based on frozen pathological images

IF 4.9 2区 医学 Q1 ENGINEERING, BIOMEDICAL
Lu Zhao , Wangyuan Zhao , Lu Qiu , Mengqi Jiang , Liqiang Qian , Hua-Nong Ting , Xiaolong Fu , Puming Zhang , Yuchen Han , Jun Zhao
{"title":"CoLM: Contrastive learning and multiple instance learning network for lung cancer classification of surgical options based on frozen pathological images","authors":"Lu Zhao ,&nbsp;Wangyuan Zhao ,&nbsp;Lu Qiu ,&nbsp;Mengqi Jiang ,&nbsp;Liqiang Qian ,&nbsp;Hua-Nong Ting ,&nbsp;Xiaolong Fu ,&nbsp;Puming Zhang ,&nbsp;Yuchen Han ,&nbsp;Jun Zhao","doi":"10.1016/j.bspc.2024.107097","DOIUrl":null,"url":null,"abstract":"<div><div>Histopathological images are regarded as the gold standard in cancer diagnosis. Formalin-fixed paraffin-embedded (FFPE) tissues are routinely collected and archived for pathological examination. However, the time-consuming procedures of tissue fixation and embedding render FFPE tissues unsuitable for intraoperative diagnosis, where immediate results are crucial during surgical procedures. In contrast, obtaining a fresh frozen section (FS) takes a very short time. FS samples are widely utilized for intraoperative diagnosis, whereas the diagnostic accuracy of FS is currently limited by the presence of potential histological artifacts. In this paper, we propose a contrastive learning image translation and multiple instance learning network (CoLM) for lung cancer classification. CoLM efficiently translates FS images into FFPE-style images and facilitates whole slide image classification. The entire framework encompasses two crucial stages. In the first stage, we employ a contrastive learning translation network with a dual-attention module (CL-DAM) for image translation. In the second stage, we utilize a hybrid transformer multi-instance learning-based network (HTM) to address the challenge posed by weak labels. We conduct experiments on lung cancer datasets to validate the performance of our proposed approach. The results demonstrate that our method achieve superior classification performance over other state-of-the-art methods, effectively mitigating the impact of blurred FS images. The proposed framework not only elevates the precision of intraoperative diagnosis when employing FS but also provides valuable reference for pathologists through the application of synthetic images.</div></div>","PeriodicalId":55362,"journal":{"name":"Biomedical Signal Processing and Control","volume":"100 ","pages":"Article 107097"},"PeriodicalIF":4.9000,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical Signal Processing and Control","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1746809424011558","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Histopathological images are regarded as the gold standard in cancer diagnosis. Formalin-fixed paraffin-embedded (FFPE) tissues are routinely collected and archived for pathological examination. However, the time-consuming procedures of tissue fixation and embedding render FFPE tissues unsuitable for intraoperative diagnosis, where immediate results are crucial during surgical procedures. In contrast, obtaining a fresh frozen section (FS) takes a very short time. FS samples are widely utilized for intraoperative diagnosis, whereas the diagnostic accuracy of FS is currently limited by the presence of potential histological artifacts. In this paper, we propose a contrastive learning image translation and multiple instance learning network (CoLM) for lung cancer classification. CoLM efficiently translates FS images into FFPE-style images and facilitates whole slide image classification. The entire framework encompasses two crucial stages. In the first stage, we employ a contrastive learning translation network with a dual-attention module (CL-DAM) for image translation. In the second stage, we utilize a hybrid transformer multi-instance learning-based network (HTM) to address the challenge posed by weak labels. We conduct experiments on lung cancer datasets to validate the performance of our proposed approach. The results demonstrate that our method achieve superior classification performance over other state-of-the-art methods, effectively mitigating the impact of blurred FS images. The proposed framework not only elevates the precision of intraoperative diagnosis when employing FS but also provides valuable reference for pathologists through the application of synthetic images.
CoLM:基于冰冻病理图像的肺癌手术方案分类对比学习和多实例学习网络
组织病理学图像被视为癌症诊断的黄金标准。福尔马林固定石蜡包埋(FFPE)组织被常规收集和存档,用于病理检查。然而,由于组织固定和包埋过程耗时,FFPE 组织不适合用于术中诊断,因为在手术过程中,即时结果至关重要。相比之下,获取新鲜冷冻切片(FS)只需很短的时间。新鲜冰冻切片样本被广泛用于术中诊断,但由于存在潜在的组织学伪影,目前新鲜冰冻切片的诊断准确性受到限制。在本文中,我们提出了一种用于肺癌分类的对比学习图像翻译和多实例学习网络(CoLM)。CoLM 能有效地将 FS 图像转换为 FFPE 类型的图像,并促进整张切片图像的分类。整个框架包括两个关键阶段。在第一阶段,我们采用带有双注意模块(CL-DAM)的对比学习翻译网络进行图像翻译。在第二阶段,我们利用基于多实例学习的混合转换器网络(HTM)来应对弱标签带来的挑战。我们在肺癌数据集上进行了实验,以验证我们提出的方法的性能。结果表明,与其他最先进的方法相比,我们的方法实现了更优越的分类性能,有效减轻了模糊 FS 图像的影响。所提出的框架不仅提高了使用 FS 时术中诊断的精确度,还通过合成图像的应用为病理学家提供了有价值的参考。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Biomedical Signal Processing and Control
Biomedical Signal Processing and Control 工程技术-工程:生物医学
CiteScore
9.80
自引率
13.70%
发文量
822
审稿时长
4 months
期刊介绍: Biomedical Signal Processing and Control aims to provide a cross-disciplinary international forum for the interchange of information on research in the measurement and analysis of signals and images in clinical medicine and the biological sciences. Emphasis is placed on contributions dealing with the practical, applications-led research on the use of methods and devices in clinical diagnosis, patient monitoring and management. Biomedical Signal Processing and Control reflects the main areas in which these methods are being used and developed at the interface of both engineering and clinical science. The scope of the journal is defined to include relevant review papers, technical notes, short communications and letters. Tutorial papers and special issues will also be published.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信