Whole slide cervical cancer classification via graph attention networks and contrastive learning

IF 5.5 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Manman Fei , Xin Zhang , Dongdong Chen , Zhiyun Song , Qian Wang , Lichi Zhang
{"title":"Whole slide cervical cancer classification via graph attention networks and contrastive learning","authors":"Manman Fei ,&nbsp;Xin Zhang ,&nbsp;Dongdong Chen ,&nbsp;Zhiyun Song ,&nbsp;Qian Wang ,&nbsp;Lichi Zhang","doi":"10.1016/j.neucom.2024.128787","DOIUrl":null,"url":null,"abstract":"<div><div>Cervical cancer is one of the most common cancers among women, which seriously threatens women’s health. Early screening can reduce the incidence rate and mortality. Thinprep cytologic test (TCT) is one of the important means of cytological screening, which has high sensitivity and specificity, and has been widely used in the early screening of cervical cancer. The automatic diagnosis of whole slide images (WSIs) by computers can effectively improve the efficiency and accuracy of doctors’ diagnoses. However, current methods ignore the intrinsic relationships between cervical cells in WSIs and neglect contextual information from the surrounding suspicious areas, and therefore limit their robustness and generalizability. In this paper, we propose a novel two-stage method to implement the automatic diagnosis of WSIs, which constructs Graph Attention Networks (GAT) based on local and global fields respectively to capture their contextual information in a hierarchical manner. In the first stage, we extract representative patches from each WSI through suspicious cell detection, and then employ a Local GAT to classify cervical cells by capturing correlations between suspicious cells in image tiles. This classification process provides the confidence and feature vectors for each suspicious cell. In the second stage, we perform WSI classification using a Global GAT model. We construct graphs corresponding to top-<span><math><msub><mrow><mi>K</mi></mrow><mrow><mi>g</mi></mrow></msub></math></span> and bottom-<span><math><msub><mrow><mi>K</mi></mrow><mrow><mi>g</mi></mrow></msub></math></span> cells for each WSI based on results from Local GAT, and introduce a supervised contrastive learning strategy to enhance the discriminative power of the extracted features. Experimental results demonstrate that our proposed method outperforms conventional approaches and effectively showcases the benefits of supervised contrastive learning. Our source code and example data are available at https://github.com/feimanman/Whole-Slide-Cervical-Cancer-Classification.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"613 ","pages":"Article 128787"},"PeriodicalIF":5.5000,"publicationDate":"2024-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231224015583","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Cervical cancer is one of the most common cancers among women, which seriously threatens women’s health. Early screening can reduce the incidence rate and mortality. Thinprep cytologic test (TCT) is one of the important means of cytological screening, which has high sensitivity and specificity, and has been widely used in the early screening of cervical cancer. The automatic diagnosis of whole slide images (WSIs) by computers can effectively improve the efficiency and accuracy of doctors’ diagnoses. However, current methods ignore the intrinsic relationships between cervical cells in WSIs and neglect contextual information from the surrounding suspicious areas, and therefore limit their robustness and generalizability. In this paper, we propose a novel two-stage method to implement the automatic diagnosis of WSIs, which constructs Graph Attention Networks (GAT) based on local and global fields respectively to capture their contextual information in a hierarchical manner. In the first stage, we extract representative patches from each WSI through suspicious cell detection, and then employ a Local GAT to classify cervical cells by capturing correlations between suspicious cells in image tiles. This classification process provides the confidence and feature vectors for each suspicious cell. In the second stage, we perform WSI classification using a Global GAT model. We construct graphs corresponding to top-Kg and bottom-Kg cells for each WSI based on results from Local GAT, and introduce a supervised contrastive learning strategy to enhance the discriminative power of the extracted features. Experimental results demonstrate that our proposed method outperforms conventional approaches and effectively showcases the benefits of supervised contrastive learning. Our source code and example data are available at https://github.com/feimanman/Whole-Slide-Cervical-Cancer-Classification.
通过图注意网络和对比学习进行宫颈癌全切片分类
宫颈癌是妇女最常见的癌症之一,严重威胁着妇女的健康。早期筛查可以降低发病率和死亡率。薄片细胞学检查(Thinprep cytologic test,TCT)是细胞学筛查的重要手段之一,具有较高的灵敏度和特异性,已广泛应用于宫颈癌的早期筛查。利用计算机对全切片图像(WSI)进行自动诊断,可以有效提高医生诊断的效率和准确性。然而,目前的方法忽视了 WSIs 中宫颈细胞之间的内在关系,也忽略了周围可疑区域的上下文信息,因此限制了其鲁棒性和普适性。在本文中,我们提出了一种分两个阶段实现 WSI 自动识别的新方法,该方法分别基于局部场和全局场构建图注意网络 (GAT),以分层方式捕捉其上下文信息。在第一阶段,我们通过可疑细胞检测从每个 WSI 中提取具有代表性的斑块,然后采用局部 GAT,通过捕捉图像瓦片中可疑细胞之间的相关性来对宫颈细胞进行分类。这一分类过程可为每个可疑细胞提供置信度和特征向量。在第二阶段,我们使用全局 GAT 模型进行 WSI 分类。我们根据局部 GAT 的结果,为每个 WSI 构建对应于上 Kg 和下 Kg 单元的图,并引入监督对比学习策略,以增强所提取特征的判别能力。实验结果表明,我们提出的方法优于传统方法,并有效地展示了监督对比学习的优势。我们的源代码和示例数据可在 https://github.com/feimanman/Whole-Slide-Cervical-Cancer-Classification 上获取。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Neurocomputing
Neurocomputing 工程技术-计算机:人工智能
CiteScore
13.10
自引率
10.00%
发文量
1382
审稿时长
70 days
期刊介绍: Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信