AB012. Automated histologic subtyping of thymic epithelial tumors with deep learning

J. Dolezal, Wenjie Guo, C. Bestvina, E. Vokes, J. Donington, A. Husain, M. Garassino
{"title":"AB012. Automated histologic subtyping of thymic epithelial tumors with deep learning","authors":"J. Dolezal, Wenjie Guo, C. Bestvina, E. Vokes, J. Donington, A. Husain, M. Garassino","doi":"10.21037/med-22-ab012","DOIUrl":null,"url":null,"abstract":"Background Rare tumors are diagnostic challenges for pathologists. Thymic epithelial tumors (TETs) are heterogenous and their treatment strategies vary according to histological subgroup. Previous work has shown that a second pathological opinion may result in a change in diagnosis for more than half of cases, with a potential treatment shift in 44%. The aim of this study is to assess the feasibility of using artificial intelligence and deep learning to classify TETs, which could be used to help improve pathologist diagnostic consistency for these challenging tumors. Methods Digital diagnostic hematoxylin and eosin (H&E) stained slides of tumors for 103 patients with thymoma type A, AB, B1, B2, and B3 were downloaded from The Cancer Genome Atlas (TCGA). An Xception-based deep convolutional neural network model was trained on slide images at 10× magnification to predict histologic subtype as an ordinal variable in three-fold cross-validation. Hyperparameters were taken from previously published experiments, and no additional hyperparameter tuning was performed to reduce the risk of overfitting. Validation predictions from each cross-fold were aggregated and compared between groups using analysis of variance (ANOVA) and one-sided t-tests with Bonferroni correction for multiple comparisons. Model activations at the post-convolutional layer for validation images in the first cross-fold were visualized with uniform manifold approximation and projection (UMAP) dimensionality reduction to better understand the spatial relationship between learned image features. Results Deep learning predictions among the TET subtypes were significantly different by ANOVA (P<0.0001) and correlated with the ordinal labels (R-squared =0.39). Thymoma A and AB subtypes were distinguished from both B1 and B2/B3 (P=0.023 and <0.001, respectively), and B1 tumors were distinguished from B2/B3 (P=0.011). Analysis of post-convolutional layer activations revealed an axis of transition through the ordinal variables, providing evidence that the deep learning model learned image features on a morphologic spectrum. Conclusions This is the first example in TETs that deep learning can discriminate between TET histologic subtypes using digital H&E slides. We aim to further validate the algorithm with a multi-institution dataset from centers of expertise to improve the ability to distinguish thymoma subtypes.","PeriodicalId":74139,"journal":{"name":"Mediastinum (Hong Kong, China)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Mediastinum (Hong Kong, China)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.21037/med-22-ab012","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Background Rare tumors are diagnostic challenges for pathologists. Thymic epithelial tumors (TETs) are heterogenous and their treatment strategies vary according to histological subgroup. Previous work has shown that a second pathological opinion may result in a change in diagnosis for more than half of cases, with a potential treatment shift in 44%. The aim of this study is to assess the feasibility of using artificial intelligence and deep learning to classify TETs, which could be used to help improve pathologist diagnostic consistency for these challenging tumors. Methods Digital diagnostic hematoxylin and eosin (H&E) stained slides of tumors for 103 patients with thymoma type A, AB, B1, B2, and B3 were downloaded from The Cancer Genome Atlas (TCGA). An Xception-based deep convolutional neural network model was trained on slide images at 10× magnification to predict histologic subtype as an ordinal variable in three-fold cross-validation. Hyperparameters were taken from previously published experiments, and no additional hyperparameter tuning was performed to reduce the risk of overfitting. Validation predictions from each cross-fold were aggregated and compared between groups using analysis of variance (ANOVA) and one-sided t-tests with Bonferroni correction for multiple comparisons. Model activations at the post-convolutional layer for validation images in the first cross-fold were visualized with uniform manifold approximation and projection (UMAP) dimensionality reduction to better understand the spatial relationship between learned image features. Results Deep learning predictions among the TET subtypes were significantly different by ANOVA (P<0.0001) and correlated with the ordinal labels (R-squared =0.39). Thymoma A and AB subtypes were distinguished from both B1 and B2/B3 (P=0.023 and <0.001, respectively), and B1 tumors were distinguished from B2/B3 (P=0.011). Analysis of post-convolutional layer activations revealed an axis of transition through the ordinal variables, providing evidence that the deep learning model learned image features on a morphologic spectrum. Conclusions This is the first example in TETs that deep learning can discriminate between TET histologic subtypes using digital H&E slides. We aim to further validate the algorithm with a multi-institution dataset from centers of expertise to improve the ability to distinguish thymoma subtypes.
AB012.使用深度学习对胸腺上皮肿瘤进行自动组织学分型
背景罕见肿瘤是病理学家面临的诊断挑战。胸腺上皮肿瘤(TETs)是异质性的,其治疗策略根据组织学亚组而异。先前的研究表明,第二种病理意见可能会导致一半以上病例的诊断改变,44%的病例可能会改变治疗方法。本研究的目的是评估使用人工智能和深度学习对tet进行分类的可行性,这可以用来帮助提高病理学家对这些具有挑战性的肿瘤的诊断一致性。方法从美国癌症基因组图谱(TCGA)下载103例A、AB、B1、B2、B3型胸腺瘤患者的数字诊断苏木精和伊红(H&E)染色肿瘤切片。在10倍放大的幻灯片图像上训练基于exception的深度卷积神经网络模型,以预测组织学亚型作为三倍交叉验证的顺序变量。超参数取自先前发表的实验,没有进行额外的超参数调整以降低过拟合的风险。使用方差分析(ANOVA)和单侧t检验对多个比较进行Bonferroni校正,对每个交叉折叠的验证预测进行汇总和组间比较。通过统一流形近似和投影(UMAP)降维,对验证图像的后卷积层模型激活进行可视化,以更好地理解学习到的图像特征之间的空间关系。结果经方差分析,TET亚型间深度学习预测差异有统计学意义(P<0.0001),且与序数标签相关(r²=0.39)。胸腺瘤A和AB亚型在B1和B2/B3中均有差异(P=0.023和<0.001),B1亚型在B2/B3中均有差异(P=0.011)。对后卷积层激活的分析揭示了通过有序变量的过渡轴,提供了深度学习模型在形态谱上学习图像特征的证据。这是深度学习可以利用数字H&E载玻片区分TET组织学亚型的第一个例子。我们的目标是用来自专业中心的多机构数据集进一步验证该算法,以提高区分胸腺瘤亚型的能力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
1.20
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信