基于深度交互学习的卵巢癌h&e染色全片图像分割研究BRCA突变的形态学模式

Q2 Medicine
David Joon Ho , M. Herman Chui , Chad M. Vanderbilt , Jiwon Jung , Mark E. Robson , Chan-Sik Park , Jin Roh , Thomas J. Fuchs
{"title":"基于深度交互学习的卵巢癌h&e染色全片图像分割研究BRCA突变的形态学模式","authors":"David Joon Ho ,&nbsp;M. Herman Chui ,&nbsp;Chad M. Vanderbilt ,&nbsp;Jiwon Jung ,&nbsp;Mark E. Robson ,&nbsp;Chan-Sik Park ,&nbsp;Jin Roh ,&nbsp;Thomas J. Fuchs","doi":"10.1016/j.jpi.2022.100160","DOIUrl":null,"url":null,"abstract":"<div><p>Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&amp;E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pixel-wise cancer segmentation models, manual annotation from pathologists is generally a bottleneck due to its time-consuming nature. In this paper, we propose Deep Interactive Learning with a pretrained segmentation model from a different cancer type to reduce manual annotation time. Instead of annotating all pixels from cancer and non-cancer regions on giga-pixel whole slide images, an iterative process of annotating mislabeled regions from a segmentation model and training/finetuning the model with the additional annotation can reduce the time. Especially, employing a pretrained segmentation model can further reduce the time than starting annotation from scratch. We trained an accurate ovarian cancer segmentation model with a pretrained breast segmentation model by 3.5 hours of manual annotation which achieved intersection-over-union of 0.74, recall of 0.86, and precision of 0.84. With automatically extracted high-grade serous ovarian cancer patches, we attempted to train an additional classification deep learning model to predict <em>BRCA</em> mutation. The segmentation model and code have been released at <span>https://github.com/MSKCC-Computational-Pathology/DMMN-ovary</span><svg><path></path></svg>.</p></div>","PeriodicalId":37769,"journal":{"name":"Journal of Pathology Informatics","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/82/b6/main.PMC9758515.pdf","citationCount":"9","resultStr":"{\"title\":\"Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation\",\"authors\":\"David Joon Ho ,&nbsp;M. Herman Chui ,&nbsp;Chad M. Vanderbilt ,&nbsp;Jiwon Jung ,&nbsp;Mark E. Robson ,&nbsp;Chan-Sik Park ,&nbsp;Jin Roh ,&nbsp;Thomas J. Fuchs\",\"doi\":\"10.1016/j.jpi.2022.100160\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&amp;E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pixel-wise cancer segmentation models, manual annotation from pathologists is generally a bottleneck due to its time-consuming nature. In this paper, we propose Deep Interactive Learning with a pretrained segmentation model from a different cancer type to reduce manual annotation time. Instead of annotating all pixels from cancer and non-cancer regions on giga-pixel whole slide images, an iterative process of annotating mislabeled regions from a segmentation model and training/finetuning the model with the additional annotation can reduce the time. Especially, employing a pretrained segmentation model can further reduce the time than starting annotation from scratch. We trained an accurate ovarian cancer segmentation model with a pretrained breast segmentation model by 3.5 hours of manual annotation which achieved intersection-over-union of 0.74, recall of 0.86, and precision of 0.84. With automatically extracted high-grade serous ovarian cancer patches, we attempted to train an additional classification deep learning model to predict <em>BRCA</em> mutation. The segmentation model and code have been released at <span>https://github.com/MSKCC-Computational-Pathology/DMMN-ovary</span><svg><path></path></svg>.</p></div>\",\"PeriodicalId\":37769,\"journal\":{\"name\":\"Journal of Pathology Informatics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/82/b6/main.PMC9758515.pdf\",\"citationCount\":\"9\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Pathology Informatics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2153353922007544\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"Medicine\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Pathology Informatics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2153353922007544","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 9

摘要

深度学习已被广泛用于分析数字化苏木精和伊红(H&E)染色的组织病理学整张幻灯片图像。使用深度学习的自动癌症分割可用于诊断恶性肿瘤并发现新的形态模式以预测分子亚型。为了训练逐像素的癌症分割模型,病理学家的手工注释由于其耗时的性质通常是一个瓶颈。在本文中,我们提出了深度交互学习与来自不同癌症类型的预训练分割模型,以减少人工注释时间。与在千兆像素的整张幻灯片图像上标注癌症和非癌症区域的所有像素不同,从分割模型中标注错误标记的区域并使用额外的标注训练/微调模型的迭代过程可以减少时间。特别是,与从头开始标注相比,使用预训练的分割模型可以进一步减少时间。通过3.5小时的人工标注,我们用预训练好的乳腺癌分割模型训练出了一个准确的卵巢癌分割模型,该模型实现了0.74的交叉过合并,0.86的召回率和0.84的精度。通过自动提取高级别浆液性卵巢癌斑块,我们尝试训练一个额外的分类深度学习模型来预测BRCA突变。分割模型和代码已在https://github.com/MSKCC-Computational-Pathology/DMMN-ovary上发布。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation

Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation

Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pixel-wise cancer segmentation models, manual annotation from pathologists is generally a bottleneck due to its time-consuming nature. In this paper, we propose Deep Interactive Learning with a pretrained segmentation model from a different cancer type to reduce manual annotation time. Instead of annotating all pixels from cancer and non-cancer regions on giga-pixel whole slide images, an iterative process of annotating mislabeled regions from a segmentation model and training/finetuning the model with the additional annotation can reduce the time. Especially, employing a pretrained segmentation model can further reduce the time than starting annotation from scratch. We trained an accurate ovarian cancer segmentation model with a pretrained breast segmentation model by 3.5 hours of manual annotation which achieved intersection-over-union of 0.74, recall of 0.86, and precision of 0.84. With automatically extracted high-grade serous ovarian cancer patches, we attempted to train an additional classification deep learning model to predict BRCA mutation. The segmentation model and code have been released at https://github.com/MSKCC-Computational-Pathology/DMMN-ovary.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Pathology Informatics
Journal of Pathology Informatics Medicine-Pathology and Forensic Medicine
CiteScore
3.70
自引率
0.00%
发文量
2
审稿时长
18 weeks
期刊介绍: The Journal of Pathology Informatics (JPI) is an open access peer-reviewed journal dedicated to the advancement of pathology informatics. This is the official journal of the Association for Pathology Informatics (API). The journal aims to publish broadly about pathology informatics and freely disseminate all articles worldwide. This journal is of interest to pathologists, informaticians, academics, researchers, health IT specialists, information officers, IT staff, vendors, and anyone with an interest in informatics. We encourage submissions from anyone with an interest in the field of pathology informatics. We publish all types of papers related to pathology informatics including original research articles, technical notes, reviews, viewpoints, commentaries, editorials, symposia, meeting abstracts, book reviews, and correspondence to the editors. All submissions are subject to rigorous peer review by the well-regarded editorial board and by expert referees in appropriate specialties.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信