A hybrid U-Net model with attention and advanced convolutional learning modules for simultaneous gland segmentation and cancer grade prediction in colorectal histopathological images

Manju Dabass , Jyoti Dabass , Sharda Vashisth , Rekha Vig
{"title":"A hybrid U-Net model with attention and advanced convolutional learning modules for simultaneous gland segmentation and cancer grade prediction in colorectal histopathological images","authors":"Manju Dabass ,&nbsp;Jyoti Dabass ,&nbsp;Sharda Vashisth ,&nbsp;Rekha Vig","doi":"10.1016/j.ibmed.2023.100094","DOIUrl":null,"url":null,"abstract":"<div><p>In this proposed research work, a computerized Hybrid U-Net model for supplying colon glandular morphometric and cancer grade information is demonstrated. The solution is put forth by incorporating three distinctive structural elements—Advanced Convolutional Learning Modules, Attention Modules, and Multi-Scalar Transitional Modules—into the conventional U-Net architecture. By combining these modules, complex multi-level convolutional feature learning further encompassed with target-specified attention and increased effective receptive-field-size are produced. Three publicly accessible datasets—CRAG, GlaS challenge, LC-25000 dataset, and an internal, proprietary dataset Hospital Colon (HosC)—are used in experiments. The suggested model also produced competitive results for the gland detection and segmentation task in terms of Object-Dice Index as ((0.950 for CRAG), (GlaS: (0.951 for Test A &amp; 0.902 for Test B)), (0.954 for LC-25000), (0.920 for HosC)), F1-score as ((0.921 for CRAG), (GlaS: (0.945 for Test A &amp; 0.923 for Test B)), (0.913 for LC-25000), (0.955 for HosC)), and Object-Hausdorff Distance ((90.43 for CRAG), (GlaS: (23.11 for Test A &amp; 71.47 for Test B)), (96.24 for LC-25000), (85.41 for HosC)). Pathologists evaluated the generated segmented glandular areas and assigned a mean score as ((9.25 for CRAG), (GlaS: (9.32 for Test A &amp; 9.28 for Test B)), (9.12 for LC-25000) (9.14 for HosC)). The proposed model successfully completed the task of determining the cancer grade with the following results: Precision as ((0.9689 for CRAG), (0.9721 for GlaS), (1.0 for LC-25000), (1.0 for HosC)), Specificity (0.8895 for CRAG), (0.9710 for GlaS), (1.0 for LC-25000), (1.0 for HosC)), and Sensitivity ((0.9677 for CRAG), (0.9722 for GlaS), (0.9995 for LC-25000), (0.9932 for HosC)). Additionally, the Gradient-Weighted class activation mappings are provided to highlight the critical regions that the suggested model believes are essential for accurately predicting cancer. These visualizations are further reviewed by skilled pathologists and assigned with the mean scores as ((9.37 for CRAG), (9.29 for GlaS), (9.09 for LC-25000), and (9.91 for HosC)). By offering a referential opinion during the morphological assessment and diagnosis formulation in histopathology images, these results will help the pathologists and contribute towards reducing inadvertent human mistake and accelerating the cancer detection procedure.</p></div>","PeriodicalId":73399,"journal":{"name":"Intelligence-based medicine","volume":"7 ","pages":"Article 100094"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intelligence-based medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S266652122300008X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 6

Abstract

In this proposed research work, a computerized Hybrid U-Net model for supplying colon glandular morphometric and cancer grade information is demonstrated. The solution is put forth by incorporating three distinctive structural elements—Advanced Convolutional Learning Modules, Attention Modules, and Multi-Scalar Transitional Modules—into the conventional U-Net architecture. By combining these modules, complex multi-level convolutional feature learning further encompassed with target-specified attention and increased effective receptive-field-size are produced. Three publicly accessible datasets—CRAG, GlaS challenge, LC-25000 dataset, and an internal, proprietary dataset Hospital Colon (HosC)—are used in experiments. The suggested model also produced competitive results for the gland detection and segmentation task in terms of Object-Dice Index as ((0.950 for CRAG), (GlaS: (0.951 for Test A & 0.902 for Test B)), (0.954 for LC-25000), (0.920 for HosC)), F1-score as ((0.921 for CRAG), (GlaS: (0.945 for Test A & 0.923 for Test B)), (0.913 for LC-25000), (0.955 for HosC)), and Object-Hausdorff Distance ((90.43 for CRAG), (GlaS: (23.11 for Test A & 71.47 for Test B)), (96.24 for LC-25000), (85.41 for HosC)). Pathologists evaluated the generated segmented glandular areas and assigned a mean score as ((9.25 for CRAG), (GlaS: (9.32 for Test A & 9.28 for Test B)), (9.12 for LC-25000) (9.14 for HosC)). The proposed model successfully completed the task of determining the cancer grade with the following results: Precision as ((0.9689 for CRAG), (0.9721 for GlaS), (1.0 for LC-25000), (1.0 for HosC)), Specificity (0.8895 for CRAG), (0.9710 for GlaS), (1.0 for LC-25000), (1.0 for HosC)), and Sensitivity ((0.9677 for CRAG), (0.9722 for GlaS), (0.9995 for LC-25000), (0.9932 for HosC)). Additionally, the Gradient-Weighted class activation mappings are provided to highlight the critical regions that the suggested model believes are essential for accurately predicting cancer. These visualizations are further reviewed by skilled pathologists and assigned with the mean scores as ((9.37 for CRAG), (9.29 for GlaS), (9.09 for LC-25000), and (9.91 for HosC)). By offering a referential opinion during the morphological assessment and diagnosis formulation in histopathology images, these results will help the pathologists and contribute towards reducing inadvertent human mistake and accelerating the cancer detection procedure.

Abstract Image

结合注意力和先进卷积学习模块的混合U-Net模型,用于结直肠组织病理图像中腺体分割和癌级预测
在这项拟议的研究工作中,展示了一个计算机化的混合U-Net模型,用于提供结肠腺体形态测量和癌症分级信息。该解决方案是通过将三个独特的结构元素——高级卷积学习模块、注意力模块和多标量过渡模块——整合到传统的U-Net架构中提出的。通过结合这些模块,可以产生复杂的多层次卷积特征学习,进一步包含目标指定的注意力和增加的有效接受域大小。实验中使用了三个可公开访问的数据集——crag、GlaS挑战、LC-25000数据集和内部专有数据集Hospital Colon (HosC)。所建议的模型在gland检测和分割任务方面也产生了竞争结果,在Object-Dice Index方面,CRAG为(0.950),Test A为(0.951);测试B为0.902),LC-25000为0.954),HosC为0.920)),f1得分为(crg为0.921),测试A为(0.945);0.923(测试B)), (0.913 LC-25000), (0.955 HosC))和对象-豪斯多夫距离((90.43 CRAG), (GlaS:(23.11测试A &测试B (71.47)), LC-25000 (96.24), HosC(85.41))。病理学家对生成的分节腺体区域进行评估,并将CRAG的平均得分定为(9.25),测试a的平均得分为(9.32);测试B为9.28),(LC-25000为9.12)(HosC为9.14))。所提出的模型成功完成了确定癌症分级的任务,其结果如下:精确度为(CRAG为0.9689),GlaS为0.9721,LC-25000为1.0,HosC为1.0),特异性为(CRAG为0.8895),GlaS为0.9710,LC-25000为1.0,HosC为1.0),敏感性为(CRAG为0.9677),GlaS为0.9722,LC-25000为0.9995),HosC为0.9932)。此外,还提供了梯度加权类激活映射,以突出显示建议模型认为对准确预测癌症至关重要的关键区域。这些图像由熟练的病理学家进一步检查,并分配平均分数为((CRAG为9.37),(GlaS为9.29),(LC-25000为9.09)和(HosC为9.91))。通过在组织病理学图像的形态学评估和诊断制定过程中提供参考意见,这些结果将有助于病理学家,并有助于减少无意的人为错误和加快癌症的检测过程。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Intelligence-based medicine
Intelligence-based medicine Health Informatics
CiteScore
5.00
自引率
0.00%
发文量
0
审稿时长
187 days
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信