使用多分辨率深度学习技术的组织病理学图像增强

IF 2.2 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Meriem Touhami, Zaka Ur Rehman, Md Jahid Hasan, Mohammad Faizal Ahmad Fauzi, Sarina Binti Mansor
{"title":"使用多分辨率深度学习技术的组织病理学图像增强","authors":"Meriem Touhami,&nbsp;Zaka Ur Rehman,&nbsp;Md Jahid Hasan,&nbsp;Mohammad Faizal Ahmad Fauzi,&nbsp;Sarina Binti Mansor","doi":"10.1049/ipr2.70166","DOIUrl":null,"url":null,"abstract":"<p>Accurate analysis of histopathology images is essential for disease diagnosis and treatment planning. However, the quality of digital pathology slides is often limited by scanner resolution, which can compromise diagnostic precision and patient care. To address this challenge, we conducted a comparative study evaluating four state of the art image enhancement methods: real enhanced super resolution generative adversarial network (Real-ESRGAN), SwinIR, multi scale image restoration network v2 (MIRNet-v2) and super resolution CNN (SRCNN). Our assessment focused on both quantitative metrics peak signal to noise ratio (PSNR) and structural similarity index (SSIM) and qualitative visual analysis to evaluate detail preservation. The experimental results revealed that SwinIR achieved the best quantitative performance among all evaluated methods, attaining the highest PSNR (35.81) and SSIM (0.95) for lung images from the LC2500 dataset at a 2 <span></span><math>\n <semantics>\n <mo>×</mo>\n <annotation>$\\times$</annotation>\n </semantics></math> upscaling factor. In contrast, real-ESRGAN excelled in perceptual quality, preserving finer image details more effectively, though it recorded slightly lower numerical scores (PSNR: 33.53, SSIM: 0.92) on the same dataset. These outcomes highlight essential trade off between perceptual fidelity and reconstruction quality, indicating that the optimal choice of enhancement method may vary depending on clinical or diagnostic priorities. The MIRNetv2 method delivered reasonable performance but ranked below both real-ESRGAN and SwinIR. Specifically, it achieved PSNR/SSIM scores of 30.67/0.94 on PR-IHC patches, 32.90/0.95 on lung images, and 31.87/0.95 on colon images, while scoring 29.11 for PR-IHC images in a separate evaluation. SRCNN demonstrated a balanced performance across datasets, achieving PSNR/SSIM values of 31.45/0.88 for lung images, 30.76/0.87 for PR-IHC patches, 32.62/0.93 for colon images, and 33.76/0.91 for PR-IHC. These findings underscore the real ESRGAN as the most effective method for improving the resolution and quality of histopathology images, supporting its potential integration into digital pathology workflows to enhance diagnostic accuracy and patient outcomes.</p>","PeriodicalId":56303,"journal":{"name":"IET Image Processing","volume":"19 1","pages":""},"PeriodicalIF":2.2000,"publicationDate":"2025-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ipr2.70166","citationCount":"0","resultStr":"{\"title\":\"Histopathology Image Enhancement Using Multi-Resolution Deep Learning Techniques\",\"authors\":\"Meriem Touhami,&nbsp;Zaka Ur Rehman,&nbsp;Md Jahid Hasan,&nbsp;Mohammad Faizal Ahmad Fauzi,&nbsp;Sarina Binti Mansor\",\"doi\":\"10.1049/ipr2.70166\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Accurate analysis of histopathology images is essential for disease diagnosis and treatment planning. However, the quality of digital pathology slides is often limited by scanner resolution, which can compromise diagnostic precision and patient care. To address this challenge, we conducted a comparative study evaluating four state of the art image enhancement methods: real enhanced super resolution generative adversarial network (Real-ESRGAN), SwinIR, multi scale image restoration network v2 (MIRNet-v2) and super resolution CNN (SRCNN). Our assessment focused on both quantitative metrics peak signal to noise ratio (PSNR) and structural similarity index (SSIM) and qualitative visual analysis to evaluate detail preservation. The experimental results revealed that SwinIR achieved the best quantitative performance among all evaluated methods, attaining the highest PSNR (35.81) and SSIM (0.95) for lung images from the LC2500 dataset at a 2 <span></span><math>\\n <semantics>\\n <mo>×</mo>\\n <annotation>$\\\\times$</annotation>\\n </semantics></math> upscaling factor. In contrast, real-ESRGAN excelled in perceptual quality, preserving finer image details more effectively, though it recorded slightly lower numerical scores (PSNR: 33.53, SSIM: 0.92) on the same dataset. These outcomes highlight essential trade off between perceptual fidelity and reconstruction quality, indicating that the optimal choice of enhancement method may vary depending on clinical or diagnostic priorities. The MIRNetv2 method delivered reasonable performance but ranked below both real-ESRGAN and SwinIR. Specifically, it achieved PSNR/SSIM scores of 30.67/0.94 on PR-IHC patches, 32.90/0.95 on lung images, and 31.87/0.95 on colon images, while scoring 29.11 for PR-IHC images in a separate evaluation. SRCNN demonstrated a balanced performance across datasets, achieving PSNR/SSIM values of 31.45/0.88 for lung images, 30.76/0.87 for PR-IHC patches, 32.62/0.93 for colon images, and 33.76/0.91 for PR-IHC. These findings underscore the real ESRGAN as the most effective method for improving the resolution and quality of histopathology images, supporting its potential integration into digital pathology workflows to enhance diagnostic accuracy and patient outcomes.</p>\",\"PeriodicalId\":56303,\"journal\":{\"name\":\"IET Image Processing\",\"volume\":\"19 1\",\"pages\":\"\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2025-07-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1049/ipr2.70166\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Image Processing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1049/ipr2.70166\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Image Processing","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/ipr2.70166","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

准确分析组织病理图像对疾病诊断和治疗计划至关重要。然而,数字病理切片的质量往往受到扫描仪分辨率的限制,这可能会损害诊断精度和患者护理。为了解决这一挑战,我们进行了一项比较研究,评估了四种最先进的图像增强方法:真实增强超分辨率生成对抗网络(real - esrgan)、SwinIR、多尺度图像恢复网络v2 (MIRNet-v2)和超分辨率CNN (SRCNN)。我们的评估侧重于定量指标峰值信噪比(PSNR)和结构相似性指数(SSIM)以及定性视觉分析来评估细节保存。实验结果表明,在所有被评估的方法中,SwinIR获得了最好的定量性能,在2 × $\times$的放大因子下,对LC2500数据集的肺部图像获得了最高的PSNR(35.81)和SSIM(0.95)。相比之下,real-ESRGAN在感知质量方面表现出色,更有效地保留了更精细的图像细节,尽管它在同一数据集上记录的数值得分略低(PSNR: 33.53, SSIM: 0.92)。这些结果强调了感知保真度和重建质量之间的基本权衡,表明增强方法的最佳选择可能因临床或诊断优先级而异。MIRNetv2方法提供了合理的性能,但排名低于real-ESRGAN和SwinIR。具体而言,PR-IHC贴片的PSNR/SSIM评分为30.67/0.94,肺图像的PSNR/SSIM评分为32.90/0.95,结肠图像的PSNR/SSIM评分为31.87/0.95,PR-IHC图像在单独评估中得分为29.11。SRCNN在数据集上表现出平衡的性能,肺图像的PSNR/SSIM值为31.45/0.88,PR-IHC补丁为30.76/0.87,结肠图像为32.62/0.93,PR-IHC为33.76/0.91。这些发现强调了真正的ESRGAN是提高组织病理学图像分辨率和质量的最有效方法,支持其与数字病理学工作流程的潜在集成,以提高诊断准确性和患者预后。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Histopathology Image Enhancement Using Multi-Resolution Deep Learning Techniques

Histopathology Image Enhancement Using Multi-Resolution Deep Learning Techniques

Accurate analysis of histopathology images is essential for disease diagnosis and treatment planning. However, the quality of digital pathology slides is often limited by scanner resolution, which can compromise diagnostic precision and patient care. To address this challenge, we conducted a comparative study evaluating four state of the art image enhancement methods: real enhanced super resolution generative adversarial network (Real-ESRGAN), SwinIR, multi scale image restoration network v2 (MIRNet-v2) and super resolution CNN (SRCNN). Our assessment focused on both quantitative metrics peak signal to noise ratio (PSNR) and structural similarity index (SSIM) and qualitative visual analysis to evaluate detail preservation. The experimental results revealed that SwinIR achieved the best quantitative performance among all evaluated methods, attaining the highest PSNR (35.81) and SSIM (0.95) for lung images from the LC2500 dataset at a 2  × $\times$ upscaling factor. In contrast, real-ESRGAN excelled in perceptual quality, preserving finer image details more effectively, though it recorded slightly lower numerical scores (PSNR: 33.53, SSIM: 0.92) on the same dataset. These outcomes highlight essential trade off between perceptual fidelity and reconstruction quality, indicating that the optimal choice of enhancement method may vary depending on clinical or diagnostic priorities. The MIRNetv2 method delivered reasonable performance but ranked below both real-ESRGAN and SwinIR. Specifically, it achieved PSNR/SSIM scores of 30.67/0.94 on PR-IHC patches, 32.90/0.95 on lung images, and 31.87/0.95 on colon images, while scoring 29.11 for PR-IHC images in a separate evaluation. SRCNN demonstrated a balanced performance across datasets, achieving PSNR/SSIM values of 31.45/0.88 for lung images, 30.76/0.87 for PR-IHC patches, 32.62/0.93 for colon images, and 33.76/0.91 for PR-IHC. These findings underscore the real ESRGAN as the most effective method for improving the resolution and quality of histopathology images, supporting its potential integration into digital pathology workflows to enhance diagnostic accuracy and patient outcomes.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IET Image Processing
IET Image Processing 工程技术-工程:电子与电气
CiteScore
5.40
自引率
8.70%
发文量
282
审稿时长
6 months
期刊介绍: The IET Image Processing journal encompasses research areas related to the generation, processing and communication of visual information. The focus of the journal is the coverage of the latest research results in image and video processing, including image generation and display, enhancement and restoration, segmentation, colour and texture analysis, coding and communication, implementations and architectures as well as innovative applications. Principal topics include: Generation and Display - Imaging sensors and acquisition systems, illumination, sampling and scanning, quantization, colour reproduction, image rendering, display and printing systems, evaluation of image quality. Processing and Analysis - Image enhancement, restoration, segmentation, registration, multispectral, colour and texture processing, multiresolution processing and wavelets, morphological operations, stereoscopic and 3-D processing, motion detection and estimation, video and image sequence processing. Implementations and Architectures - Image and video processing hardware and software, design and construction, architectures and software, neural, adaptive, and fuzzy processing. Coding and Transmission - Image and video compression and coding, compression standards, noise modelling, visual information networks, streamed video. Retrieval and Multimedia - Storage of images and video, database design, image retrieval, video annotation and editing, mixed media incorporating visual information, multimedia systems and applications, image and video watermarking, steganography. Applications - Innovative application of image and video processing technologies to any field, including life sciences, earth sciences, astronomy, document processing and security. Current Special Issue Call for Papers: Evolutionary Computation for Image Processing - https://digital-library.theiet.org/files/IET_IPR_CFP_EC.pdf AI-Powered 3D Vision - https://digital-library.theiet.org/files/IET_IPR_CFP_AIPV.pdf Multidisciplinary advancement of Imaging Technologies: From Medical Diagnostics and Genomics to Cognitive Machine Vision, and Artificial Intelligence - https://digital-library.theiet.org/files/IET_IPR_CFP_IST.pdf Deep Learning for 3D Reconstruction - https://digital-library.theiet.org/files/IET_IPR_CFP_DLR.pdf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信