A practical framework for unsupervised structure preservation medical image enhancement

IF 4.9 2区 医学 Q1 ENGINEERING, BIOMEDICAL
{"title":"A practical framework for unsupervised structure preservation medical image enhancement","authors":"","doi":"10.1016/j.bspc.2024.106918","DOIUrl":null,"url":null,"abstract":"<div><div>Low-quality (LQ) images often lead to difficulties in the screening and diagnosis of medical diseases. Unsupervised generative adversarial networks (GAN)-based image enhancement methods offer promising solutions. However, there is a quality-originality trade-off in that they produce visually pleasing results but fail to reserve the originality, especially the structural inputs. Moreover, objectively evaluating structure preservation for unsupervised medical image enhancement tasks (i.e., without reference images) is essential. In this study, we propose (1) Laplacian structural similarity index measure (LaSSIM) - a non-reference objective structure preservation evaluation for unsupervised medical image enhancement methods; and (2) a novel unsupervised GAN-based method called Laplacian medical image enhancement (LaMEGAN) to balance both originality and quality from LQ images. The proposed LaSSIM does not require clean reference images and is superior to SSIM in capturing image structural changes under image degradations, such as strong blurring on various image datasets. Experiments demonstrate that our LaMEGAN effectively balances the quality and originality trade-off. Compared to CycleGAN, which achieves superior quality scores but lacks in structure preservation, LaMEGAN outperforms significantly in structure preservation, scoring 4.05 compared to 3.58 on the mean doctor opinion score (MDOS). Additionally, LaMEGAN produces visually appealing images with quality scores close to CycleGAN in all eight evaluation metrics. The implementation code will be available at <span><span>https://github.com/AillisInc/USPMIE</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":55362,"journal":{"name":"Biomedical Signal Processing and Control","volume":null,"pages":null},"PeriodicalIF":4.9000,"publicationDate":"2024-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical Signal Processing and Control","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1746809424009765","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Low-quality (LQ) images often lead to difficulties in the screening and diagnosis of medical diseases. Unsupervised generative adversarial networks (GAN)-based image enhancement methods offer promising solutions. However, there is a quality-originality trade-off in that they produce visually pleasing results but fail to reserve the originality, especially the structural inputs. Moreover, objectively evaluating structure preservation for unsupervised medical image enhancement tasks (i.e., without reference images) is essential. In this study, we propose (1) Laplacian structural similarity index measure (LaSSIM) - a non-reference objective structure preservation evaluation for unsupervised medical image enhancement methods; and (2) a novel unsupervised GAN-based method called Laplacian medical image enhancement (LaMEGAN) to balance both originality and quality from LQ images. The proposed LaSSIM does not require clean reference images and is superior to SSIM in capturing image structural changes under image degradations, such as strong blurring on various image datasets. Experiments demonstrate that our LaMEGAN effectively balances the quality and originality trade-off. Compared to CycleGAN, which achieves superior quality scores but lacks in structure preservation, LaMEGAN outperforms significantly in structure preservation, scoring 4.05 compared to 3.58 on the mean doctor opinion score (MDOS). Additionally, LaMEGAN produces visually appealing images with quality scores close to CycleGAN in all eight evaluation metrics. The implementation code will be available at https://github.com/AillisInc/USPMIE.
无监督结构保存医学图像增强实用框架
低质量(LQ)图像通常会给医学疾病的筛查和诊断带来困难。基于无监督生成式对抗网络(GAN)的图像增强方法提供了有前景的解决方案。然而,这些方法在质量和原始性之间存在权衡,即它们能产生视觉上令人愉悦的结果,但却无法保留原始性,尤其是结构输入。此外,客观地评估无监督医学图像增强任务(即没有参考图像)的结构保留至关重要。在本研究中,我们提出了(1)拉普拉斯结构相似性指数测量法(LaSSIM)--一种用于无监督医学图像增强方法的非参考客观结构保留评估方法;以及(2)一种基于 GAN 的新型无监督拉普拉斯医学图像增强方法(LaMEGAN),以平衡 LQ 图像的原创性和质量。所提出的 LaSSIM 不需要干净的参考图像,在捕捉图像退化(如各种图像数据集上的强模糊)情况下的图像结构变化方面优于 SSIM。实验证明,我们的 LaMEGAN 有效地平衡了质量和原创性之间的权衡。CycleGAN 的质量得分较高,但在结构保护方面有所欠缺;相比之下,LaMEGAN 在结构保护方面表现出色,其平均医生意见得分(MDOS)为 4.05 分,而 CycleGAN 为 3.58 分。此外,LaMEGAN 生成的图像具有视觉吸引力,在所有八个评估指标上的质量得分都接近 CycleGAN。实现代码将发布在 https://github.com/AillisInc/USPMIE 网站上。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Biomedical Signal Processing and Control
Biomedical Signal Processing and Control 工程技术-工程:生物医学
CiteScore
9.80
自引率
13.70%
发文量
822
审稿时长
4 months
期刊介绍: Biomedical Signal Processing and Control aims to provide a cross-disciplinary international forum for the interchange of information on research in the measurement and analysis of signals and images in clinical medicine and the biological sciences. Emphasis is placed on contributions dealing with the practical, applications-led research on the use of methods and devices in clinical diagnosis, patient monitoring and management. Biomedical Signal Processing and Control reflects the main areas in which these methods are being used and developed at the interface of both engineering and clinical science. The scope of the journal is defined to include relevant review papers, technical notes, short communications and letters. Tutorial papers and special issues will also be published.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信