Structured Illumination Microscopy With Uncertainty-Guided Deep Learning

IF 4.2 2区 计算机科学 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Xuyang Chang;Xiaoqin Zhu;Yibo Feng;Zhenyue Chen;Liheng Bian
{"title":"Structured Illumination Microscopy With Uncertainty-Guided Deep Learning","authors":"Xuyang Chang;Xiaoqin Zhu;Yibo Feng;Zhenyue Chen;Liheng Bian","doi":"10.1109/TCI.2025.3550715","DOIUrl":null,"url":null,"abstract":"Super-resolution microscopy enables the visualization of subcellular structures with unprecedented detail, significantly advancing life sciences. Among the various techniques available, structured illumination microscopy (SIM) provides an ideal balance of speed, resolution, and phototoxicity. Recent advancements in deep learning have further enhanced SIM capabilities, achieving improved imaging quality with higher signal-to-noise ratios and fewer measurements. However, the opaque nature of these deep learning models complicates the quantification of uncertainty in their outputs, which may lead to visually appealing but scientifically inaccurate results, particularly challenging for clinical diagnostics. In this paper, we introduce a two-step strategy that not only quantifies the uncertainty of deep learning models but also enhances super-resolution reconstruction. The first step implements a novel sparse-constrained loss function, incorporating Jeffrey's prior, to accurately predict uncertainty maps. These maps assess the confidence levels of the network's predictions and identify potential inaccuracies. In the second step, these predicted uncertainty maps serve as an attention mechanism, directing the neural network's focus towards areas of high uncertainty to improve the reconstruction of high-frequency details and textures. A series of simulations and experiments confirm that our method accurately quantifies uncertainty and improves high-resolution image reconstruction, increasing the peak signal-to-noise ratio by an average of 1.7 dB and structural similarity by 0.06, compared to traditional methods on mitochondrial and microtubule datasets. Our approach holds promise for advancing the application of deep learning-based super-resolution microscopy in clinical settings.","PeriodicalId":56022,"journal":{"name":"IEEE Transactions on Computational Imaging","volume":"11 ","pages":"389-398"},"PeriodicalIF":4.2000,"publicationDate":"2025-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Imaging","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10923692/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Super-resolution microscopy enables the visualization of subcellular structures with unprecedented detail, significantly advancing life sciences. Among the various techniques available, structured illumination microscopy (SIM) provides an ideal balance of speed, resolution, and phototoxicity. Recent advancements in deep learning have further enhanced SIM capabilities, achieving improved imaging quality with higher signal-to-noise ratios and fewer measurements. However, the opaque nature of these deep learning models complicates the quantification of uncertainty in their outputs, which may lead to visually appealing but scientifically inaccurate results, particularly challenging for clinical diagnostics. In this paper, we introduce a two-step strategy that not only quantifies the uncertainty of deep learning models but also enhances super-resolution reconstruction. The first step implements a novel sparse-constrained loss function, incorporating Jeffrey's prior, to accurately predict uncertainty maps. These maps assess the confidence levels of the network's predictions and identify potential inaccuracies. In the second step, these predicted uncertainty maps serve as an attention mechanism, directing the neural network's focus towards areas of high uncertainty to improve the reconstruction of high-frequency details and textures. A series of simulations and experiments confirm that our method accurately quantifies uncertainty and improves high-resolution image reconstruction, increasing the peak signal-to-noise ratio by an average of 1.7 dB and structural similarity by 0.06, compared to traditional methods on mitochondrial and microtubule datasets. Our approach holds promise for advancing the application of deep learning-based super-resolution microscopy in clinical settings.
结构照明显微镜与不确定性引导的深度学习
超分辨率显微镜使亚细胞结构的可视化与前所未有的细节,显著推进生命科学。在各种可用的技术中,结构照明显微镜(SIM)提供了速度,分辨率和光毒性的理想平衡。深度学习的最新进展进一步增强了SIM功能,通过更高的信噪比和更少的测量,实现了更高的成像质量。然而,这些深度学习模型的不透明性质使其输出中的不确定性的量化复杂化,这可能导致视觉上吸引人但科学上不准确的结果,对临床诊断尤其具有挑战性。在本文中,我们引入了一种两步策略,不仅量化了深度学习模型的不确定性,而且增强了超分辨率重建。第一步实现了一个新的稀疏约束损失函数,结合杰弗里先验,以准确预测不确定性映射。这些地图评估了网络预测的可信度,并识别出潜在的不准确性。在第二步中,这些预测的不确定性图作为一种注意机制,引导神经网络的焦点转向高不确定性的区域,以改善高频细节和纹理的重建。一系列的模拟和实验证实,与传统方法相比,我们的方法准确地量化了不确定性,提高了高分辨率图像的重建,峰值信噪比平均提高了1.7 dB,结构相似性提高了0.06。我们的方法有望推进基于深度学习的超分辨率显微镜在临床环境中的应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Computational Imaging
IEEE Transactions on Computational Imaging Mathematics-Computational Mathematics
CiteScore
8.20
自引率
7.40%
发文量
59
期刊介绍: The IEEE Transactions on Computational Imaging will publish articles where computation plays an integral role in the image formation process. Papers will cover all areas of computational imaging ranging from fundamental theoretical methods to the latest innovative computational imaging system designs. Topics of interest will include advanced algorithms and mathematical techniques, model-based data inversion, methods for image and signal recovery from sparse and incomplete data, techniques for non-traditional sensing of image data, methods for dynamic information acquisition and extraction from imaging sensors, software and hardware for efficient computation in imaging systems, and highly novel imaging system design.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信