Structured Illumination Microscopy With Uncertainty-Guided Deep Learning

IF 4.2 2区 计算机科学 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Xuyang Chang;Xiaoqin Zhu;Yibo Feng;Zhenyue Chen;Liheng Bian
{"title":"Structured Illumination Microscopy With Uncertainty-Guided Deep Learning","authors":"Xuyang Chang;Xiaoqin Zhu;Yibo Feng;Zhenyue Chen;Liheng Bian","doi":"10.1109/TCI.2025.3550715","DOIUrl":null,"url":null,"abstract":"Super-resolution microscopy enables the visualization of subcellular structures with unprecedented detail, significantly advancing life sciences. Among the various techniques available, structured illumination microscopy (SIM) provides an ideal balance of speed, resolution, and phototoxicity. Recent advancements in deep learning have further enhanced SIM capabilities, achieving improved imaging quality with higher signal-to-noise ratios and fewer measurements. However, the opaque nature of these deep learning models complicates the quantification of uncertainty in their outputs, which may lead to visually appealing but scientifically inaccurate results, particularly challenging for clinical diagnostics. In this paper, we introduce a two-step strategy that not only quantifies the uncertainty of deep learning models but also enhances super-resolution reconstruction. The first step implements a novel sparse-constrained loss function, incorporating Jeffrey's prior, to accurately predict uncertainty maps. These maps assess the confidence levels of the network's predictions and identify potential inaccuracies. In the second step, these predicted uncertainty maps serve as an attention mechanism, directing the neural network's focus towards areas of high uncertainty to improve the reconstruction of high-frequency details and textures. A series of simulations and experiments confirm that our method accurately quantifies uncertainty and improves high-resolution image reconstruction, increasing the peak signal-to-noise ratio by an average of 1.7 dB and structural similarity by 0.06, compared to traditional methods on mitochondrial and microtubule datasets. Our approach holds promise for advancing the application of deep learning-based super-resolution microscopy in clinical settings.","PeriodicalId":56022,"journal":{"name":"IEEE Transactions on Computational Imaging","volume":"11 ","pages":"389-398"},"PeriodicalIF":4.2000,"publicationDate":"2025-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Imaging","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10923692/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Super-resolution microscopy enables the visualization of subcellular structures with unprecedented detail, significantly advancing life sciences. Among the various techniques available, structured illumination microscopy (SIM) provides an ideal balance of speed, resolution, and phototoxicity. Recent advancements in deep learning have further enhanced SIM capabilities, achieving improved imaging quality with higher signal-to-noise ratios and fewer measurements. However, the opaque nature of these deep learning models complicates the quantification of uncertainty in their outputs, which may lead to visually appealing but scientifically inaccurate results, particularly challenging for clinical diagnostics. In this paper, we introduce a two-step strategy that not only quantifies the uncertainty of deep learning models but also enhances super-resolution reconstruction. The first step implements a novel sparse-constrained loss function, incorporating Jeffrey's prior, to accurately predict uncertainty maps. These maps assess the confidence levels of the network's predictions and identify potential inaccuracies. In the second step, these predicted uncertainty maps serve as an attention mechanism, directing the neural network's focus towards areas of high uncertainty to improve the reconstruction of high-frequency details and textures. A series of simulations and experiments confirm that our method accurately quantifies uncertainty and improves high-resolution image reconstruction, increasing the peak signal-to-noise ratio by an average of 1.7 dB and structural similarity by 0.06, compared to traditional methods on mitochondrial and microtubule datasets. Our approach holds promise for advancing the application of deep learning-based super-resolution microscopy in clinical settings.
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Computational Imaging
IEEE Transactions on Computational Imaging Mathematics-Computational Mathematics
CiteScore
8.20
自引率
7.40%
发文量
59
期刊介绍: The IEEE Transactions on Computational Imaging will publish articles where computation plays an integral role in the image formation process. Papers will cover all areas of computational imaging ranging from fundamental theoretical methods to the latest innovative computational imaging system designs. Topics of interest will include advanced algorithms and mathematical techniques, model-based data inversion, methods for image and signal recovery from sparse and incomplete data, techniques for non-traditional sensing of image data, methods for dynamic information acquisition and extraction from imaging sensors, software and hardware for efficient computation in imaging systems, and highly novel imaging system design.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信