{"title":"Structured Illumination Microscopy With Uncertainty-Guided Deep Learning","authors":"Xuyang Chang;Xiaoqin Zhu;Yibo Feng;Zhenyue Chen;Liheng Bian","doi":"10.1109/TCI.2025.3550715","DOIUrl":null,"url":null,"abstract":"Super-resolution microscopy enables the visualization of subcellular structures with unprecedented detail, significantly advancing life sciences. Among the various techniques available, structured illumination microscopy (SIM) provides an ideal balance of speed, resolution, and phototoxicity. Recent advancements in deep learning have further enhanced SIM capabilities, achieving improved imaging quality with higher signal-to-noise ratios and fewer measurements. However, the opaque nature of these deep learning models complicates the quantification of uncertainty in their outputs, which may lead to visually appealing but scientifically inaccurate results, particularly challenging for clinical diagnostics. In this paper, we introduce a two-step strategy that not only quantifies the uncertainty of deep learning models but also enhances super-resolution reconstruction. The first step implements a novel sparse-constrained loss function, incorporating Jeffrey's prior, to accurately predict uncertainty maps. These maps assess the confidence levels of the network's predictions and identify potential inaccuracies. In the second step, these predicted uncertainty maps serve as an attention mechanism, directing the neural network's focus towards areas of high uncertainty to improve the reconstruction of high-frequency details and textures. A series of simulations and experiments confirm that our method accurately quantifies uncertainty and improves high-resolution image reconstruction, increasing the peak signal-to-noise ratio by an average of 1.7 dB and structural similarity by 0.06, compared to traditional methods on mitochondrial and microtubule datasets. Our approach holds promise for advancing the application of deep learning-based super-resolution microscopy in clinical settings.","PeriodicalId":56022,"journal":{"name":"IEEE Transactions on Computational Imaging","volume":"11 ","pages":"389-398"},"PeriodicalIF":4.2000,"publicationDate":"2025-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Imaging","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10923692/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Super-resolution microscopy enables the visualization of subcellular structures with unprecedented detail, significantly advancing life sciences. Among the various techniques available, structured illumination microscopy (SIM) provides an ideal balance of speed, resolution, and phototoxicity. Recent advancements in deep learning have further enhanced SIM capabilities, achieving improved imaging quality with higher signal-to-noise ratios and fewer measurements. However, the opaque nature of these deep learning models complicates the quantification of uncertainty in their outputs, which may lead to visually appealing but scientifically inaccurate results, particularly challenging for clinical diagnostics. In this paper, we introduce a two-step strategy that not only quantifies the uncertainty of deep learning models but also enhances super-resolution reconstruction. The first step implements a novel sparse-constrained loss function, incorporating Jeffrey's prior, to accurately predict uncertainty maps. These maps assess the confidence levels of the network's predictions and identify potential inaccuracies. In the second step, these predicted uncertainty maps serve as an attention mechanism, directing the neural network's focus towards areas of high uncertainty to improve the reconstruction of high-frequency details and textures. A series of simulations and experiments confirm that our method accurately quantifies uncertainty and improves high-resolution image reconstruction, increasing the peak signal-to-noise ratio by an average of 1.7 dB and structural similarity by 0.06, compared to traditional methods on mitochondrial and microtubule datasets. Our approach holds promise for advancing the application of deep learning-based super-resolution microscopy in clinical settings.
期刊介绍:
The IEEE Transactions on Computational Imaging will publish articles where computation plays an integral role in the image formation process. Papers will cover all areas of computational imaging ranging from fundamental theoretical methods to the latest innovative computational imaging system designs. Topics of interest will include advanced algorithms and mathematical techniques, model-based data inversion, methods for image and signal recovery from sparse and incomplete data, techniques for non-traditional sensing of image data, methods for dynamic information acquisition and extraction from imaging sensors, software and hardware for efficient computation in imaging systems, and highly novel imaging system design.