Yuping He, Yunhua Yao, Yilin He, Zhen-Jian Huang, D. Qi, Chonglei Zhang, Xiaoshuai Huang, K. Shi, Pengpeng Ding, C. Jin, L. Deng, Zhenrong Sun, Xiaocong Yuan, Shian Zhang
{"title":"Untrained neural network enhances the resolution of structured illumination microscopy under strong background and noise levels","authors":"Yuping He, Yunhua Yao, Yilin He, Zhen-Jian Huang, D. Qi, Chonglei Zhang, Xiaoshuai Huang, K. Shi, Pengpeng Ding, C. Jin, L. Deng, Zhenrong Sun, Xiaocong Yuan, Shian Zhang","doi":"10.1117/1.APN.2.4.046005","DOIUrl":null,"url":null,"abstract":"Abstract. Structured illumination microscopy (SIM) has been widely applied in the superresolution imaging of subcellular dynamics in live cells. Higher spatial resolution is expected for the observation of finer structures. However, further increasing spatial resolution in SIM under the condition of strong background and noise levels remains challenging. Here, we report a method to achieve deep resolution enhancement of SIM by combining an untrained neural network with an alternating direction method of multipliers (ADMM) framework, i.e., ADMM-DRE-SIM. By exploiting the implicit image priors in the neural network and the Hessian prior in the ADMM framework associated with the optical transfer model of SIM, ADMM-DRE-SIM can further realize the spatial frequency extension without the requirement of training datasets. Moreover, an image degradation model containing the convolution with equivalent point spread function of SIM and additional background map is utilized to suppress the strong background while keeping the structure fidelity. Experimental results by imaging tubulins and actins show that ADMM-DRE-SIM can obtain the resolution enhancement by a factor of ∼1.6 compared to conventional SIM, evidencing the promising applications of ADMM-DRE-SIM in superresolution biomedical imaging.","PeriodicalId":223078,"journal":{"name":"Advanced Photonics Nexus","volume":"12 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Photonics Nexus","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/1.APN.2.4.046005","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract. Structured illumination microscopy (SIM) has been widely applied in the superresolution imaging of subcellular dynamics in live cells. Higher spatial resolution is expected for the observation of finer structures. However, further increasing spatial resolution in SIM under the condition of strong background and noise levels remains challenging. Here, we report a method to achieve deep resolution enhancement of SIM by combining an untrained neural network with an alternating direction method of multipliers (ADMM) framework, i.e., ADMM-DRE-SIM. By exploiting the implicit image priors in the neural network and the Hessian prior in the ADMM framework associated with the optical transfer model of SIM, ADMM-DRE-SIM can further realize the spatial frequency extension without the requirement of training datasets. Moreover, an image degradation model containing the convolution with equivalent point spread function of SIM and additional background map is utilized to suppress the strong background while keeping the structure fidelity. Experimental results by imaging tubulins and actins show that ADMM-DRE-SIM can obtain the resolution enhancement by a factor of ∼1.6 compared to conventional SIM, evidencing the promising applications of ADMM-DRE-SIM in superresolution biomedical imaging.
摘要结构照明显微镜(SIM)已广泛应用于活细胞亚细胞动力学的超分辨率成像。对于精细结构的观测,期望有更高的空间分辨率。然而,在强背景和强噪声条件下,进一步提高SIM的空间分辨率仍然是一个挑战。在此,我们报告了一种将未经训练的神经网络与交替方向乘法器(ADMM)框架(即ADMM- dre -SIM)相结合来实现SIM深度分辨率增强的方法。利用神经网络中的隐式图像先验和ADMM框架中的Hessian先验与SIM的光传递模型相结合,ADMM- dre -SIM可以在不需要训练数据集的情况下进一步实现空间频率扩展。此外,在保持结构保真度的前提下,利用等效点扩展函数与附加背景映射卷积的图像退化模型抑制强背景。通过对微管和肌动蛋白成像的实验结果表明,ADMM-DRE-SIM的分辨率比传统的SIM提高了约1.6倍,证明了ADMM-DRE-SIM在超分辨率生物医学成像中的应用前景。