{"title":"通过正则化潜在搜索重建计算超分辨率显微镜中的可解释特征。","authors":"Marzieh Gheisari, Auguste Genovesio","doi":"10.1017/S2633903X24000084","DOIUrl":null,"url":null,"abstract":"<p><p>Supervised deep learning approaches can artificially increase the resolution of microscopy images by learning a mapping between two image resolutions or modalities. However, such methods often require a large set of hard-to-get low-res/high-res image pairs and produce synthetic images with a moderate increase in resolution. Conversely, recent methods based on generative adversarial network (GAN) latent search offered a drastic increase in resolution without the need of paired images. However, they offer limited reconstruction of the high-resolution (HR) image interpretable features. Here, we propose a robust super-resolution (SR) method based on regularized latent search (RLS) that offers an actionable balance between fidelity to the ground truth (GT) and realism of the recovered image given a distribution prior. The latter allows to split the analysis of a low-resolution (LR) image into a computational SR task performed by deep learning followed by a quantification task performed by a handcrafted algorithm based on interpretable biological features. This two-step process holds potential for various applications such as diagnostics on mobile devices, where the main aim is not to recover the HR details of a specific sample but rather to obtain HR images that preserve explainable and quantifiable differences between conditions.</p>","PeriodicalId":72371,"journal":{"name":"Biological imaging","volume":"4 ","pages":"e8"},"PeriodicalIF":0.0000,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11418082/pdf/","citationCount":"0","resultStr":"{\"title\":\"Reconstructing interpretable features in computational super-resolution microscopy via regularized latent search.\",\"authors\":\"Marzieh Gheisari, Auguste Genovesio\",\"doi\":\"10.1017/S2633903X24000084\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Supervised deep learning approaches can artificially increase the resolution of microscopy images by learning a mapping between two image resolutions or modalities. However, such methods often require a large set of hard-to-get low-res/high-res image pairs and produce synthetic images with a moderate increase in resolution. Conversely, recent methods based on generative adversarial network (GAN) latent search offered a drastic increase in resolution without the need of paired images. However, they offer limited reconstruction of the high-resolution (HR) image interpretable features. Here, we propose a robust super-resolution (SR) method based on regularized latent search (RLS) that offers an actionable balance between fidelity to the ground truth (GT) and realism of the recovered image given a distribution prior. The latter allows to split the analysis of a low-resolution (LR) image into a computational SR task performed by deep learning followed by a quantification task performed by a handcrafted algorithm based on interpretable biological features. This two-step process holds potential for various applications such as diagnostics on mobile devices, where the main aim is not to recover the HR details of a specific sample but rather to obtain HR images that preserve explainable and quantifiable differences between conditions.</p>\",\"PeriodicalId\":72371,\"journal\":{\"name\":\"Biological imaging\",\"volume\":\"4 \",\"pages\":\"e8\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-05-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11418082/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biological imaging\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1017/S2633903X24000084\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biological imaging","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1017/S2633903X24000084","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
有监督的深度学习方法可以通过学习两种图像分辨率或模式之间的映射,人为提高显微图像的分辨率。然而,这类方法通常需要大量难以获得的低分辨率/高分辨率图像对,生成的合成图像分辨率也只能适度提高。相反,最近基于生成式对抗网络(GAN)潜搜索的方法无需配对图像即可大幅提高分辨率。然而,这些方法对高分辨率(HR)图像可解释特征的重建有限。在此,我们提出了一种基于正则化潜在搜索(RLS)的鲁棒性超分辨率(SR)方法,该方法在忠实于地面实况(GT)和给定分布先验的恢复图像逼真度之间实现了可操作的平衡。后者可以将低分辨率(LR)图像的分析拆分为由深度学习执行的计算 SR 任务和由基于可解释生物特征的手工算法执行的量化任务。这种两步法可用于各种应用,如移动设备诊断,其主要目的不是恢复特定样本的 HR 细节,而是获取 HR 图像,以保留不同条件下可解释和可量化的差异。
Reconstructing interpretable features in computational super-resolution microscopy via regularized latent search.
Supervised deep learning approaches can artificially increase the resolution of microscopy images by learning a mapping between two image resolutions or modalities. However, such methods often require a large set of hard-to-get low-res/high-res image pairs and produce synthetic images with a moderate increase in resolution. Conversely, recent methods based on generative adversarial network (GAN) latent search offered a drastic increase in resolution without the need of paired images. However, they offer limited reconstruction of the high-resolution (HR) image interpretable features. Here, we propose a robust super-resolution (SR) method based on regularized latent search (RLS) that offers an actionable balance between fidelity to the ground truth (GT) and realism of the recovered image given a distribution prior. The latter allows to split the analysis of a low-resolution (LR) image into a computational SR task performed by deep learning followed by a quantification task performed by a handcrafted algorithm based on interpretable biological features. This two-step process holds potential for various applications such as diagnostics on mobile devices, where the main aim is not to recover the HR details of a specific sample but rather to obtain HR images that preserve explainable and quantifiable differences between conditions.