Pamela Osuna-Vargas, Maren H. Wehrheim, Lucas Zinz, Johanna Rahm, Ashwin Balakrishnan, Alexandra Kaminer, Mike Heilemann, Matthias Kaschube
{"title":"Denoising diffusion models for high-resolution microscopy image restoration","authors":"Pamela Osuna-Vargas, Maren H. Wehrheim, Lucas Zinz, Johanna Rahm, Ashwin Balakrishnan, Alexandra Kaminer, Mike Heilemann, Matthias Kaschube","doi":"arxiv-2409.12078","DOIUrl":null,"url":null,"abstract":"Advances in microscopy imaging enable researchers to visualize structures at\nthe nanoscale level thereby unraveling intricate details of biological\norganization. However, challenges such as image noise, photobleaching of\nfluorophores, and low tolerability of biological samples to high light doses\nremain, restricting temporal resolutions and experiment durations. Reduced\nlaser doses enable longer measurements at the cost of lower resolution and\nincreased noise, which hinders accurate downstream analyses. Here we train a\ndenoising diffusion probabilistic model (DDPM) to predict high-resolution\nimages by conditioning the model on low-resolution information. Additionally,\nthe probabilistic aspect of the DDPM allows for repeated generation of images\nthat tend to further increase the signal-to-noise ratio. We show that our model\nachieves a performance that is better or similar to the previously\nbest-performing methods, across four highly diverse datasets. Importantly,\nwhile any of the previous methods show competitive performance for some, but\nnot all datasets, our method consistently achieves high performance across all\nfour data sets, suggesting high generalizability.","PeriodicalId":501289,"journal":{"name":"arXiv - EE - Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - EE - Image and Video Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.12078","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Advances in microscopy imaging enable researchers to visualize structures at
the nanoscale level thereby unraveling intricate details of biological
organization. However, challenges such as image noise, photobleaching of
fluorophores, and low tolerability of biological samples to high light doses
remain, restricting temporal resolutions and experiment durations. Reduced
laser doses enable longer measurements at the cost of lower resolution and
increased noise, which hinders accurate downstream analyses. Here we train a
denoising diffusion probabilistic model (DDPM) to predict high-resolution
images by conditioning the model on low-resolution information. Additionally,
the probabilistic aspect of the DDPM allows for repeated generation of images
that tend to further increase the signal-to-noise ratio. We show that our model
achieves a performance that is better or similar to the previously
best-performing methods, across four highly diverse datasets. Importantly,
while any of the previous methods show competitive performance for some, but
not all datasets, our method consistently achieves high performance across all
four data sets, suggesting high generalizability.