Roman Spilger, Ji Young Lee, R. Bartenschlager, K. Rohr
{"title":"Deep Neural Network for Combined Particle Tracking and Colocalization Analysis in Two-Channel Microscopy Images","authors":"Roman Spilger, Ji Young Lee, R. Bartenschlager, K. Rohr","doi":"10.1109/ISBI52829.2022.9761696","DOIUrl":null,"url":null,"abstract":"Analyzing protein dynamics in multi-channel fluorescence microscopy data is important to understand biological processes. We present a novel deep learning approach for combined particle tracking and colocalization analysis in two-channel microscopy image sequences. The approach is based on a convolutional long short-term memory network and exploits colocalization information to improve tracking. Short and long-term temporal dependencies of object motion as well as image intensities are taken into account to compute assignment probabilities jointly across multiple detections. Colocalization probabilities are also determined by the neural network. We evaluated the performance of the proposed approach based on synthetic images and real two-channel fluorescence microscopy data. It turned out that our approach outperforms previous methods.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"5 1","pages":"1-4"},"PeriodicalIF":0.0000,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISBI52829.2022.9761696","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
Abstract
Analyzing protein dynamics in multi-channel fluorescence microscopy data is important to understand biological processes. We present a novel deep learning approach for combined particle tracking and colocalization analysis in two-channel microscopy image sequences. The approach is based on a convolutional long short-term memory network and exploits colocalization information to improve tracking. Short and long-term temporal dependencies of object motion as well as image intensities are taken into account to compute assignment probabilities jointly across multiple detections. Colocalization probabilities are also determined by the neural network. We evaluated the performance of the proposed approach based on synthetic images and real two-channel fluorescence microscopy data. It turned out that our approach outperforms previous methods.