Colloidoscope: detecting dense colloids in 3D with deep learning.

IF 2.8 3区 化学 Q3 CHEMISTRY, PHYSICAL
Soft Matter Pub Date : 2025-06-09 DOI:10.1039/d4sm01307g
Abdelwahab Kawafi, Lars Kürten, Levke Ortlieb, Yushi Yang, Abraham Mauleon Amieva, James Hallett, C Patrick Royall
{"title":"Colloidoscope: detecting dense colloids in 3D with deep learning.","authors":"Abdelwahab Kawafi, Lars Kürten, Levke Ortlieb, Yushi Yang, Abraham Mauleon Amieva, James Hallett, C Patrick Royall","doi":"10.1039/d4sm01307g","DOIUrl":null,"url":null,"abstract":"<p><p>Colloidoscope is a deep learning pipeline employing a 3D residual U-net architecture, designed to enhance the tracking of dense colloidal suspensions through confocal microscopy. This methodology uses a simulated training dataset that reflects a wide array of real-world imaging conditions, specifically targeting high colloid volume fraction and low-contrast scenarios where traditional detection methods struggle. Central to our approach is the use of experimental signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR), and point-spread-functions (PSFs) to accurately quantify and simulate the experimental data. Our findings reveal that Colloidoscope achieves superior recall in particle detection (it finds more particles) compared to conventional methods. Simultaneously, high precision is maintained (high fraction of true positives). The model demonstrates a notable robustness to photobleached samples, thereby prolonging the imaging time and number of frames that may be acquired. Furthermore, Colloidoscope maintains small scale resolution sufficient to classify local structural motifs. Evaluated across both simulated and experimental datasets, Colloidoscope brings the advancements in computer vision offered by deep learning to particle tracking at high volume fractions. We offer a promising tool for researchers in the soft matter community. This model is deployed and available to use pretrained at https://github.com/wahabk/colloidoscope.</p>","PeriodicalId":103,"journal":{"name":"Soft Matter","volume":" ","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2025-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Soft Matter","FirstCategoryId":"92","ListUrlMain":"https://doi.org/10.1039/d4sm01307g","RegionNum":3,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"CHEMISTRY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Colloidoscope is a deep learning pipeline employing a 3D residual U-net architecture, designed to enhance the tracking of dense colloidal suspensions through confocal microscopy. This methodology uses a simulated training dataset that reflects a wide array of real-world imaging conditions, specifically targeting high colloid volume fraction and low-contrast scenarios where traditional detection methods struggle. Central to our approach is the use of experimental signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR), and point-spread-functions (PSFs) to accurately quantify and simulate the experimental data. Our findings reveal that Colloidoscope achieves superior recall in particle detection (it finds more particles) compared to conventional methods. Simultaneously, high precision is maintained (high fraction of true positives). The model demonstrates a notable robustness to photobleached samples, thereby prolonging the imaging time and number of frames that may be acquired. Furthermore, Colloidoscope maintains small scale resolution sufficient to classify local structural motifs. Evaluated across both simulated and experimental datasets, Colloidoscope brings the advancements in computer vision offered by deep learning to particle tracking at high volume fractions. We offer a promising tool for researchers in the soft matter community. This model is deployed and available to use pretrained at https://github.com/wahabk/colloidoscope.

胶体镜:利用深度学习技术检测三维致密胶体。
Colloidoscope是一种采用3D残余U-net架构的深度学习管道,旨在通过共聚焦显微镜增强对密集胶体悬浮液的跟踪。该方法使用模拟训练数据集,该数据集反映了广泛的现实世界成像条件,特别是针对传统检测方法难以解决的高胶体体积分数和低对比度场景。我们方法的核心是使用实验信噪比(SNR),对比噪声比(CNR)和点扩展函数(psf)来准确量化和模拟实验数据。我们的研究结果表明,与传统方法相比,胶体镜在粒子检测方面具有更高的召回率(发现更多的粒子)。同时,保持高精度(真阳性的高分数)。该模型对光漂白样品具有显著的鲁棒性,从而延长了成像时间和可以获得的帧数。此外,胶体镜保持小尺度分辨率,足以分类局部结构基元。通过模拟和实验数据集进行评估,Colloidoscope将深度学习提供的计算机视觉技术的进步带入了高体积分数的粒子跟踪。我们为软物质领域的研究人员提供了一个很有前途的工具。该模型已部署并可在https://github.com/wahabk/colloidoscope上使用预训练。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Soft Matter
Soft Matter 工程技术-材料科学:综合
CiteScore
6.00
自引率
5.90%
发文量
891
审稿时长
1.9 months
期刊介绍: Soft Matter is an international journal published by the Royal Society of Chemistry using Engineering-Materials Science: A Synthesis as its research focus. It publishes original research articles, review articles, and synthesis articles related to this field, reporting the latest discoveries in the relevant theoretical, practical, and applied disciplines in a timely manner, and aims to promote the rapid exchange of scientific information in this subject area. The journal is an open access journal. The journal is an open access journal and has not been placed on the alert list in the last three years.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信