Proceedings of SPIE--the International Society for Optical Engineering最新文献

筛选
英文 中文
Glo-VLMs: Leveraging Vision-Language Models for Fine-Grained Diseased Glomerulus Classification. Glo-VLMs:利用视觉语言模型进行细粒病变肾小球分类。
Proceedings of SPIE--the International Society for Optical Engineering Pub Date : 2026-01-01 Epub Date: 2026-04-02 DOI: 10.1117/12.3085625
Zhenhao Guo, Rachit Saluja, Hongjin Fang, Tianyuan Yao, Quan Liu, Yuankai Huo, Benjamin Liechty, David J Pisapia, Kenji Ikemura, Mert R Sabuncu, Yihe Yang, Ruining Deng
{"title":"Glo-VLMs: Leveraging Vision-Language Models for Fine-Grained Diseased Glomerulus Classification.","authors":"Zhenhao Guo, Rachit Saluja, Hongjin Fang, Tianyuan Yao, Quan Liu, Yuankai Huo, Benjamin Liechty, David J Pisapia, Kenji Ikemura, Mert R Sabuncu, Yihe Yang, Ruining Deng","doi":"10.1117/12.3085625","DOIUrl":"10.1117/12.3085625","url":null,"abstract":"<p><p>Vision-language models (VLMs) have shown considerable potential in digital pathology, yet their effectiveness remains limited for fine-grained, disease-specific classification tasks such as distinguishing between glomerular subtypes. The subtle morphological variations among these subtypes, combined with the difficulty of aligning visual patterns with precise clinical terminology, make automated diagnosis in renal pathology particularly challenging. In this work, we explore how large pretrained VLMs can be effectively adapted to perform fine-grained glomerular classification, even in scenarios where only a small number of labeled examples are available. In this work, we introduce Glo-VLMs, a systematic framework designed to explore the adaptation of VLMs to fine-grained glomerular classification in data-constrained settings. Our approach leverages curated pathology images alongside clinical text prompts to facilitate joint image-text representation learning for nuanced renal pathology subtypes. By assessing various VLMs architectures and adaptation strategies under a few-shot learning paradigm, we explore how both the choice of method and the amount of labeled data impact model performance in clinically relevant scenarios. To ensure a fair comparison, we evaluate all models using standardized multi-class metrics, aiming to clarify the practical requirements and potential of large pretrained models for specialized clinical research applications. As a result, fine-tuning the VLMs achieved 0.7416 accuracy, 0.9045 macro-AUC, and 0.5277 F1-score with only 8 shots per class, demonstrating that even with highly limited supervision, foundation models can be effectively adapted for fine-grained medical image classification.</p>","PeriodicalId":74505,"journal":{"name":"Proceedings of SPIE--the International Society for Optical Engineering","volume":"13932 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13600262/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149042639","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fully Differentiable dMRI Streamline Propagation in PyTorch. PyTorch中完全可微的dMRI流线传播。
Proceedings of SPIE--the International Society for Optical Engineering Pub Date : 2026-01-01 Epub Date: 2026-04-03 DOI: 10.1117/12.3086590
Jongyeon Yoon, Elyssa M McMaster, Michael E Kim, Gaurav Rudravaram, Kurt G Schilling, Bennett A Landman, Daniel Moyer
{"title":"Fully Differentiable dMRI Streamline Propagation in PyTorch.","authors":"Jongyeon Yoon, Elyssa M McMaster, Michael E Kim, Gaurav Rudravaram, Kurt G Schilling, Bennett A Landman, Daniel Moyer","doi":"10.1117/12.3086590","DOIUrl":"10.1117/12.3086590","url":null,"abstract":"<p><p>Diffusion MRI (dMRI) provides a distinctive means to probe the microstructural architecture of living tissue, facilitating applications such as brain connectivity analysis, modeling across multiple conditions, and the estimation of macrostructural features. Tractography, which emerged in the final years of the 20th century and accelerated in the early 21st century, is a technique for visualizing white matter pathways in the brain using dMRI. Most diffusion tractography methods rely on procedural streamline propagators or global energy minimization methods. Although recent advancements in deep learning have enabled tasks that were previously challenging, existing tractography approaches are often non-differentiable, limiting their integration in end-to-end learning frameworks. While progress has been made in representing streamlines in differentiable frameworks, no existing method offers fully differentiable propagation. In this work, we propose a fully differentiable solution that retains numerical fidelity with a leading streamline algorithm. The key is that our PyTorch-engineered streamline propagator has no components that block gradient flow, making it fully differentiable. We show that our method matches standard propagators while remaining differentiable. By translating streamline propagation into a differentiable PyTorch framework, we enable deeper integration of tractography into deep learning workflows, laying the foundation for a new category of macrostructural reasoning that is not only computationally robust but also scientifically rigorous.</p>","PeriodicalId":74505,"journal":{"name":"Proceedings of SPIE--the International Society for Optical Engineering","volume":"13925 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13245533/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148213597","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep learning‑based cell type prediction in lung tissue from brightfield histology using CODEX-derived labels. 利用codex衍生标签,基于深度学习的明场组织学肺组织细胞类型预测。
Proceedings of SPIE--the International Society for Optical Engineering Pub Date : 2026-01-01 Epub Date: 2026-04-02 DOI: 10.1117/12.3088120
Sumanth Devarasetty, Nicholas Lucarelli, Sayat Mimar, Sanjay Jain, Tarek M El-Achkar, Jeffrey Purkerson, Gloria Pryhuber, Pinaki Sarder
{"title":"Deep learning‑based cell type prediction in lung tissue from brightfield histology using CODEX-derived labels.","authors":"Sumanth Devarasetty, Nicholas Lucarelli, Sayat Mimar, Sanjay Jain, Tarek M El-Achkar, Jeffrey Purkerson, Gloria Pryhuber, Pinaki Sarder","doi":"10.1117/12.3088120","DOIUrl":"10.1117/12.3088120","url":null,"abstract":"<p><p>Identifying cell types present in lung biopsies can provide critical information on pathological processes, tissue organization, and organ health, and are valuable in both clinical and research settings. Knowledge of cell types, their distributions, and spatial relationships can assist pathologists and researchers in diagnosis, prognosis, and mechanistic investigations. Multiplex imaging technologies such as Phenocycler<sup>™</sup>, based on co-detection by indexing (CODEX) can provide whole-slide spatial maps of protein expression and can accurately identify cell types; however, CODEX shares limitations including high costs of antibodies and reagents, as well as labor-intensive conjugation and validation steps. In contrast, hematoxylin and eosin (H&E) staining is inexpensive and routinely available, offering the potential for scalable cell-type mapping if robust prediction can be achieved directly from histology. In this work, we develop a deep learning pipeline to automatically detect cell types in H&E-stained lung tissue sections by leveraging ground-truth annotations from paired CODEX images. The dataset comprises over 2.3 million labeled cells, segmented from lung tissue sections obtained from multiple donors, and grouped into five broad classes: epithelial, immune, endothelial, stromal, and contractile. We train a DeepLabV3+ semantic segmentation model with ResNet backbone on patches from these annotated slides and reserve a subset for testing. Our model achieved 51.3% balanced accuracy across five classes, which is ~2.5x the random-guessing baseline of 20%. This framework demonstrates the feasibility of approximating multiplexed imaging-based cell type maps from routine histology.</p>","PeriodicalId":74505,"journal":{"name":"Proceedings of SPIE--the International Society for Optical Engineering","volume":"13932 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13286254/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148310655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Machine learning assisted wavefront sensor. 机器学习辅助波前传感器。
Proceedings of SPIE--the International Society for Optical Engineering Pub Date : 2026-01-01 Epub Date: 2026-03-05 DOI: 10.1117/12.3084846
Conor McFadden, Bingying Chen, Reto Fiolka
{"title":"Machine learning assisted wavefront sensor.","authors":"Conor McFadden, Bingying Chen, Reto Fiolka","doi":"10.1117/12.3084846","DOIUrl":"10.1117/12.3084846","url":null,"abstract":"<p><p>Adaptive optics aims to restore diffraction limited resolution in an imaging system in the presence of optical aberrations. To this end, the wavefront error needs to be measured prior to its compensation. Traditional wavefront sensors typically measure the local gradient of the wavefront emitted from a guide star (or another known point source) using a microlens array in front of a camera. They are typically dedicated devices that need to be integrated into an imaging system. Here we have tested the concept of estimating the wavefront error directly from an image of a guide star by training a machine learning model. We produce a two-photon laser spot in a water fluorescein media, and introduce random, but known aberrations using a deformable mirror to form a large training set. After validation, we integrated the machine learning wavefront sensor in an AO feedback loop with the deformable mirror. We demonstrate proof of principle compensation of sample-introduced optical aberrations with this system.</p>","PeriodicalId":74505,"journal":{"name":"Proceedings of SPIE--the International Society for Optical Engineering","volume":"13860 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13234910/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148201571","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Analytic Bounds on GAMLSS Model Variability of Normative White Matter Brain Charts. 规范白质脑图GAMLSS模型变异性的解析界。
Proceedings of SPIE--the International Society for Optical Engineering Pub Date : 2026-01-01 Epub Date: 2026-04-02 DOI: 10.1117/12.3085643
Michael E Kim, Gaurav Rudravaram, Adam Saunders, Chenyu Gao, Karthik Ramadass, Nancy R Newlin, Praitayini Kanakaraj, Sam Bogdanov, Derek Archer, Timothy J Hohman, Angela L Jefferson, Victoria L Morgan, Alexandra Roche, Dario J Englot, Susan M Resnick, Lori L Beason Held, Murat Bilgel, Laurie E Cutting, Laura A Barquero, Micah A D'Archangel, Tin Q Nguyen, Kathryn L Humphreys, Yanbin Niu, Sophia Vinci-Booher, Carissa J Cascio, Kimberly R Pechman, Niranjana Shashikumar, Zhiyuan Li, Simon N Vandekar, Panpan Zhang, John C Gore, Yihao Liu, Lianrui Zuo, Kurt G Schilling, Daniel C Moyer, Bennett A Landman
{"title":"Analytic Bounds on GAMLSS Model Variability of Normative White Matter Brain Charts.","authors":"Michael E Kim, Gaurav Rudravaram, Adam Saunders, Chenyu Gao, Karthik Ramadass, Nancy R Newlin, Praitayini Kanakaraj, Sam Bogdanov, Derek Archer, Timothy J Hohman, Angela L Jefferson, Victoria L Morgan, Alexandra Roche, Dario J Englot, Susan M Resnick, Lori L Beason Held, Murat Bilgel, Laurie E Cutting, Laura A Barquero, Micah A D'Archangel, Tin Q Nguyen, Kathryn L Humphreys, Yanbin Niu, Sophia Vinci-Booher, Carissa J Cascio, Kimberly R Pechman, Niranjana Shashikumar, Zhiyuan Li, Simon N Vandekar, Panpan Zhang, John C Gore, Yihao Liu, Lianrui Zuo, Kurt G Schilling, Daniel C Moyer, Bennett A Landman","doi":"10.1117/12.3085643","DOIUrl":"10.1117/12.3085643","url":null,"abstract":"<p><p>Brain charts, or normative models of quantitative neuroimaging measures, can identify trajectories of brain development and abnormalities in groups and individuals by leveraging large populations. Recent work has extended these brain charts to model microstructural and macrostructural features of white matter. Assessments of variance for these brain charts are necessary to determine whether the models being used for these data are stable. We implement an analytic approach to characterize variability of the parameters in previously released brain charts created using the generalized additive models for location, scale, and shape (GAMLSS) framework. Additionally, we empirically validate the accuracy of each analytic model through a comparison to a bootstrapping approach from 0.2 to 90 years of age. We find that across all models, the analytic coefficient of variation (COV) remains below 5% for ages greater than 0.25 years, with the maximum empirical observed COV reaching 7% at 0.2 years of age. Further, the empirical assessment shows high agreement with the analytic assessment, with COV estimates averaged across the lifespan for all models having a Pearson correlation coefficient of 0.776 and a mean difference of 4 x 10<sup>-4</sup>. Both methods exhibit volume and surface area as the features with the largest average COV for the majority of tracts. However, the analytic assessment yields axial diffusivity as the feature most frequently having the smallest COV, whereas the corresponding feature for the empirical assessment is average length. These results suggest that the analytic approach overestimates model stability for WM brain charts when the COV is low and that the validation method is suitable for assessing whether GAMLSS models are unstable.</p>","PeriodicalId":74505,"journal":{"name":"Proceedings of SPIE--the International Society for Optical Engineering","volume":"13930 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13245483/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148213614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Extending Regression Without Truth to Integrate Ground-Truth Measurements for Evaluating Quantitative Imaging Methods with Patient Data. 扩展无真回归,整合地面真值测量,以评估定量成像方法与患者数据。
Proceedings of SPIE--the International Society for Optical Engineering Pub Date : 2026-01-01 Epub Date: 2026-04-02 DOI: 10.1117/12.3088141
Yan Liu, Abhinav K Jha
{"title":"Extending Regression Without Truth to Integrate Ground-Truth Measurements for Evaluating Quantitative Imaging Methods with Patient Data.","authors":"Yan Liu, Abhinav K Jha","doi":"10.1117/12.3088141","DOIUrl":"10.1117/12.3088141","url":null,"abstract":"<p><p>Objective evaluation of quantitative imaging (QI) methods with patient data is often hindered by the lack of gold standards. To address this challenge, a class of regression-without-truth (RWT) techniques have been developed. These techniques assume that the true and measured values are linearly related and estimate the linear-relationship parameters without access to true values. However, reliable estimation of these parameters typically requires many patient samples, which can be expensive and time consuming to obtain, and even impossible in settings such as studies with rare diseases or with new clinical imaging procedures. Thus, there is an important need for strategies to perform evaluation of quantitative imaging methods with a small number of patient samples. In this context, we note that datasets with known ground truth, such as physical phantom studies, could be available. In this manuscript, we propose an approach that integrates information from both patient data without ground truth and known-ground-truth datasets to perform objective evaluation of QI methods. We validated the proposed approach using numerical studies, which showed that the proposed approach yielded improved performance in ranking QI methods compared with RWT technique. The results demonstrate the potential of the proposed approach for evaluating QI methods when patient data are limited and motivate further validation with clinically realistic simulation studies and clinical data.</p>","PeriodicalId":74505,"journal":{"name":"Proceedings of SPIE--the International Society for Optical Engineering","volume":"13928 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13372251/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148458024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Modeling human observer performance with neural network observers in a forced localization task using undersampled MRI images. 在使用欠采样MRI图像的强制定位任务中,用神经网络观测者建模人类观测者的表现。
Proceedings of SPIE--the International Society for Optical Engineering Pub Date : 2026-01-01 Epub Date: 2026-04-02 DOI: 10.1117/12.3084847
Sandro Amaglobeli, Justine P Prasad, Craig K Abbey, Angel R Pineda
{"title":"Modeling human observer performance with neural network observers in a forced localization task using undersampled MRI images.","authors":"Sandro Amaglobeli, Justine P Prasad, Craig K Abbey, Angel R Pineda","doi":"10.1117/12.3084847","DOIUrl":"10.1117/12.3084847","url":null,"abstract":"<p><p>Modelling human performance in forced localization tasks is a challenge for model observers because of the many possible signal locations along with capturing human perception. This is particularly challenging when using anatomical images and needing generalization to out-of-distribution images such as in varying undersampling in magnetic resonance imaging (MRI). In this study, we modeled human forced localization (FL) performance using images with varied percentage of low frequencies fully collected in 5× MRI undersampling, ranging from 0% (aliasing) to 20% (blurring). We used a modified EfficientNet-B1 architecture trained to directly predict coordinates (FLNet) as well as using a biologically inspired V1Block, which incorporates Gabor filters to mimic early stages of human visual processing as a preprocessing to FLNet (V1FLNet). When trained on images with 20% of low frequencies collected, both neural networks surpassed average human performance but diverged from human-like performance on out-of-distribution data. Training on both 0% and 20% data, leading to interpolation in the generalization and more training data led to better results. Training on all the conditions resulted in the best results which also matched human performance and would lead to the same choice of which low k-space frequencies to collect as the human observer studies. The adaptive models, trained and evaluated across each of the seven conditions, performed better than the model trained on one condition but not as well as the model trained on all conditions. V1FLNet had similar performance as FLNet especially for the model that used all conditions for training.</p>","PeriodicalId":74505,"journal":{"name":"Proceedings of SPIE--the International Society for Optical Engineering","volume":"13928 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13383116/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148610969","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Combining optimal biomarkers and deep learning for multimodal presurgical prediction of incisional hernia. 结合最佳生物标志物和深度学习用于切口疝的多模式术前预测。
Proceedings of SPIE--the International Society for Optical Engineering Pub Date : 2026-01-01 Epub Date: 2026-04-01 DOI: 10.1117/12.3086832
Yubing Tong, Lipeng Xie, Ruben U Fernandez, Tiange Liu, Robyn B Broach, Drew A Torigian, John P Fischer, Jayaram K Udupa
{"title":"Combining optimal biomarkers and deep learning for multimodal presurgical prediction of incisional hernia.","authors":"Yubing Tong, Lipeng Xie, Ruben U Fernandez, Tiange Liu, Robyn B Broach, Drew A Torigian, John P Fischer, Jayaram K Udupa","doi":"10.1117/12.3086832","DOIUrl":"https://doi.org/10.1117/12.3086832","url":null,"abstract":"<p><p>Despite its significant clinical and economic burden, the underlying pathophysiology of incisional hernia (IH) remains poorly understood. Imaging-derived features have shown promise in differentiating patients with and without IH. Yet, earlier studies primarily relied on conventional statistical analyses or basic machine learning models applied to relatively small, matched case-control cohorts. In this study, we substantially strengthen and expand upon prior research by analyzing abdominopelvic CT images from a larger cohort of 420 patients (157 IH, 263 non-IH). We introduce a hybrid intelligence (HI) framework that integrates natural intelligence (NI) and artificial intelligence (AI). This approach enables the embedding of hand-crafted features into deep learning (DL) models for prediction, referred to as hybrid deep learning (h-DL). The OBM approach utilizes 34 clinically related parameters alongside 1,065 image-based features. The primary objective of this study is to develop an HI strategy that combines OBM's efficient feature selection with DL's predictive power for improved IH prediction. While the DL model alone outperformed OBM, hybrid models-particularly h-DL-achieved even higher accuracy. This versatile methodology is broadly applicable and can be readily adapted to other biomarker-driven clinical prediction tasks.</p>","PeriodicalId":74505,"journal":{"name":"Proceedings of SPIE--the International Society for Optical Engineering","volume":"13927 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13681200/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149240460","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Monocular absolute depth estimation from endoscopy via domain-invariant feature learning and latent consistency. 基于域不变特征学习和潜在一致性的内窥镜单目绝对深度估计。
Proceedings of SPIE--the International Society for Optical Engineering Pub Date : 2026-01-01 Epub Date: 2026-04-03 DOI: 10.1117/12.3086626
Hao Li, Daiwei Lu, Jesse d'Almeida, Dilara Isik, Ehsan Khodapanah Aghdam, Nick DiSanto, Ayberk Acar, Susheela Sharma, Jie Ying Wu, Robert J Webster, Ipek Oguz
{"title":"Monocular absolute depth estimation from endoscopy via domain-invariant feature learning and latent consistency.","authors":"Hao Li, Daiwei Lu, Jesse d'Almeida, Dilara Isik, Ehsan Khodapanah Aghdam, Nick DiSanto, Ayberk Acar, Susheela Sharma, Jie Ying Wu, Robert J Webster, Ipek Oguz","doi":"10.1117/12.3086626","DOIUrl":"10.1117/12.3086626","url":null,"abstract":"<p><p>Monocular depth estimation (MDE) is a critical task to guide autonomous medical robots. However, obtaining absolute (metric) depth from an endoscopy camera in surgical scenes is difficult, which limits supervised learning of depth on real endoscopic images. Current image-level unsupervised domain adaptation methods translate synthetic images with known depth maps into the style of real endoscopic frames and train depth networks using these translated images with their corresponding depth maps. However a domain gap often remains between real and translated synthetic images. In this paper, we present a latent feature alignment method to improve absolute depth estimation by reducing this domain gap in the context of endoscopic videos of the central airway. Our methods are agnostic to the image translation process and focus on the depth estimation itself. Specifically, the depth network takes translated synthetic and real endoscopic frames as input and learns latent domain-invariant features via adversarial learning and directional feature consistency. The evaluation is conducted on endoscopic videos of central airway phantoms with manually aligned absolute depth maps. Compared to state-of-the-art MDE methods, our approach achieves superior performance on both absolute and relative depth metrics, and consistently improves results across various backbones and pretrained weights. Our code is available at https://github.com/MedICL-VU/MDE.</p>","PeriodicalId":74505,"journal":{"name":"Proceedings of SPIE--the International Society for Optical Engineering","volume":"13925 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13441291/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148681262","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Combined excitation scan-based hyperspectral imaging and digital deconvolution for the assessment of the kinetic and spatial distributions of cAMP signals. 基于激励扫描的高光谱成像与数字反褶积相结合,用于评估cAMP信号的动力学和空间分布。
Proceedings of SPIE--the International Society for Optical Engineering Pub Date : 2026-01-01 Epub Date: 2026-03-04 DOI: 10.1117/12.3081819
Naga Annamdevula, Rebecca Tang-Holmes, Robert Ledoux, Taylor Jackson, Anna-Kate Driver, Eliott Franklin, Andrea Britain, Thomas C Rich, Silas J Leavesley
{"title":"Combined excitation scan-based hyperspectral imaging and digital deconvolution for the assessment of the kinetic and spatial distributions of cAMP signals.","authors":"Naga Annamdevula, Rebecca Tang-Holmes, Robert Ledoux, Taylor Jackson, Anna-Kate Driver, Eliott Franklin, Andrea Britain, Thomas C Rich, Silas J Leavesley","doi":"10.1117/12.3081819","DOIUrl":"10.1117/12.3081819","url":null,"abstract":"<p><p>The cAMP signaling system coordinates a plethora of cellular responses, including contraction, movement, excitability, gene transcription and translation, and Ca<sup>2+</sup> handling. However, the mechanisms by which cAMP signals differentially regulate specific physiological responses remain elusive. Recent studies from a variety of groups provide compelling evidence that the subcellular location of cAMP signals contributes to signal specificity. Our previous work using a spectral Nikon A1R confocal microscope system highlights the need to consider cAMP signals in three spatial distributions (x,y,z). However, this and other commercially available microscope systems lack sufficient sensitivity and speed to track the kinetics of cAMP signals in four dimensions (4D: x,y,z,t). Here, we propose a combination of excitation scan-based hyperspectral imaging and digital deconvolution approaches to overcome this limitation. Imaging was performed using a custom excitation-scanning hyperspectral microscope based upon an Eclipse Ti2 microscope platform (Nikon Instruments), Titan 300 Xenon arc lamp (Sunoptics), VersaChrome thin-film tunable filters (Semrock Inc.) in a VF-5 tiltable filter wheel (Sutter Instruments), and a Prime 95B sCMOS camera (Photometrics). HEK293 and LNCaP cells were transfected with caDDis cAMP probes (Montana Molecular), and subsequently labeled with MitoTracker and/or NucBlue. Cells were imaged at excitation wavelengths ranging from 360 to 525 nm in 5 nm increments and emission was detected using a 532 nm long pass dichroic filter (Semrock Inc.). Hyperspectral image stacks were acquired at 250-500 nm axial increments (z-stacks). NIS Elements analysis software was used to deconvolve image data at each acquisition wavelength. The contributions from each fluorophore were then assessed using nonnegative linear unmixing. Preliminary results indicate that digital deconvolution of hyperspectral image stacks offers an effective approach to assess the spatial distributions of multiple fluorophores including cAMP probes in 5D (x, y, z, λ, and t). This work was supported by the University of South Alabama Center for Lung Biology, NIH R01HL169522 and S10OD028606, and NSF DBI-2408000.</p>","PeriodicalId":74505,"journal":{"name":"Proceedings of SPIE--the International Society for Optical Engineering","volume":"13857 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13098491/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147791647","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书