Jiong Zhang , Shuai Yu , Yonghuai Liu , Dan Zhang , Jianyang Xie , Tao Chen , Yalin Zheng , Huazhu Fu , Yitian Zhao
{"title":"3D microvascular reconstruction in retinal OCT angiography images via domain-adaptive learning","authors":"Jiong Zhang , Shuai Yu , Yonghuai Liu , Dan Zhang , Jianyang Xie , Tao Chen , Yalin Zheng , Huazhu Fu , Yitian Zhao","doi":"10.1016/j.patcog.2025.111494","DOIUrl":null,"url":null,"abstract":"<div><div>Optical Coherence Tomography Angiography (OCTA) is a non-invasive imaging technique that enables the acquisition of 3D depth-resolved information with micrometer resolution, facilitating the diagnosis of various eye-related diseases. In OCTA-based image analysis, 2D <em>en face</em> projected images are commonly used for quantifying microvascular changes, while the 3D images with rich depth information remains largely unexplored. This is mainly due to that direct 3D vessel reconstruction faces several challenges, including projection artifacts, complex vessel topology, and high computational cost. These limitations hinder comprehensive microvascular analysis and may obscure potentially vital 3D vessel biomarkers. In this study, we propose a novel method for 3D reconstruction of retinal microvasculature using 2D <em>en face</em> images. Our approach capitalizes on a elaborately generated 2D OCTA depth map for vessel reconstruction, thus eliminating the need for unavailable 3D volumetric data in certain retinal imaging devices. More specifically, we first build a structure-guided depth prediction network which incorporates a domain adaptation module to evaluate the depth maps obtained from different OCTA imaging devices. A point-cloud-to-surface reconstruction method is then utilized to reconstruct the corresponding 3D retinal vessels, based on the predicted depth maps and 2D vascular information. Experimental results demonstrate the superior performance of our method in comparison to existing state-of-the-art techniques. Furthermore, we extract 3D vessel-related features to assess disease correlation and classification, effectively evaluating the potential of our method for guiding subsequent clinical analysis. The results show promise of exploring 3D microvascular analysis for early diagnosis of various eye-related diseases.</div></div>","PeriodicalId":49713,"journal":{"name":"Pattern Recognition","volume":"165 ","pages":"Article 111494"},"PeriodicalIF":7.5000,"publicationDate":"2025-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Recognition","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0031320325001542","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Optical Coherence Tomography Angiography (OCTA) is a non-invasive imaging technique that enables the acquisition of 3D depth-resolved information with micrometer resolution, facilitating the diagnosis of various eye-related diseases. In OCTA-based image analysis, 2D en face projected images are commonly used for quantifying microvascular changes, while the 3D images with rich depth information remains largely unexplored. This is mainly due to that direct 3D vessel reconstruction faces several challenges, including projection artifacts, complex vessel topology, and high computational cost. These limitations hinder comprehensive microvascular analysis and may obscure potentially vital 3D vessel biomarkers. In this study, we propose a novel method for 3D reconstruction of retinal microvasculature using 2D en face images. Our approach capitalizes on a elaborately generated 2D OCTA depth map for vessel reconstruction, thus eliminating the need for unavailable 3D volumetric data in certain retinal imaging devices. More specifically, we first build a structure-guided depth prediction network which incorporates a domain adaptation module to evaluate the depth maps obtained from different OCTA imaging devices. A point-cloud-to-surface reconstruction method is then utilized to reconstruct the corresponding 3D retinal vessels, based on the predicted depth maps and 2D vascular information. Experimental results demonstrate the superior performance of our method in comparison to existing state-of-the-art techniques. Furthermore, we extract 3D vessel-related features to assess disease correlation and classification, effectively evaluating the potential of our method for guiding subsequent clinical analysis. The results show promise of exploring 3D microvascular analysis for early diagnosis of various eye-related diseases.
期刊介绍:
The field of Pattern Recognition is both mature and rapidly evolving, playing a crucial role in various related fields such as computer vision, image processing, text analysis, and neural networks. It closely intersects with machine learning and is being applied in emerging areas like biometrics, bioinformatics, multimedia data analysis, and data science. The journal Pattern Recognition, established half a century ago during the early days of computer science, has since grown significantly in scope and influence.