Context-Aware Real-Time Semantic View Expansion of Intraoperative 4D OCT

Michael Sommersperger;Philipp Matten;Tony Wang;Shervin Dehghani;Jonas Nienhaus;Hessam Roodaki;Wolfgang Drexler;Rainer A. Leitgeb;Tilman Schmoll;Nassir Navab
{"title":"Context-Aware Real-Time Semantic View Expansion of Intraoperative 4D OCT","authors":"Michael Sommersperger;Philipp Matten;Tony Wang;Shervin Dehghani;Jonas Nienhaus;Hessam Roodaki;Wolfgang Drexler;Rainer A. Leitgeb;Tilman Schmoll;Nassir Navab","doi":"10.1109/TMI.2025.3528742","DOIUrl":null,"url":null,"abstract":"Four-dimensional microscope-integrated optical coherence tomography enables volumetric imaging of tissue structures and tool-tissue interactions in ophthalmic surgery at interactive update rates. This enables surgeons to undertake particular surgical steps under four-dimensional optical coherence tomography (4D OCT) guidance. However, current 4D OCT systems are limited by their field of view and signal quality. Both are attributable to the emphasis on high volume acquisition rates, which is critical for smooth visual perception by the surgeon. Existing 3D volume mosaicing methods are developed in the context of diagnostic imaging and do not take dynamic surgical interactions and real-time processing into account. In this paper, we propose a novel volume mosaicing and visualization methodology that not only aims at leveraging the temporal information to overcome some of the current limitations and imaging artifacts of 4D OCT, but also is aware of the surgical context and dynamic instrument motion implicitly during registration and explicitly for visualization. We propose a rapid 4-degrees of freedom volume registration, integrating an innovative approach for volume mosaicing that takes temporal recency and semantic information into account for enhanced surgical visualization. Our experiments on 4D OCT datasets demonstrate high registration accuracy and illustrate the benefits for visualization by reducing imaging artifacts and dynamically expanding the surgical view.","PeriodicalId":94033,"journal":{"name":"IEEE transactions on medical imaging","volume":"44 5","pages":"2256-2269"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10838602","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on medical imaging","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10838602/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Four-dimensional microscope-integrated optical coherence tomography enables volumetric imaging of tissue structures and tool-tissue interactions in ophthalmic surgery at interactive update rates. This enables surgeons to undertake particular surgical steps under four-dimensional optical coherence tomography (4D OCT) guidance. However, current 4D OCT systems are limited by their field of view and signal quality. Both are attributable to the emphasis on high volume acquisition rates, which is critical for smooth visual perception by the surgeon. Existing 3D volume mosaicing methods are developed in the context of diagnostic imaging and do not take dynamic surgical interactions and real-time processing into account. In this paper, we propose a novel volume mosaicing and visualization methodology that not only aims at leveraging the temporal information to overcome some of the current limitations and imaging artifacts of 4D OCT, but also is aware of the surgical context and dynamic instrument motion implicitly during registration and explicitly for visualization. We propose a rapid 4-degrees of freedom volume registration, integrating an innovative approach for volume mosaicing that takes temporal recency and semantic information into account for enhanced surgical visualization. Our experiments on 4D OCT datasets demonstrate high registration accuracy and illustrate the benefits for visualization by reducing imaging artifacts and dynamically expanding the surgical view.
术中4D OCT上下文感知实时语义视图扩展
四维显微镜集成光学相干断层扫描使组织结构的体积成像和工具-组织的相互作用在眼科手术在交互更新率。这使得外科医生能够在四维光学相干断层扫描(4D OCT)的指导下进行特定的手术步骤。然而,目前的四维OCT系统受到视场和信号质量的限制。两者都归因于强调高体积获取率,这对外科医生的平滑视觉感知至关重要。现有的三维体积拼接方法是在诊断成像的背景下发展起来的,没有考虑到动态的手术相互作用和实时处理。在本文中,我们提出了一种新的体积拼接和可视化方法,该方法不仅旨在利用时间信息来克服当前四维OCT的一些限制和成像伪影,而且还可以在配准过程中隐式地了解手术背景和动态仪器运动,并明确地进行可视化。我们提出了一种快速的4自由度体配准,集成了一种创新的体拼接方法,该方法将时间近时性和语义信息考虑在内,以增强手术可视化。我们在4D OCT数据集上的实验证明了高配准精度,并通过减少成像伪影和动态扩展手术视图来说明可视化的好处。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信