Fusion and visualization of intraoperative cortical images with preoperative models for epilepsy surgical planning and guidance.

Q Medicine
Computer Aided Surgery Pub Date : 2011-01-01 Epub Date: 2011-06-13 DOI:10.3109/10929088.2011.585805
A Wang, S M Mirsattari, A G Parrent, T M Peters
{"title":"Fusion and visualization of intraoperative cortical images with preoperative models for epilepsy surgical planning and guidance.","authors":"A Wang,&nbsp;S M Mirsattari,&nbsp;A G Parrent,&nbsp;T M Peters","doi":"10.3109/10929088.2011.585805","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>During epilepsy surgery it is important for the surgeon to correlate the preoperative cortical morphology (from preoperative images) with the intraoperative environment. Augmented Reality (AR) provides a solution for combining the real environment with virtual models. However, AR usually requires the use of specialized displays, and its effectiveness in the surgery still needs to be evaluated. The objective of this research was to develop an alternative approach to provide enhanced visualization by fusing a direct (photographic) view of the surgical field with the 3D patient model during image guided epilepsy surgery.</p><p><strong>Materials and methods: </strong>We correlated the preoperative plan with the intraoperative surgical scene, first by a manual landmark-based registration and then by an intensity-based perspective 3D-2D registration for camera pose estimation. The 2D photographic image was then texture-mapped onto the 3D preoperative model using the solved camera pose. In the proposed method, we employ direct volume rendering to obtain a perspective view of the brain image using GPU-accelerated ray-casting. The algorithm was validated by a phantom study and also in the clinical environment with a neuronavigation system.</p><p><strong>Results: </strong>In the phantom experiment, the 3D Mean Registration Error (MRE) was 2.43 ± 0.32 mm with a success rate of 100%. In the clinical experiment, the 3D MRE was 5.15 ± 0.49 mm with 2D in-plane error of 3.30 ± 1.41 mm. A clinical application of our fusion method for enhanced and augmented visualization for integrated image and functional guidance during neurosurgery is also presented.</p><p><strong>Conclusions: </strong>This paper presents an alternative approach to a sophisticated AR environment for assisting in epilepsy surgery, whereby a real intraoperative scene is mapped onto the surface model of the brain. In contrast to the AR approach, this method needs no specialized display equipment. Moreover, it requires minimal changes to existing systems and workflow, and is therefore well suited to the OR environment. In the phantom and in vivo clinical experiments, we demonstrate that the fusion method can achieve a level of accuracy sufficient for the requirements of epilepsy surgery.</p>","PeriodicalId":50644,"journal":{"name":"Computer Aided Surgery","volume":"16 4","pages":"149-60"},"PeriodicalIF":0.0000,"publicationDate":"2011-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.3109/10929088.2011.585805","citationCount":"18","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Aided Surgery","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3109/10929088.2011.585805","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2011/6/13 0:00:00","PubModel":"Epub","JCR":"Q","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 18

Abstract

Objective: During epilepsy surgery it is important for the surgeon to correlate the preoperative cortical morphology (from preoperative images) with the intraoperative environment. Augmented Reality (AR) provides a solution for combining the real environment with virtual models. However, AR usually requires the use of specialized displays, and its effectiveness in the surgery still needs to be evaluated. The objective of this research was to develop an alternative approach to provide enhanced visualization by fusing a direct (photographic) view of the surgical field with the 3D patient model during image guided epilepsy surgery.

Materials and methods: We correlated the preoperative plan with the intraoperative surgical scene, first by a manual landmark-based registration and then by an intensity-based perspective 3D-2D registration for camera pose estimation. The 2D photographic image was then texture-mapped onto the 3D preoperative model using the solved camera pose. In the proposed method, we employ direct volume rendering to obtain a perspective view of the brain image using GPU-accelerated ray-casting. The algorithm was validated by a phantom study and also in the clinical environment with a neuronavigation system.

Results: In the phantom experiment, the 3D Mean Registration Error (MRE) was 2.43 ± 0.32 mm with a success rate of 100%. In the clinical experiment, the 3D MRE was 5.15 ± 0.49 mm with 2D in-plane error of 3.30 ± 1.41 mm. A clinical application of our fusion method for enhanced and augmented visualization for integrated image and functional guidance during neurosurgery is also presented.

Conclusions: This paper presents an alternative approach to a sophisticated AR environment for assisting in epilepsy surgery, whereby a real intraoperative scene is mapped onto the surface model of the brain. In contrast to the AR approach, this method needs no specialized display equipment. Moreover, it requires minimal changes to existing systems and workflow, and is therefore well suited to the OR environment. In the phantom and in vivo clinical experiments, we demonstrate that the fusion method can achieve a level of accuracy sufficient for the requirements of epilepsy surgery.

术中皮质图像与术前模型的融合和可视化对癫痫手术计划和指导。
目的:在癫痫手术中,外科医生将术前皮层形态(从术前图像)与术中环境相关联是很重要的。增强现实(AR)提供了一种将真实环境与虚拟模型相结合的解决方案。然而,增强现实通常需要使用专门的显示器,其在手术中的有效性仍有待评估。本研究的目的是开发一种替代方法,通过在图像引导癫痫手术中融合手术视野的直接(摄影)视图与3D患者模型来提供增强的可视化。材料和方法:我们将术前计划与术中手术场景相关联,首先通过基于手动地标的配准,然后通过基于强度的透视3D-2D配准进行相机姿势估计。然后将二维摄影图像使用解出的相机位姿纹理映射到三维术前模型上。在提出的方法中,我们使用gpu加速的光线投射,采用直接体绘制来获得大脑图像的透视视图。该算法已通过幻影研究和神经导航系统在临床环境中得到验证。结果:在幻像实验中,三维平均配准误差(MRE)为2.43±0.32 mm,成功率为100%。临床实验中,三维磁共振成像(MRE)为5.15±0.49 mm,二维平面内误差为3.30±1.41 mm。我们的融合方法的临床应用,增强和增强可视化集成图像和功能指导在神经外科。结论:本文提出了一种辅助癫痫手术的复杂AR环境的替代方法,即将真实的术中场景映射到大脑表面模型上。与增强现实方法相比,这种方法不需要专门的显示设备。此外,它需要对现有系统和工作流程进行最小的更改,因此非常适合OR环境。在幻影和体内临床实验中,我们证明融合方法可以达到足以满足癫痫手术要求的精度水平。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computer Aided Surgery
Computer Aided Surgery 医学-外科
CiteScore
0.75
自引率
0.00%
发文量
0
审稿时长
>12 weeks
期刊介绍: The scope of Computer Aided Surgery encompasses all fields within surgery, as well as biomedical imaging and instrumentation, and digital technology employed as an adjunct to imaging in diagnosis, therapeutics, and surgery. Topics featured include frameless as well as conventional stereotaxic procedures, surgery guided by ultrasound, image guided focal irradiation, robotic surgery, and other therapeutic interventions that are performed with the use of digital imaging technology.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信