Is Overlain Display a Right Choice for AR Navigation? A Qualitative Study of Head-Mounted Augmented Reality Surgical Navigation on Accuracy for Large-Scale Clinical Deployment

IF 4.8 1区医学 Q1 NEUROSCIENCES

CNS Neuroscience & Therapeutics Pub Date : 2025-01-16 DOI:10.1111/cns.70217

Jian Ye, Qingwen Chen, Tao Zhong, Jian Liu, Han Gao

{"title":"Is Overlain Display a Right Choice for AR Navigation? A Qualitative Study of Head-Mounted Augmented Reality Surgical Navigation on Accuracy for Large-Scale Clinical Deployment","authors":"Jian Ye, Qingwen Chen, Tao Zhong, Jian Liu, Han Gao","doi":"10.1111/cns.70217","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>During the course of the past two decades, head-mounted augmented reality surgical navigation (HMARSN) systems have been increasingly employed in a variety of surgical specialties as a result of both advancements in augmented reality–related technologies and surgeons' desires to overcome some drawbacks inherent to conventional surgical navigation systems. In the present time, most experimental HMARSN systems adopt overlain display (OD) that overlay virtual models and planned routes of surgical tools on corresponding physical tissues, organs, lesions, and so forth, in a surgical field so as to provide surgeons with an intuitive and direct view to gain better hand–eye coordination as well as avoid attention shift and loss of sight (LOS), among other benefits during procedures. Yet, its system accuracy, which is the most crucial performance indicator of any surgical navigation system, is difficult to ascertain because it is highly subjective and user-dependent. Therefore, the aim of this study was to review presently available experimental OD HMARSN systems qualitatively, explore how their system accuracy is affected by overlain display, and find out if such systems are suited to large-scale clinical deployment.</p>\n </section>\n \n <section>\n \n <h3> Method</h3>\n \n <p>We searched PubMed and ScienceDirect with the following terms: head mounted augmented reality surgical navigation, and 445 records were returned in total. After screening and eligibility assessment, 60 papers were finally analyzed. Specifically, we focused on how their accuracies were defined and measured, as well as whether such accuracies are stable in clinical practice and competitive with corresponding commercially available systems.</p>\n </section>\n \n <section>\n \n <h3> Results and Conclusions</h3>\n \n <p>The primary findings are that the system accuracy of OD HMARSN systems is seriously affected by a transformation between the spaces of the user's eyes and the surgical field, because measurement of the transformation is heavily individualized and user-dependent. Additionally, the transformation itself is potentially subject to changes during surgical procedures, and hence unstable. Therefore, OD HMARSN systems are not suitable for large-scale clinical deployment.</p>\n </section>\n </div>","PeriodicalId":154,"journal":{"name":"CNS Neuroscience & Therapeutics","volume":"31 1","pages":""},"PeriodicalIF":4.8000,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11736426/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"CNS Neuroscience & Therapeutics","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/cns.70217","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NEUROSCIENCES","Score":null,"Total":0}

引用次数: 0

Abstract

Background

During the course of the past two decades, head-mounted augmented reality surgical navigation (HMARSN) systems have been increasingly employed in a variety of surgical specialties as a result of both advancements in augmented reality–related technologies and surgeons' desires to overcome some drawbacks inherent to conventional surgical navigation systems. In the present time, most experimental HMARSN systems adopt overlain display (OD) that overlay virtual models and planned routes of surgical tools on corresponding physical tissues, organs, lesions, and so forth, in a surgical field so as to provide surgeons with an intuitive and direct view to gain better hand–eye coordination as well as avoid attention shift and loss of sight (LOS), among other benefits during procedures. Yet, its system accuracy, which is the most crucial performance indicator of any surgical navigation system, is difficult to ascertain because it is highly subjective and user-dependent. Therefore, the aim of this study was to review presently available experimental OD HMARSN systems qualitatively, explore how their system accuracy is affected by overlain display, and find out if such systems are suited to large-scale clinical deployment.

Method

We searched PubMed and ScienceDirect with the following terms: head mounted augmented reality surgical navigation, and 445 records were returned in total. After screening and eligibility assessment, 60 papers were finally analyzed. Specifically, we focused on how their accuracies were defined and measured, as well as whether such accuracies are stable in clinical practice and competitive with corresponding commercially available systems.

Results and Conclusions

The primary findings are that the system accuracy of OD HMARSN systems is seriously affected by a transformation between the spaces of the user's eyes and the surgical field, because measurement of the transformation is heavily individualized and user-dependent. Additionally, the transformation itself is potentially subject to changes during surgical procedures, and hence unstable. Therefore, OD HMARSN systems are not suitable for large-scale clinical deployment.

Abstract Image

查看原文本刊更多论文

重叠显示是AR导航的正确选择吗？头戴式增强现实手术导航对大规模临床部署准确性的定性研究。

背景：在过去的二十年中，由于增强现实相关技术的进步和外科医生希望克服传统手术导航系统固有的一些缺点，头戴式增强现实手术导航（HMARSN）系统越来越多地应用于各种外科专业。目前，大多数实验HMARSN系统采用重叠显示（overain display， OD），将手术工具的虚拟模型和规划路线叠加在手术区域内相应的物理组织、器官、病变等上，为外科医生提供直观、直接的观察，以获得更好的手眼协调，避免手术过程中的注意力转移和视力丧失等好处。然而，它的系统精度是任何手术导航系统最重要的性能指标，很难确定，因为它是高度主观和用户依赖的。因此，本研究的目的是定性地回顾目前可用的实验OD HMARSN系统，探讨重叠显示如何影响其系统精度，并找出这些系统是否适合大规模临床部署。方法：用头戴式增强现实外科导航检索PubMed和ScienceDirect，共检索到445条记录。经过筛选和合格性评估，最终对60篇论文进行分析。具体来说，我们关注的是如何定义和测量它们的准确性，以及这种准确性在临床实践中是否稳定，是否与相应的商业可用系统具有竞争力。结果和结论：主要发现OD HMARSN系统的系统精度受到用户眼睛空间和手术视野之间转换的严重影响，因为转换的测量是高度个性化和用户依赖的。此外，在手术过程中，变形本身可能会发生变化，因此不稳定。因此，OD HMARSN系统不适合大规模临床部署。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

CNS Neuroscience & Therapeutics 医学-神经科学

CiteScore

7.30

自引率

12.70%

发文量

240

审稿时长

2 months

期刊介绍： CNS Neuroscience & Therapeutics provides a medium for rapid publication of original clinical, experimental, and translational research papers, timely reviews and reports of novel findings of therapeutic relevance to the central nervous system, as well as papers related to clinical pharmacology, drug development and novel methodologies for drug evaluation. The journal focuses on neurological and psychiatric diseases such as stroke, Parkinson’s disease, Alzheimer’s disease, depression, schizophrenia, epilepsy, and drug abuse.