Augmented reality headsets for surgical guidance: the impact of holographic model positions on user localisation accuracy

IF 4.4 3区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Laura Pérez-Pachón, Parivrudh Sharma, Helena Brech, Jenny Gregory, Terry Lowe, Matthieu Poyade, Flora Gröning
{"title":"Augmented reality headsets for surgical guidance: the impact of holographic model positions on user localisation accuracy","authors":"Laura Pérez-Pachón, Parivrudh Sharma, Helena Brech, Jenny Gregory, Terry Lowe, Matthieu Poyade, Flora Gröning","doi":"10.1007/s10055-024-00960-x","DOIUrl":null,"url":null,"abstract":"<p>Novel augmented reality headsets such as HoloLens can be used to overlay patient-specific virtual models of resection margins on the patient’s skin, providing surgeons with information not normally available in the operating room. For this to be useful, surgeons wearing the headset must be able to localise virtual models accurately. We measured the error with which users localise virtual models at different positions and distances from their eyes. Healthy volunteers aged 20–59 years (<i>n</i> = 54) performed 81 exercises involving the localisation of a virtual hexagon’s vertices overlaid on a monitor surface. Nine predefined positions and three distances between the virtual hexagon and the users’ eyes (65, 85 and 105 cm) were set. We found that, some model positions and the shortest distance (65 cm) led to larger localisation errors than other positions and larger distances (85 and 105 cm). Positional errors of more than 5 mm and 1–5 mm margin errors were found in 29.8% and over 40% of cases, respectively. Strong outliers were also found (e.g. margin shrinkage of up to 17.4 mm in 4.3% of cases). The measured errors may result in poor outcomes of surgeries: e.g. incomplete tumour excision or inaccurate flap design, which can potentially lead to tumour recurrence and flap failure, respectively. Reducing localisation errors associated with arm reach distances between the virtual models and users’ eyes is necessary for augmented reality headsets to be suitable for surgical purposes. In addition, training surgeons on the use of these headsets may help to minimise localisation errors.</p>","PeriodicalId":23727,"journal":{"name":"Virtual Reality","volume":null,"pages":null},"PeriodicalIF":4.4000,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Virtual Reality","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s10055-024-00960-x","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

Novel augmented reality headsets such as HoloLens can be used to overlay patient-specific virtual models of resection margins on the patient’s skin, providing surgeons with information not normally available in the operating room. For this to be useful, surgeons wearing the headset must be able to localise virtual models accurately. We measured the error with which users localise virtual models at different positions and distances from their eyes. Healthy volunteers aged 20–59 years (n = 54) performed 81 exercises involving the localisation of a virtual hexagon’s vertices overlaid on a monitor surface. Nine predefined positions and three distances between the virtual hexagon and the users’ eyes (65, 85 and 105 cm) were set. We found that, some model positions and the shortest distance (65 cm) led to larger localisation errors than other positions and larger distances (85 and 105 cm). Positional errors of more than 5 mm and 1–5 mm margin errors were found in 29.8% and over 40% of cases, respectively. Strong outliers were also found (e.g. margin shrinkage of up to 17.4 mm in 4.3% of cases). The measured errors may result in poor outcomes of surgeries: e.g. incomplete tumour excision or inaccurate flap design, which can potentially lead to tumour recurrence and flap failure, respectively. Reducing localisation errors associated with arm reach distances between the virtual models and users’ eyes is necessary for augmented reality headsets to be suitable for surgical purposes. In addition, training surgeons on the use of these headsets may help to minimise localisation errors.

Abstract Image

用于手术引导的增强现实头戴设备:全息模型位置对用户定位精度的影响
HoloLens 等新型增强现实头显可用于在患者皮肤上叠加特定于患者的切除边缘虚拟模型,为外科医生提供通常在手术室无法获得的信息。要使其发挥作用,佩戴头显的外科医生必须能够准确定位虚拟模型。我们测量了用户在距离眼睛不同位置和距离时定位虚拟模型的误差。年龄在 20-59 岁之间的健康志愿者(n = 54)进行了 81 次练习,涉及对显示器表面上叠加的虚拟六边形顶点进行定位。在虚拟六边形与用户眼睛之间设置了九个预定义位置和三个距离(65、85 和 105 厘米)。我们发现,与其他位置和较大距离(85 厘米和 105 厘米)相比,一些模型位置和最短距离(65 厘米)导致的定位误差更大。位置误差超过 5 毫米和边缘误差超过 1-5 毫米的情况分别占 29.8%和 40%以上。此外,还发现了强烈的异常值(例如,4.3%的病例边缘收缩达 17.4 毫米)。测量误差可能导致手术效果不佳:如肿瘤切除不彻底或皮瓣设计不准确,这可能分别导致肿瘤复发和皮瓣失败。要使增强现实头显适用于外科手术,就必须减少与虚拟模型和用户眼睛之间的手臂触及距离有关的定位误差。此外,培训外科医生使用这些头显可能有助于最大限度地减少定位误差。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Virtual Reality
Virtual Reality COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS-COMPUTER SCIENCE, SOFTWARE ENGINEERING
CiteScore
8.30
自引率
14.30%
发文量
95
审稿时长
>12 weeks
期刊介绍: The journal, established in 1995, publishes original research in Virtual Reality, Augmented and Mixed Reality that shapes and informs the community. The multidisciplinary nature of the field means that submissions are welcomed on a wide range of topics including, but not limited to: Original research studies of Virtual Reality, Augmented Reality, Mixed Reality and real-time visualization applications Development and evaluation of systems, tools, techniques and software that advance the field, including: Display technologies, including Head Mounted Displays, simulators and immersive displays Haptic technologies, including novel devices, interaction and rendering Interaction management, including gesture control, eye gaze, biosensors and wearables Tracking technologies VR/AR/MR in medicine, including training, surgical simulation, rehabilitation, and tissue/organ modelling. Impactful and original applications and studies of VR/AR/MR’s utility in areas such as manufacturing, business, telecommunications, arts, education, design, entertainment and defence Research demonstrating new techniques and approaches to designing, building and evaluating virtual and augmented reality systems Original research studies assessing the social, ethical, data or legal aspects of VR/AR/MR.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信