Bronchoscopy using a head-mounted mixed reality device—a phantom study and a first in-patient user experience

IF 3.2 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING
Arne Kildahl-Andersen, E. F. Hofstad, Hanne Sorger, T. Amundsen, T. Langø, H. O. Leira, G. Kiss
{"title":"Bronchoscopy using a head-mounted mixed reality device—a phantom study and a first in-patient user experience","authors":"Arne Kildahl-Andersen, E. F. Hofstad, Hanne Sorger, T. Amundsen, T. Langø, H. O. Leira, G. Kiss","doi":"10.3389/frvir.2023.940536","DOIUrl":null,"url":null,"abstract":"Background: Bronchoscopy for peripheral lung lesions may involve image sources such as computed tomography (CT), fluoroscopy, radial endobronchial ultrasound (R-EBUS), and virtual/electromagnetic navigation bronchoscopy. Our objective was to evaluate the feasibility of replacing these multiple monitors with a head-mounted display (HMD), always providing relevant image data in the line of sight of the bronchoscopist. Methods: A total of 17 pulmonologists wearing a HMD (Microsoft® HoloLens 2) performed bronchoscopy with electromagnetic navigation in a lung phantom. The bronchoscopists first conducted an endobronchial inspection and navigation to the target, followed by an endobronchial ultrasound bronchoscopy. The HMD experience was evaluated using a questionnaire. Finally, the HMD was used in bronchoscopy inspection and electromagnetic navigation of two patients presenting with hemoptysis. Results: In the phantom study, the perceived quality of video and ultrasound images was assessed using a visual analog scale, with 100% representing optimal image quality. The score for video quality was 58% (95% confidence interval [CI] 48%–68%) and for ultrasound image quality, the score was 43% (95% CI 30%–56%). Contrast, color rendering, and resolution were all considered suboptimal. Despite adjusting the brightness settings, video image rendering was considered too dark. Navigation to the target for biopsy sampling was accomplished by all participants, with no significant difference in procedure time between experienced and less experienced bronchoscopists. The overall system latency for the image stream was 0.33–0.35 s. Fifteen of the pulmonologists would consider using HoloLens for navigation in the periphery, and two would not consider using HoloLens in bronchoscopy at all. In the human study, bronchoscopy inspection was feasible for both patients. Conclusion: Bronchoscopy using an HMD was feasible in a lung phantom and in two patients. Video and ultrasound image quality was considered inferior to that of video monitors. HoloLens 2 was suboptimal for airway and mucosa inspection but may be adequate for virtual bronchoscopy navigation.","PeriodicalId":73116,"journal":{"name":"Frontiers in virtual reality","volume":" ","pages":""},"PeriodicalIF":3.2000,"publicationDate":"2023-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in virtual reality","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/frvir.2023.940536","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
引用次数: 1

Abstract

Background: Bronchoscopy for peripheral lung lesions may involve image sources such as computed tomography (CT), fluoroscopy, radial endobronchial ultrasound (R-EBUS), and virtual/electromagnetic navigation bronchoscopy. Our objective was to evaluate the feasibility of replacing these multiple monitors with a head-mounted display (HMD), always providing relevant image data in the line of sight of the bronchoscopist. Methods: A total of 17 pulmonologists wearing a HMD (Microsoft® HoloLens 2) performed bronchoscopy with electromagnetic navigation in a lung phantom. The bronchoscopists first conducted an endobronchial inspection and navigation to the target, followed by an endobronchial ultrasound bronchoscopy. The HMD experience was evaluated using a questionnaire. Finally, the HMD was used in bronchoscopy inspection and electromagnetic navigation of two patients presenting with hemoptysis. Results: In the phantom study, the perceived quality of video and ultrasound images was assessed using a visual analog scale, with 100% representing optimal image quality. The score for video quality was 58% (95% confidence interval [CI] 48%–68%) and for ultrasound image quality, the score was 43% (95% CI 30%–56%). Contrast, color rendering, and resolution were all considered suboptimal. Despite adjusting the brightness settings, video image rendering was considered too dark. Navigation to the target for biopsy sampling was accomplished by all participants, with no significant difference in procedure time between experienced and less experienced bronchoscopists. The overall system latency for the image stream was 0.33–0.35 s. Fifteen of the pulmonologists would consider using HoloLens for navigation in the periphery, and two would not consider using HoloLens in bronchoscopy at all. In the human study, bronchoscopy inspection was feasible for both patients. Conclusion: Bronchoscopy using an HMD was feasible in a lung phantom and in two patients. Video and ultrasound image quality was considered inferior to that of video monitors. HoloLens 2 was suboptimal for airway and mucosa inspection but may be adequate for virtual bronchoscopy navigation.
使用头戴式混合现实设备的支气管镜检查——一项幻影研究和首次住院用户体验
背景:肺周围病变的支气管镜检查可能涉及图像来源,如计算机断层扫描(CT)、透视、径向支气管内超声(R-EBUS)和虚拟/电磁导航支气管镜检查。我们的目的是评估用头戴式显示器(HMD)取代这些多个监视器的可行性,该显示器始终在支气管镜医师的视线内提供相关的图像数据。方法:共有17名肺病专家佩戴HMD (Microsoft®HoloLens 2)在肺幻影中进行电磁导航支气管镜检查。支气管镜医师首先进行支气管内检查并导航到目标,然后进行支气管内超声支气管镜检查。HMD体验通过问卷进行评估。最后用HMD对2例咯血患者进行支气管镜检查和电磁导航。结果:在幻像研究中,视频和超声图像的感知质量使用视觉模拟量表进行评估,100%代表最佳图像质量。视频质量得分为58%(95%置信区间[CI] 48%-68%),超声图像质量得分为43%(95%置信区间[CI] 30%-56%)。对比度、显色性和分辨率都被认为是次优的。尽管调整了亮度设置,但视频图像渲染被认为太暗。所有参与者都完成了对活检取样目标的导航,经验丰富和经验不足的支气管镜医师在手术时间上没有显着差异。图像流的整体系统延迟为0.33-0.35秒。15位肺科医生会考虑使用HoloLens进行外周导航,2位不考虑在支气管镜检查中使用HoloLens。在人体研究中,支气管镜检查对两例患者都是可行的。结论:HMD支气管镜检查在2例肺幻象患者中是可行的。视频和超声图像质量被认为不如视频监视器。HoloLens 2对于气道和粘膜检查不理想,但对于虚拟支气管镜导航可能足够。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
5.80
自引率
0.00%
发文量
0
审稿时长
13 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信