混合现实用于远程程序培训和评估：可行性研究

IF 2.6 3区医学 Q1 EDUCATION, SCIENTIFIC DISCIPLINES

Journal of Surgical Education Pub Date : 2025-04-22 DOI:10.1016/j.jsurg.2025.103504

Junko Tokuno , Gerald M. Fried , Pepa Kaneva , Amir Sayadi , Camille Caron , Atif Jastaniah , Renzo Cecere , Dan L. Deckelbaum , Amir Hooshiar

{"title":"混合现实用于远程程序培训和评估：可行性研究","authors":"Junko Tokuno , Gerald M. Fried , Pepa Kaneva , Amir Sayadi , Camille Caron , Atif Jastaniah , Renzo Cecere , Dan L. Deckelbaum , Amir Hooshiar","doi":"10.1016/j.jsurg.2025.103504","DOIUrl":null,"url":null,"abstract":"<div><h3>OBJECTIVE</h3><div>Mixed reality (MR) enables real-time telecommunication with verbal and virtual information. We aimed to build a proof of concept and evaluate MR's feasibility for remote personalized technical skill training for chest tube insertion technique.</div></div><div><h3>DESIGN</h3><div>Nonexperimental correlational design.</div></div><div><h3>SETTING</h3><div>A commercial MR software was used to communicate between the participant's head-mounted display and the instructor's laptop. Study participants followed the instructions of an off-site instructor delivered by means of virtual annotations and verbal guidance while performing chest tube insertion on a mannequin. Expert-participants assessed the educational applicability of this teaching approach by a 5-point Likert scale. Non–expert-participants then performed the procedure without the instructions, while technical skills were assessed using a modified Objective Structured Assessment of Technical Skills by 2 experts, 1 rater present on-site and the other observing the performance remotely through the MR system. Non–expert-participants reported the usability of the system using the System Usability Scale (SUS). Inter-rater reliability (remote vs in-person) was calculated using the interclass correlation coefficient (ICC). Data are reported as median (interquartile range).</div></div><div><h3>PARTICIPANTS</h3><div>Five experts and 17 nonexpert individuals (10 medical trainees, 3 nurses, and 4 engineering students).</div></div><div><h3>RESULTS</h3><div>Experts evaluated the teaching with the MR system for remote procedural training useful (4.8 out of 5). The overall SUS score was excellent at 87.5 (77.5-95.0). Scores of in-person and remote technical skill assessment were 45 (39-47), and 44 (37-49) out of 50, respectively. ICC was 0.94.</div></div><div><h3>CONCLUSIONS</h3><div>We successfully established a proof of concept of an MR system for remote procedural training. The system was well-received both by experts and nonexperts, and this teaching approach led to sufficient proficiency in technical skill among non–expert-participants. Reliability of technical skill assessment between via remote and direct observation was excellent. MR is a promising technology for remote instruction and assessment in procedural training.</div></div>","PeriodicalId":50033,"journal":{"name":"Journal of Surgical Education","volume":"82 6","pages":"Article 103504"},"PeriodicalIF":2.6000,"publicationDate":"2025-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Mixed Reality for Remote Procedural Training and Assessment: A Feasibility Study\",\"authors\":\"Junko Tokuno , Gerald M. Fried , Pepa Kaneva , Amir Sayadi , Camille Caron , Atif Jastaniah , Renzo Cecere , Dan L. Deckelbaum , Amir Hooshiar\",\"doi\":\"10.1016/j.jsurg.2025.103504\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>OBJECTIVE</h3><div>Mixed reality (MR) enables real-time telecommunication with verbal and virtual information. We aimed to build a proof of concept and evaluate MR's feasibility for remote personalized technical skill training for chest tube insertion technique.</div></div><div><h3>DESIGN</h3><div>Nonexperimental correlational design.</div></div><div><h3>SETTING</h3><div>A commercial MR software was used to communicate between the participant's head-mounted display and the instructor's laptop. Study participants followed the instructions of an off-site instructor delivered by means of virtual annotations and verbal guidance while performing chest tube insertion on a mannequin. Expert-participants assessed the educational applicability of this teaching approach by a 5-point Likert scale. Non–expert-participants then performed the procedure without the instructions, while technical skills were assessed using a modified Objective Structured Assessment of Technical Skills by 2 experts, 1 rater present on-site and the other observing the performance remotely through the MR system. Non–expert-participants reported the usability of the system using the System Usability Scale (SUS). Inter-rater reliability (remote vs in-person) was calculated using the interclass correlation coefficient (ICC). Data are reported as median (interquartile range).</div></div><div><h3>PARTICIPANTS</h3><div>Five experts and 17 nonexpert individuals (10 medical trainees, 3 nurses, and 4 engineering students).</div></div><div><h3>RESULTS</h3><div>Experts evaluated the teaching with the MR system for remote procedural training useful (4.8 out of 5). The overall SUS score was excellent at 87.5 (77.5-95.0). Scores of in-person and remote technical skill assessment were 45 (39-47), and 44 (37-49) out of 50, respectively. ICC was 0.94.</div></div><div><h3>CONCLUSIONS</h3><div>We successfully established a proof of concept of an MR system for remote procedural training. The system was well-received both by experts and nonexperts, and this teaching approach led to sufficient proficiency in technical skill among non–expert-participants. Reliability of technical skill assessment between via remote and direct observation was excellent. MR is a promising technology for remote instruction and assessment in procedural training.</div></div>\",\"PeriodicalId\":50033,\"journal\":{\"name\":\"Journal of Surgical Education\",\"volume\":\"82 6\",\"pages\":\"Article 103504\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2025-04-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Surgical Education\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1931720425000844\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION, SCIENTIFIC DISCIPLINES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Surgical Education","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1931720425000844","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}

引用次数: 0

摘要

目的混合现实技术（MR）实现了语言和虚拟信息的实时通信。我们的目的是建立一个概念验证和评估磁共振的可行性，远程个性化的技术技能培训的胸管插入技术。非实验相关设计。SETTINGA商用核磁共振软件用于在参与者的头戴式显示器和教练的笔记本电脑之间进行通信。研究参与者在人体模型上进行胸管插入时，遵循非现场教练的指导，通过虚拟注释和口头指导。专家参与者通过5分李克特量表评估了这种教学方法的教育适用性。然后，非专家参与者在没有指导的情况下执行该程序，而技术技能则由2名专家使用改进的客观结构化技术技能评估进行评估，其中1名专家在场，另一名专家通过MR系统远程观察表现。非专家参与者使用系统可用性量表（SUS）报告系统的可用性。使用类间相关系数（ICC）计算组间信度（远程vs面对面）。数据以中位数（四分位数范围）报告。5名专家和17名非专家（10名医学实习生，3名护士，4名工程专业学生）。结果专家评价MR系统用于远程程序培训的教学效果（4.8分，满分5分），SUS总分为87.5分（77.5-95.0分），为优秀。面对面和远程技术技能评估的得分分别为45分（39-47分）和44分（37-49分）。ICC为0.94。结论我们成功地建立了一个用于远程程序培训的磁共振系统的概念验证。该系统受到专家和非专家的好评，这种教学方法使非专家参与者对技术技能有了足够的熟练程度。通过远程观察和直接观察进行技术技能评估的信度较好。核磁共振是一种很有前途的程序训练远程教学和评估技术。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Mixed Reality for Remote Procedural Training and Assessment: A Feasibility Study

OBJECTIVE

Mixed reality (MR) enables real-time telecommunication with verbal and virtual information. We aimed to build a proof of concept and evaluate MR's feasibility for remote personalized technical skill training for chest tube insertion technique.

DESIGN

Nonexperimental correlational design.

SETTING

A commercial MR software was used to communicate between the participant's head-mounted display and the instructor's laptop. Study participants followed the instructions of an off-site instructor delivered by means of virtual annotations and verbal guidance while performing chest tube insertion on a mannequin. Expert-participants assessed the educational applicability of this teaching approach by a 5-point Likert scale. Non–expert-participants then performed the procedure without the instructions, while technical skills were assessed using a modified Objective Structured Assessment of Technical Skills by 2 experts, 1 rater present on-site and the other observing the performance remotely through the MR system. Non–expert-participants reported the usability of the system using the System Usability Scale (SUS). Inter-rater reliability (remote vs in-person) was calculated using the interclass correlation coefficient (ICC). Data are reported as median (interquartile range).

PARTICIPANTS

Five experts and 17 nonexpert individuals (10 medical trainees, 3 nurses, and 4 engineering students).

RESULTS

Experts evaluated the teaching with the MR system for remote procedural training useful (4.8 out of 5). The overall SUS score was excellent at 87.5 (77.5-95.0). Scores of in-person and remote technical skill assessment were 45 (39-47), and 44 (37-49) out of 50, respectively. ICC was 0.94.

CONCLUSIONS

We successfully established a proof of concept of an MR system for remote procedural training. The system was well-received both by experts and nonexperts, and this teaching approach led to sufficient proficiency in technical skill among non–expert-participants. Reliability of technical skill assessment between via remote and direct observation was excellent. MR is a promising technology for remote instruction and assessment in procedural training.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Journal of Surgical Education EDUCATION, SCIENTIFIC DISCIPLINES-SURGERY

CiteScore

5.60

自引率

10.30%

发文量

261

审稿时长

48 days

期刊介绍： The Journal of Surgical Education (JSE) is dedicated to advancing the field of surgical education through original research. The journal publishes research articles in all surgical disciplines on topics relative to the education of surgical students, residents, and fellows, as well as practicing surgeons. Our readers look to JSE for timely, innovative research findings from the international surgical education community. As the official journal of the Association of Program Directors in Surgery (APDS), JSE publishes the proceedings of the annual APDS meeting held during Surgery Education Week.