测量脊柱外科医生的表现:用于评估外科医生能力的评估指标和评估方法的范围审查。

IF 3.5 2区 医学 Q2 CLINICAL NEUROLOGY
Spine Pub Date : 2025-10-15 Epub Date: 2025-08-01 DOI:10.1097/BRS.0000000000005451
Sara R McMahan, Emily C Courtois, Alexander M Satin, Richard D Guyer, Bethany A Wilson, Kyle T Robinson, Donna D Ohnmeiss
{"title":"测量脊柱外科医生的表现:用于评估外科医生能力的评估指标和评估方法的范围审查。","authors":"Sara R McMahan, Emily C Courtois, Alexander M Satin, Richard D Guyer, Bethany A Wilson, Kyle T Robinson, Donna D Ohnmeiss","doi":"10.1097/BRS.0000000000005451","DOIUrl":null,"url":null,"abstract":"<p><strong>Study design: </strong>This is a scoping review.</p><p><strong>Objective: </strong>To systematically review and synthesize the performance metrics used to assess surgical competency during spine surgery training.</p><p><strong>Summary of background data: </strong>The complexity of spine surgery requires prolonged training and careful competency evaluation. Simulation-based training offers scalable, repeatable, and ethically feasible alternatives to cadaver-based education. However, the assessment of surgeon performance across these platforms varies widely in scope and standardization.</p><p><strong>Methods: </strong>A scoping review was conducted following the PRISMA-ScR guidelines and registered in the Open Science Framework. Three databases were searched through February 2025 for prospective studies assessing surgeon performance in spine surgery training. Included studies evaluated technical and/or nontechnical skills using defined metrics across various simulation platforms. Data extraction focused on surgical procedure, simulator type, assessment metrics, and scoring methods.</p><p><strong>Results: </strong>From 974 screened records, 44 studies were included. Technical skills (TS) were assessed in all studies, primarily focusing on accuracy, efficiency, handling, safety, and efficacy. Nontechnical skills (NTS)-including cognition, communication, and self-assessment-were reported in 12 studies. Assessment metrics were influenced by surgical procedure and simulation modality. Physical models were most frequently used (n=25), followed by virtual (n=8), hybrid (n=9), and cadaveric or patient models. Scoring systems ranged from validated tools (eg, OSATS, GRS) to piloted instruments. TS were often measured via reviewer scoring or automated simulator output, while NTS assessments lacked consistency and standardization.</p><p><strong>Conclusion: </strong>Performance assessments in spine surgery simulation training vary significantly across platforms and procedures. TS are widely measured using objective or structured scoring systems, whereas NTS remain underassessed. This review underscores the need for validated, comprehensive, and procedure-specific performance metrics-integrating both TS and NTS-to enhance training, standardize evaluation, and ensure clinical readiness.</p>","PeriodicalId":22193,"journal":{"name":"Spine","volume":" ","pages":"E407-E421"},"PeriodicalIF":3.5000,"publicationDate":"2025-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Measuring Spine Surgeon Performance: A Scoping Review of Assessment Metrics and Evaluation Methods Used to Assess Surgeon Competency.\",\"authors\":\"Sara R McMahan, Emily C Courtois, Alexander M Satin, Richard D Guyer, Bethany A Wilson, Kyle T Robinson, Donna D Ohnmeiss\",\"doi\":\"10.1097/BRS.0000000000005451\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Study design: </strong>This is a scoping review.</p><p><strong>Objective: </strong>To systematically review and synthesize the performance metrics used to assess surgical competency during spine surgery training.</p><p><strong>Summary of background data: </strong>The complexity of spine surgery requires prolonged training and careful competency evaluation. Simulation-based training offers scalable, repeatable, and ethically feasible alternatives to cadaver-based education. However, the assessment of surgeon performance across these platforms varies widely in scope and standardization.</p><p><strong>Methods: </strong>A scoping review was conducted following the PRISMA-ScR guidelines and registered in the Open Science Framework. Three databases were searched through February 2025 for prospective studies assessing surgeon performance in spine surgery training. Included studies evaluated technical and/or nontechnical skills using defined metrics across various simulation platforms. Data extraction focused on surgical procedure, simulator type, assessment metrics, and scoring methods.</p><p><strong>Results: </strong>From 974 screened records, 44 studies were included. Technical skills (TS) were assessed in all studies, primarily focusing on accuracy, efficiency, handling, safety, and efficacy. Nontechnical skills (NTS)-including cognition, communication, and self-assessment-were reported in 12 studies. Assessment metrics were influenced by surgical procedure and simulation modality. Physical models were most frequently used (n=25), followed by virtual (n=8), hybrid (n=9), and cadaveric or patient models. Scoring systems ranged from validated tools (eg, OSATS, GRS) to piloted instruments. TS were often measured via reviewer scoring or automated simulator output, while NTS assessments lacked consistency and standardization.</p><p><strong>Conclusion: </strong>Performance assessments in spine surgery simulation training vary significantly across platforms and procedures. TS are widely measured using objective or structured scoring systems, whereas NTS remain underassessed. This review underscores the need for validated, comprehensive, and procedure-specific performance metrics-integrating both TS and NTS-to enhance training, standardize evaluation, and ensure clinical readiness.</p>\",\"PeriodicalId\":22193,\"journal\":{\"name\":\"Spine\",\"volume\":\" \",\"pages\":\"E407-E421\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2025-10-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Spine\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1097/BRS.0000000000005451\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/8/1 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Spine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/BRS.0000000000005451","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/8/1 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0

摘要

研究设计:这是一项范围综述。目的:系统地回顾和综合脊柱外科培训中用于评估手术能力的绩效指标。背景资料总结:脊柱外科的复杂性需要长期的训练和仔细的能力评估。基于模拟的培训为基于尸体的教育提供了可扩展、可重复和道德上可行的替代方案。然而,在这些平台上对外科医生表现的评估在范围和标准化方面差异很大。方法:按照PRISMA-ScR指南进行范围审查,并在开放科学框架中注册。到2025年2月,三个数据库进行了前瞻性研究,评估外科医生在脊柱外科培训中的表现。包括研究评估技术和/或非技术技能,使用各种模拟平台的定义指标。数据提取侧重于手术程序、模拟器类型、评估指标和评分方法。结果:从974份筛选记录中,纳入44项研究。技术技能(TS)在所有研究中都进行了评估,主要集中在准确性、效率、处理、安全性和有效性方面。12项研究报告了非技术技能(NTS),包括认知、沟通和自我评估。评估指标受手术方式和模拟方式的影响。最常用的是物理模型(n=25),其次是虚拟模型(n=8)、混合模型(n=9)和尸体模型或患者模型。评分系统的范围从经过验证的工具(例如,OSATS, GRS)到试点仪器。TS通常通过审稿人评分或自动模拟器输出来衡量,而NTS评估缺乏一致性和标准化。结论:脊柱外科模拟训练的绩效评估在不同平台和程序中存在显著差异。TS广泛使用客观或结构化的评分系统来衡量,而NTS仍然被低估。本综述强调需要经过验证的、全面的和程序特定的绩效指标——整合TS和nts——以加强培训、标准化评估和确保临床准备。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Measuring Spine Surgeon Performance: A Scoping Review of Assessment Metrics and Evaluation Methods Used to Assess Surgeon Competency.

Study design: This is a scoping review.

Objective: To systematically review and synthesize the performance metrics used to assess surgical competency during spine surgery training.

Summary of background data: The complexity of spine surgery requires prolonged training and careful competency evaluation. Simulation-based training offers scalable, repeatable, and ethically feasible alternatives to cadaver-based education. However, the assessment of surgeon performance across these platforms varies widely in scope and standardization.

Methods: A scoping review was conducted following the PRISMA-ScR guidelines and registered in the Open Science Framework. Three databases were searched through February 2025 for prospective studies assessing surgeon performance in spine surgery training. Included studies evaluated technical and/or nontechnical skills using defined metrics across various simulation platforms. Data extraction focused on surgical procedure, simulator type, assessment metrics, and scoring methods.

Results: From 974 screened records, 44 studies were included. Technical skills (TS) were assessed in all studies, primarily focusing on accuracy, efficiency, handling, safety, and efficacy. Nontechnical skills (NTS)-including cognition, communication, and self-assessment-were reported in 12 studies. Assessment metrics were influenced by surgical procedure and simulation modality. Physical models were most frequently used (n=25), followed by virtual (n=8), hybrid (n=9), and cadaveric or patient models. Scoring systems ranged from validated tools (eg, OSATS, GRS) to piloted instruments. TS were often measured via reviewer scoring or automated simulator output, while NTS assessments lacked consistency and standardization.

Conclusion: Performance assessments in spine surgery simulation training vary significantly across platforms and procedures. TS are widely measured using objective or structured scoring systems, whereas NTS remain underassessed. This review underscores the need for validated, comprehensive, and procedure-specific performance metrics-integrating both TS and NTS-to enhance training, standardize evaluation, and ensure clinical readiness.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Spine
Spine 医学-临床神经学
CiteScore
5.90
自引率
6.70%
发文量
361
审稿时长
6.0 months
期刊介绍: Lippincott Williams & Wilkins is a leading international publisher of professional health information for physicians, nurses, specialized clinicians and students. For a complete listing of titles currently published by Lippincott Williams & Wilkins and detailed information about print, online, and other offerings, please visit the LWW Online Store. Recognized internationally as the leading journal in its field, Spine is an international, peer-reviewed, bi-weekly periodical that considers for publication original articles in the field of Spine. It is the leading subspecialty journal for the treatment of spinal disorders. Only original papers are considered for publication with the understanding that they are contributed solely to Spine. The Journal does not publish articles reporting material that has been reported at length elsewhere.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信