Sara R McMahan, Emily C Courtois, Alexander M Satin, Richard D Guyer, Bethany A Wilson, Kyle T Robinson, Donna D Ohnmeiss
{"title":"Measuring Spine Surgeon Performance: A Scoping Review of Assessment Metrics and Evaluation Methods Used to Assess Surgeon Competency.","authors":"Sara R McMahan, Emily C Courtois, Alexander M Satin, Richard D Guyer, Bethany A Wilson, Kyle T Robinson, Donna D Ohnmeiss","doi":"10.1097/BRS.0000000000005451","DOIUrl":null,"url":null,"abstract":"<p><strong>Study design: </strong>This is a scoping review.</p><p><strong>Objective: </strong>To systematically review and synthesize the performance metrics used to assess surgical competency during spine surgery training.</p><p><strong>Summary of background data: </strong>The complexity of spine surgery requires prolonged training and careful competency evaluation. Simulation-based training offers scalable, repeatable, and ethically feasible alternatives to cadaver-based education. However, the assessment of surgeon performance across these platforms varies widely in scope and standardization.</p><p><strong>Methods: </strong>A scoping review was conducted following the PRISMA-ScR guidelines and registered in the Open Science Framework. Three databases were searched through February 2025 for prospective studies assessing surgeon performance in spine surgery training. Included studies evaluated technical and/or nontechnical skills using defined metrics across various simulation platforms. Data extraction focused on surgical procedure, simulator type, assessment metrics, and scoring methods.</p><p><strong>Results: </strong>From 974 screened records, 44 studies were included. Technical skills (TS) were assessed in all studies, primarily focusing on accuracy, efficiency, handling, safety, and efficacy. Nontechnical skills (NTS)-including cognition, communication, and self-assessment-were reported in 12 studies. Assessment metrics were influenced by surgical procedure and simulation modality. Physical models were most frequently used (n=25), followed by virtual (n=8), hybrid (n=9), and cadaveric or patient models. Scoring systems ranged from validated tools (eg, OSATS, GRS) to piloted instruments. TS were often measured via reviewer scoring or automated simulator output, while NTS assessments lacked consistency and standardization.</p><p><strong>Conclusion: </strong>Performance assessments in spine surgery simulation training vary significantly across platforms and procedures. TS are widely measured using objective or structured scoring systems, whereas NTS remain underassessed. This review underscores the need for validated, comprehensive, and procedure-specific performance metrics-integrating both TS and NTS-to enhance training, standardize evaluation, and ensure clinical readiness.</p>","PeriodicalId":22193,"journal":{"name":"Spine","volume":" ","pages":"E407-E421"},"PeriodicalIF":3.5000,"publicationDate":"2025-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Spine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/BRS.0000000000005451","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/8/1 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Study design: This is a scoping review.
Objective: To systematically review and synthesize the performance metrics used to assess surgical competency during spine surgery training.
Summary of background data: The complexity of spine surgery requires prolonged training and careful competency evaluation. Simulation-based training offers scalable, repeatable, and ethically feasible alternatives to cadaver-based education. However, the assessment of surgeon performance across these platforms varies widely in scope and standardization.
Methods: A scoping review was conducted following the PRISMA-ScR guidelines and registered in the Open Science Framework. Three databases were searched through February 2025 for prospective studies assessing surgeon performance in spine surgery training. Included studies evaluated technical and/or nontechnical skills using defined metrics across various simulation platforms. Data extraction focused on surgical procedure, simulator type, assessment metrics, and scoring methods.
Results: From 974 screened records, 44 studies were included. Technical skills (TS) were assessed in all studies, primarily focusing on accuracy, efficiency, handling, safety, and efficacy. Nontechnical skills (NTS)-including cognition, communication, and self-assessment-were reported in 12 studies. Assessment metrics were influenced by surgical procedure and simulation modality. Physical models were most frequently used (n=25), followed by virtual (n=8), hybrid (n=9), and cadaveric or patient models. Scoring systems ranged from validated tools (eg, OSATS, GRS) to piloted instruments. TS were often measured via reviewer scoring or automated simulator output, while NTS assessments lacked consistency and standardization.
Conclusion: Performance assessments in spine surgery simulation training vary significantly across platforms and procedures. TS are widely measured using objective or structured scoring systems, whereas NTS remain underassessed. This review underscores the need for validated, comprehensive, and procedure-specific performance metrics-integrating both TS and NTS-to enhance training, standardize evaluation, and ensure clinical readiness.
期刊介绍:
Lippincott Williams & Wilkins is a leading international publisher of professional health information for physicians, nurses, specialized clinicians and students. For a complete listing of titles currently published by Lippincott Williams & Wilkins and detailed information about print, online, and other offerings, please visit the LWW Online Store.
Recognized internationally as the leading journal in its field, Spine is an international, peer-reviewed, bi-weekly periodical that considers for publication original articles in the field of Spine. It is the leading subspecialty journal for the treatment of spinal disorders. Only original papers are considered for publication with the understanding that they are contributed solely to Spine. The Journal does not publish articles reporting material that has been reported at length elsewhere.