Arthroscopic Shoulder Simulation Studies Reveal Improvements in Performance Metrics without Proven Transferability to the Operating Room: A Systematic Review.

Abstract

Purpose: The purpose of this systematic review was to evaluate the use of shoulder arthroscopic simulation in Orthopaedic surgery trainees.

Methods: A literature search was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, using PubMed, Medline (Ovid), and EMBASE library databases. Inclusion criteria were experimental studies reporting pre- and post-test results of shoulder arthroscopic simulation in orthopaedic trainees (studies reporting results of comparison between groups not within the groups were excluded). Participant demographics, type of simulator training, simulator tasks assessed and performance outcome measures were systematically reviewed. Each performance outcome measure was graphically represented in a Forest plot with point estimates of the incidence of performance outcomes with corresponding 95% confidence intervals and I².

Results: Fifteen studies met inclusion criteria with a total of 353 participants. The most common procedures simulated were diagnostic shoulder arthroscopy (n=9 [60%]), arthroscopic Bankart repairs (n=3 [20%]), and rotator cuff repairs (n =2 [13%]). Simulations primarily utilized virtual reality (60%) and bench top models (40%). The primary outcomes measured were time to task completion and Arthroscopic Surgical Skill Evaluation Tool (ASSET) scores. Time to task completion improved significantly with training (range 13-439 seconds pre-test to 8-253.29 seconds post-test), with substantial heterogeneity across studies (I²=87%). ASSET scores improved in 60% of the studies (ranging from 14-20.9 pre-test to 17.9-28.5 post-test), with low heterogeneity (I²=20%). Additionally, both camera and probe distances decreased after simulation use, while the 14-point anatomic checklist showed no pre to post-test differences.

Conclusion: Arthroscopic simulation training benefits technical skills in shoulder arthroscopy, but the quality, assessment, and validity of these protocols vary. The translation of simulation training into the operating room has yet to be conclusively demonstrated.