Artificial intelligence based assessment of minimally invasive surgical skills using standardised objective metrics - A narrative review.

IF 2.7 3区医学 Q1 SURGERY

American journal of surgery Pub Date : 2024-11-06 DOI:10.1016/j.amjsurg.2024.116074

D Kankanamge, C Wijeweera, Z Ong, T Preda, T Carney, M Wilson, V Preda

{"title":"Artificial intelligence based assessment of minimally invasive surgical skills using standardised objective metrics - A narrative review.","authors":"D Kankanamge, C Wijeweera, Z Ong, T Preda, T Carney, M Wilson, V Preda","doi":"10.1016/j.amjsurg.2024.116074","DOIUrl":null,"url":null,"abstract":"Introduction: Many studies display significant heterogeneity in the reliability of artificial intelligence (AI) assessment of minimally invasive surgical (MIS) skills. Our objective is to investigate whether AI systems utilising standardised objective metrics (SOMs) as the basis of skill assessment can provide a clearer understanding of the current state of such technology.Methods: We systematically searched Medline, Embase, Scopus, CENTRAL and Web of Science from March 2023 to September 2023. Results were compiled as a narrative review.Results: Twenty-four citations were analysed. Overall accuracy of AI systems in predicting overall SOM score of a procedure ranged from 63 % to 100 %. The most frequently used SOM by AI algorithms were Objective Structured Assessment of Technical Skills (OSATS) (8/24) and Global Evaluative Assessment of Robotic Skills (GEARS) (8/24).Conclusions: Stratifying for AI studies which employed SOMs to assess surgical skill did not reduce heterogeneity of reported reliability. Our study identifies key issues within the current literature, which, once addressed, could allow more meaningful comparisons between studies.","PeriodicalId":7771,"journal":{"name":"American journal of surgery","volume":"241 ","pages":"116074"},"PeriodicalIF":2.7000,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American journal of surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.amjsurg.2024.116074","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"SURGERY","Score":null,"Total":0}

引用次数: 0

Abstract

Introduction: Many studies display significant heterogeneity in the reliability of artificial intelligence (AI) assessment of minimally invasive surgical (MIS) skills. Our objective is to investigate whether AI systems utilising standardised objective metrics (SOMs) as the basis of skill assessment can provide a clearer understanding of the current state of such technology.

Methods: We systematically searched Medline, Embase, Scopus, CENTRAL and Web of Science from March 2023 to September 2023. Results were compiled as a narrative review.

Results: Twenty-four citations were analysed. Overall accuracy of AI systems in predicting overall SOM score of a procedure ranged from 63 % to 100 %. The most frequently used SOM by AI algorithms were Objective Structured Assessment of Technical Skills (OSATS) (8/24) and Global Evaluative Assessment of Robotic Skills (GEARS) (8/24).

Conclusions: Stratifying for AI studies which employed SOMs to assess surgical skill did not reduce heterogeneity of reported reliability. Our study identifies key issues within the current literature, which, once addressed, could allow more meaningful comparisons between studies.

查看原文本刊更多论文

基于人工智能的微创手术技能标准化客观指标评估 - 综述。

导言：许多研究显示，人工智能（AI）对微创手术（MIS）技能评估的可靠性存在很大差异。我们的目的是研究利用标准化客观指标（SOMs）作为技能评估基础的人工智能系统能否让人们更清楚地了解此类技术的现状：我们系统地检索了 2023 年 3 月至 2023 年 9 月期间的 Medline、Embase、Scopus、CENTRAL 和 Web of Science。结果：分析了 24 篇引文：结果：分析了 24 篇引文。人工智能系统预测手术SOM总得分的总体准确率从63%到100%不等。人工智能算法最常使用的SOM是技术技能客观结构化评估（OSATS）（8/24）和机器人技能全球评估（GEARS）（8/24）：结论：对采用 SOM 评估手术技能的人工智能研究进行分层并不能减少报告可靠性的异质性。我们的研究发现了当前文献中存在的关键问题，一旦解决了这些问题，就能对不同研究进行更有意义的比较。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

American journal of surgery 医学-外科

CiteScore

5.00

自引率

6.70%

发文量

570

审稿时长

56 days

期刊介绍： The American Journal of Surgery® is a peer-reviewed journal designed for the general surgeon who performs abdominal, cancer, vascular, head and neck, breast, colorectal, and other forms of surgery. AJS is the official journal of 7 major surgical societies* and publishes their official papers as well as independently submitted clinical studies, editorials, reviews, brief reports, correspondence and book reviews.