Prospective randomized evaluation of the sustained impact of assistive artificial intelligence on anesthetists' ultrasound scanning for regional anesthesia.
Chao-Ying Kowa, Megan Morecroft, Alan J R Macfarlane, David Burckett-St Laurent, Amit Pawa, Simeon West, Steve Margetts, Nat Haslam, Toby Ashken, Maria Paz Sebastian, Athmaja Thottungal, Jono Womack, Julia Alison Noble, Helen Higham, James S Bowness
{"title":"Prospective randomized evaluation of the sustained impact of assistive artificial intelligence on anesthetists' ultrasound scanning for regional anesthesia.","authors":"Chao-Ying Kowa, Megan Morecroft, Alan J R Macfarlane, David Burckett-St Laurent, Amit Pawa, Simeon West, Steve Margetts, Nat Haslam, Toby Ashken, Maria Paz Sebastian, Athmaja Thottungal, Jono Womack, Julia Alison Noble, Helen Higham, James S Bowness","doi":"10.1136/bmjsit-2024-000264","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Ultrasound-guided regional anesthesia (UGRA) relies on acquiring and interpreting an appropriate view of sonoanatomy. Artificial intelligence (AI) has the potential to aid this by applying a color overlay to key sonoanatomical structures.The primary aim was to determine whether an AI-generated color overlay was associated with a difference in participants' ability to identify an appropriate block view over a 2-month period after a standardized teaching session (as judged by a blinded assessor). Secondary outcomes included the ability to identify an appropriate block view (unblinded assessor), global rating score and participant confidence scores.</p><p><strong>Design: </strong>Randomized, partially blinded, prospective cross-over study.</p><p><strong>Setting: </strong>Simulation scans on healthy volunteers. Initial assessments on 29 November 2022 and 30 November 2022, with follow-up on 25 January 2023 - 27 January 2023.</p><p><strong>Participants: </strong>57 junior anesthetists undertook initial assessments and 51 (89.47%) returned at 2 months.</p><p><strong>Intervention: </strong>Participants performed ultrasound scans for six peripheral nerve blocks, with AI assistance randomized to half of the blocks. Cross-over assignment was employed for 2 months.</p><p><strong>Main outcome measures: </strong>Blinded experts assessed whether the block view acquired was acceptable (yes/no). Unblinded experts also assessed this parameter and provided a global performance rating (0-100). Participants reported scan confidence (0-100).</p><p><strong>Results: </strong>AI assistance was associated with a higher rate of appropriate block view acquisition in both blinded and unblinded assessments (p=0.02 and <0.01, respectively). Participant confidence and expert rating scores were superior throughout (all p<0.01).</p><p><strong>Conclusions: </strong>Assistive AI was associated with superior ultrasound scanning performance 2 months after formal teaching. It may aid application of sonoanatomical knowledge and skills gained in teaching, to support delivery of UGRA beyond the immediate post-teaching period.</p><p><strong>Trial registration number: </strong>www.clinicaltrials.govNCT05583032.</p>","PeriodicalId":33349,"journal":{"name":"BMJ Surgery Interventions Health Technologies","volume":"6 1","pages":"e000264"},"PeriodicalIF":2.1000,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11487881/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMJ Surgery Interventions Health Technologies","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1136/bmjsit-2024-000264","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"SURGERY","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives: Ultrasound-guided regional anesthesia (UGRA) relies on acquiring and interpreting an appropriate view of sonoanatomy. Artificial intelligence (AI) has the potential to aid this by applying a color overlay to key sonoanatomical structures.The primary aim was to determine whether an AI-generated color overlay was associated with a difference in participants' ability to identify an appropriate block view over a 2-month period after a standardized teaching session (as judged by a blinded assessor). Secondary outcomes included the ability to identify an appropriate block view (unblinded assessor), global rating score and participant confidence scores.
Setting: Simulation scans on healthy volunteers. Initial assessments on 29 November 2022 and 30 November 2022, with follow-up on 25 January 2023 - 27 January 2023.
Participants: 57 junior anesthetists undertook initial assessments and 51 (89.47%) returned at 2 months.
Intervention: Participants performed ultrasound scans for six peripheral nerve blocks, with AI assistance randomized to half of the blocks. Cross-over assignment was employed for 2 months.
Main outcome measures: Blinded experts assessed whether the block view acquired was acceptable (yes/no). Unblinded experts also assessed this parameter and provided a global performance rating (0-100). Participants reported scan confidence (0-100).
Results: AI assistance was associated with a higher rate of appropriate block view acquisition in both blinded and unblinded assessments (p=0.02 and <0.01, respectively). Participant confidence and expert rating scores were superior throughout (all p<0.01).
Conclusions: Assistive AI was associated with superior ultrasound scanning performance 2 months after formal teaching. It may aid application of sonoanatomical knowledge and skills gained in teaching, to support delivery of UGRA beyond the immediate post-teaching period.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
