Development of an evaluation framework for robotic total mesorectal excision videos: a review and comparison of medical professional and public video resources.
Zohaib Arain, Michael G Fadel, Aksaan Arif, Henry Douglas Robb, Bibek Das, Liam Poynter, Christos Kontovounisios, Hutan Ashrafian, Daniel Lawes, Matyas Fehervari
{"title":"Development of an evaluation framework for robotic total mesorectal excision videos: a review and comparison of medical professional and public video resources.","authors":"Zohaib Arain, Michael G Fadel, Aksaan Arif, Henry Douglas Robb, Bibek Das, Liam Poynter, Christos Kontovounisios, Hutan Ashrafian, Daniel Lawes, Matyas Fehervari","doi":"10.1007/s00384-025-04914-w","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>This study aims to assess the quality of educational surgical videos for robotic total mesorectal excision (TME), across widely used open-source platforms, using a newly designed quality assessment checklist.</p><p><strong>Methods: </strong>The checklist was developed by using existing society guidelines, such as the European Academy of Robotic Colorectal Surgery, comprising four key sections: (i) usability of the platform, (ii) video component, (iii) intraoperative techniques and (iv) other information (including case presentation and outcomes). Videos were identified using the search terms 'Robotic TME' from surgical education platforms (WebSurg, C-SATS and Touch Surgery) and YouTube, between January 2016 and July 2024. All videos displaying robotic TME were reviewed and scored using the quality assessment tool (/12), and the videos across the platforms were subsequently compared.</p><p><strong>Results: </strong>A total of 113 videos were scored using the checklist: 63 surgical education platform (10 WebSurg and 53 C-SATS) and 50 YouTube videos. The total median checklist score achieved by WebSurg (9 [IQR 8-9] and YouTube videos (8 [IQR 7-10]) was significantly higher than CSAT-S videos (4 [IQR 4-5]; p < 0.001). The usability of platform scores for YouTube was significantly higher than WebSurg and C-SATS videos (p < 0.001). Scores for video components, intraoperative techniques and other information were higher across WebSurg and YouTube videos when compared to C-SATS (p < 0.001); however, there was no significant difference between WebSurg and YouTube for each domain.</p><p><strong>Conclusion: </strong>The overall educational quality of online robotic TME videos was found to be generally heterogeneous, with WebSurg and YouTube videos demonstrating higher scores based on the checklist. A new quality assessment tool has been proposed for robotic TME videos, which has the potential to improve the reliability and value of published video research.</p>","PeriodicalId":13789,"journal":{"name":"International Journal of Colorectal Disease","volume":"40 1","pages":"127"},"PeriodicalIF":2.3000,"publicationDate":"2025-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12103343/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Colorectal Disease","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00384-025-04914-w","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"GASTROENTEROLOGY & HEPATOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: This study aims to assess the quality of educational surgical videos for robotic total mesorectal excision (TME), across widely used open-source platforms, using a newly designed quality assessment checklist.
Methods: The checklist was developed by using existing society guidelines, such as the European Academy of Robotic Colorectal Surgery, comprising four key sections: (i) usability of the platform, (ii) video component, (iii) intraoperative techniques and (iv) other information (including case presentation and outcomes). Videos were identified using the search terms 'Robotic TME' from surgical education platforms (WebSurg, C-SATS and Touch Surgery) and YouTube, between January 2016 and July 2024. All videos displaying robotic TME were reviewed and scored using the quality assessment tool (/12), and the videos across the platforms were subsequently compared.
Results: A total of 113 videos were scored using the checklist: 63 surgical education platform (10 WebSurg and 53 C-SATS) and 50 YouTube videos. The total median checklist score achieved by WebSurg (9 [IQR 8-9] and YouTube videos (8 [IQR 7-10]) was significantly higher than CSAT-S videos (4 [IQR 4-5]; p < 0.001). The usability of platform scores for YouTube was significantly higher than WebSurg and C-SATS videos (p < 0.001). Scores for video components, intraoperative techniques and other information were higher across WebSurg and YouTube videos when compared to C-SATS (p < 0.001); however, there was no significant difference between WebSurg and YouTube for each domain.
Conclusion: The overall educational quality of online robotic TME videos was found to be generally heterogeneous, with WebSurg and YouTube videos demonstrating higher scores based on the checklist. A new quality assessment tool has been proposed for robotic TME videos, which has the potential to improve the reliability and value of published video research.
期刊介绍：
The International Journal of Colorectal Disease, Clinical and Molecular Gastroenterology and Surgery aims to publish novel and state-of-the-art papers which deal with the physiology and pathophysiology of diseases involving the entire gastrointestinal tract. In addition to original research articles, the following categories will be included: reviews (usually commissioned but may also be submitted), case reports, letters to the editor, and protocols on clinical studies.
The journal offers its readers an interdisciplinary forum for clinical science and molecular research related to gastrointestinal disease.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
