Adherence of randomised controlled trials using artificial intelligence in ophthalmology to CONSORT-AI guidelines: a systematic review and critical appraisal.

IF 4.1 Q1 HEALTH CARE SCIENCES & SERVICES
Niveditha Pattathil, Jonathan Z L Zhao, Olapeju Sam-Oyerinde, Tina Felfeli
{"title":"Adherence of randomised controlled trials using artificial intelligence in ophthalmology to CONSORT-AI guidelines: a systematic review and critical appraisal.","authors":"Niveditha Pattathil,&nbsp;Jonathan Z L Zhao,&nbsp;Olapeju Sam-Oyerinde,&nbsp;Tina Felfeli","doi":"10.1136/bmjhci-2023-100757","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Many efforts have been made to explore the potential of deep learning and artificial intelligence (AI) in disciplines such as medicine, including ophthalmology. This systematic review aims to evaluate the reporting quality of randomised controlled trials (RCTs) that evaluate AI technologies applied to ophthalmology.</p><p><strong>Methods: </strong>A comprehensive search of three relevant databases (EMBASE, Medline, Cochrane) from 1 January 2010 to 5 February 2022 was conducted. The reporting quality of these papers was scored using the Consolidated Standards of Reporting Trials-Artificial Intelligence (CONSORT-AI) checklist and further risk of bias was assessed using the RoB-2 tool.</p><p><strong>Results: </strong>The initial search yielded 2973 citations from which 5 articles satisfied the inclusion/exclusion criteria. These articles featured AI technologies applied to diabetic retinopathy screening, ophthalmologic education, fungal keratitis detection and paediatric cataract diagnosis. None of the articles reported all items in the CONSORT-AI checklist. The overall mean CONSORT-AI score of the included RCTs was 53% (range 37%-78%). The individual scores of the articles were 37% (19/51), 39% (20), 49% (25), 61% (31) and 78% (40). All articles were scored as being moderate risk, or 'some concerns present', regarding potential risk of bias according to the RoB-2 tool.</p><p><strong>Conclusion: </strong>A small number of RCTs have been published to date on the applications of AI in ophthalmology and vision science. Adherence to the 2020 CONSORT-AI reporting guidelines is suboptimal with notable reporting items often missed. Greater adherence will help facilitate reproducibility of AI research which can be a stimulus for more AI-based RCTs and clinical applications in ophthalmology.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":null,"pages":null},"PeriodicalIF":4.1000,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/1c/4b/bmjhci-2023-100757.PMC10357814.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMJ Health & Care Informatics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1136/bmjhci-2023-100757","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose: Many efforts have been made to explore the potential of deep learning and artificial intelligence (AI) in disciplines such as medicine, including ophthalmology. This systematic review aims to evaluate the reporting quality of randomised controlled trials (RCTs) that evaluate AI technologies applied to ophthalmology.

Methods: A comprehensive search of three relevant databases (EMBASE, Medline, Cochrane) from 1 January 2010 to 5 February 2022 was conducted. The reporting quality of these papers was scored using the Consolidated Standards of Reporting Trials-Artificial Intelligence (CONSORT-AI) checklist and further risk of bias was assessed using the RoB-2 tool.

Results: The initial search yielded 2973 citations from which 5 articles satisfied the inclusion/exclusion criteria. These articles featured AI technologies applied to diabetic retinopathy screening, ophthalmologic education, fungal keratitis detection and paediatric cataract diagnosis. None of the articles reported all items in the CONSORT-AI checklist. The overall mean CONSORT-AI score of the included RCTs was 53% (range 37%-78%). The individual scores of the articles were 37% (19/51), 39% (20), 49% (25), 61% (31) and 78% (40). All articles were scored as being moderate risk, or 'some concerns present', regarding potential risk of bias according to the RoB-2 tool.

Conclusion: A small number of RCTs have been published to date on the applications of AI in ophthalmology and vision science. Adherence to the 2020 CONSORT-AI reporting guidelines is suboptimal with notable reporting items often missed. Greater adherence will help facilitate reproducibility of AI research which can be a stimulus for more AI-based RCTs and clinical applications in ophthalmology.

Abstract Image

Abstract Image

眼科学中使用人工智能的随机对照试验遵守conber - ai指南:系统回顾和关键评价。
目的:为了探索深度学习和人工智能(AI)在医学(包括眼科)等学科中的潜力,人们做出了许多努力。本系统综述旨在评估评估人工智能技术应用于眼科的随机对照试验(rct)的报告质量。方法:综合检索2010年1月1日至2022年2月5日EMBASE、Medline、Cochrane三个相关数据库。这些论文的报告质量使用联合试验报告标准-人工智能(conber - ai)检查表进行评分,并使用rob2工具评估进一步的偏倚风险。结果:初步检索得到2973条引用,其中5篇文章符合纳入/排除标准。这些文章介绍了人工智能技术在糖尿病视网膜病变筛查、眼科教育、真菌性角膜炎检测和儿童白内障诊断中的应用。没有一篇文章报告了consortium - ai清单中的所有项目。纳入的rct的总体平均confederation - ai评分为53%(范围为37%-78%)。文章的单项得分分别为37%(19/51)、39%(20)、49%(25)、61%(31)和78%(40)。根据rob2工具,所有文章的潜在偏倚风险均被评为中度风险,或“存在一些担忧”。结论:迄今为止,关于人工智能在眼科和视觉科学中的应用的随机对照试验已经发表了少量。遵守2020年consortium - ai报告指南是次优的,经常遗漏重要的报告项目。更大的依从性将有助于促进人工智能研究的可重复性,这可以刺激更多基于人工智能的随机对照试验和眼科临床应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
6.10
自引率
4.90%
发文量
40
审稿时长
18 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信