{"title":"Multicentre study to assess the performance of an artificial intelligence instrument to support qualitative diagnosis of colorectal polyps.","authors":"Keigo Sato, Mizuki Kuramochi, Akihiko Tsuchiya, Akihiro Yamaguchi, Yasuo Hosoda, Norio Yamaguchi, Naohiro Nakamura, Yuki Itoi, Yu Hashimoto, Kengo Kasuga, Hirohito Tanaka, Shiko Kuribayashi, Yoji Takeuchi, Toshio Uraoka","doi":"10.1136/bmjgast-2024-001553","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Computer-aided diagnosis (CAD) using artificial intelligence (AI) is expected to support the characterisation of colorectal lesions, which is clinically relevant for efficient colorectal cancer prevention. We conducted this study to assess the diagnostic performance of commercially available CAD systems.</p><p><strong>Methods: </strong>This was a multicentre, prospective performance evaluation study. The endoscopist diagnosed polyps using white light imaging, followed by non-magnified blue light imaging (non-mBLI) and mBLI. AI subsequently assessed the lesions using non-mBLI (non-mAI), followed by mBLI (mAI). Eventually, endoscopists made the final diagnosis by integrating the AI diagnosis (AI+endoscopist). The primary endpoint was the accuracy of the AI diagnosis of neoplastic lesions. The diagnostic performance of each modality (sensitivity, specificity and accuracy) and confidence levels were also assessed.</p><p><strong>Results: </strong>Overall, 380 lesions from 139 patients were included in the analysis. The accuracy of non-mAI was 83%, 95% CI (79% to 87%), which was inferior to that of mBLI (89%, 95% CI (85% to 92%)) and mAI (89%, 95% CI (85% to 92%)). The accuracy (95% CI) of diagnosis by expert endoscopists using mAI (91%, 95% CI (87% to 94%)) was comparable to that of expert endoscopists using mBLI (91%, 95% CI (87% to 94%)) but better than that of non-expert endoscopists using mAI (83%, 95% CI (75% to 90%)). The level of confidence in making a correct diagnosis was increased when using magnification and AI.</p><p><strong>Conclusions: </strong>The diagnostic performance of mAI for differentiating colonic lesions is comparable to that of endoscopists, regardless of their experience. However, it can be affected by the use of magnification as well as the endoscopists' level of experience.</p>","PeriodicalId":9235,"journal":{"name":"BMJ Open Gastroenterology","volume":"11 1","pages":""},"PeriodicalIF":3.3000,"publicationDate":"2024-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11499753/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMJ Open Gastroenterology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1136/bmjgast-2024-001553","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"GASTROENTEROLOGY & HEPATOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: Computer-aided diagnosis (CAD) using artificial intelligence (AI) is expected to support the characterisation of colorectal lesions, which is clinically relevant for efficient colorectal cancer prevention. We conducted this study to assess the diagnostic performance of commercially available CAD systems.
Methods: This was a multicentre, prospective performance evaluation study. The endoscopist diagnosed polyps using white light imaging, followed by non-magnified blue light imaging (non-mBLI) and mBLI. AI subsequently assessed the lesions using non-mBLI (non-mAI), followed by mBLI (mAI). Eventually, endoscopists made the final diagnosis by integrating the AI diagnosis (AI+endoscopist). The primary endpoint was the accuracy of the AI diagnosis of neoplastic lesions. The diagnostic performance of each modality (sensitivity, specificity and accuracy) and confidence levels were also assessed.
Results: Overall, 380 lesions from 139 patients were included in the analysis. The accuracy of non-mAI was 83%, 95% CI (79% to 87%), which was inferior to that of mBLI (89%, 95% CI (85% to 92%)) and mAI (89%, 95% CI (85% to 92%)). The accuracy (95% CI) of diagnosis by expert endoscopists using mAI (91%, 95% CI (87% to 94%)) was comparable to that of expert endoscopists using mBLI (91%, 95% CI (87% to 94%)) but better than that of non-expert endoscopists using mAI (83%, 95% CI (75% to 90%)). The level of confidence in making a correct diagnosis was increased when using magnification and AI.
Conclusions: The diagnostic performance of mAI for differentiating colonic lesions is comparable to that of endoscopists, regardless of their experience. However, it can be affected by the use of magnification as well as the endoscopists' level of experience.
期刊介绍:
BMJ Open Gastroenterology is an online-only, peer-reviewed, open access gastroenterology journal, dedicated to publishing high-quality medical research from all disciplines and therapeutic areas of gastroenterology. It is the open access companion journal of Gut and is co-owned by the British Society of Gastroenterology. The journal publishes all research study types, from study protocols to phase I trials to meta-analyses, including small or specialist studies. Publishing procedures are built around continuous publication, publishing research online as soon as the article is ready.