Carlos E O Dos Santos, Daniele Malaman, Ivan D Arciniegas Sanmartin, Ari B S Leão, Gabriel S Leão, Júlio C Pereira-Lima
{"title":"Performance of artificial intelligence in the characterization of colorectal lesions.","authors":"Carlos E O Dos Santos, Daniele Malaman, Ivan D Arciniegas Sanmartin, Ari B S Leão, Gabriel S Leão, Júlio C Pereira-Lima","doi":"10.4103/sjg.sjg_316_22","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Image-enhanced endoscopy (IEE) has been used in the differentiation between neoplastic and non-neoplastic colorectal lesions through microvasculature analysis. This study aimed to evaluate the computer-aided diagnosis (CADx) mode of the CAD EYE system for the optical diagnosis of colorectal lesions and compare it with the performance of an expert, in addition to evaluating the computer-aided detection (CADe) mode in terms of polyp detection rate (PDR) and adenoma detection rate (ADR).</p><p><strong>Methods: </strong>A prospective study was conducted to evaluate the performance of CAD EYE using blue light imaging (BLI), dichotomizing lesions into hyperplastic and neoplastic, and of an expert based on the Japan Narrow-Band Imaging Expert Team (JNET) classification for the characterization of lesions. After white light imaging (WLI) diagnosis, magnification was used on all lesions, which were removed and examined histologically. Diagnostic criteria were evaluated, and PDR and ADR were calculated.</p><p><strong>Results: </strong>A total of 110 lesions (80 (72.7%) dysplastic lesions and 30 (27.3%) nondysplastic lesions) were evaluated in 52 patients, with a mean lesion size of 4.3 mm. Artificial intelligence (AI) analysis showed 81.8% accuracy, 76.3% sensitivity, 96.7% specificity, 98.5% positive predictive value (PPV), and 60.4% negative predictive value (NPV). The kappa value was 0.61, and the area under the receiver operating characteristic curve (AUC) was 0.87. Expert analysis showed 93.6% accuracy, 92.5% sensitivity, 96.7% specificity, 98.7% PPV, and 82.9% NPV. The kappa value was 0.85, and the AUC was 0.95. Overall, PDR was 67.6% and ADR was 45.9%.</p><p><strong>Conclusions: </strong>The CADx mode showed good accuracy in characterizing colorectal lesions, but the expert assessment was superior in almost all diagnostic criteria. PDR and ADR were high.</p>","PeriodicalId":1,"journal":{"name":"Accounts of Chemical Research","volume":null,"pages":null},"PeriodicalIF":16.4000,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/85/72/SJG-29-219.PMC10445495.pdf","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accounts of Chemical Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.4103/sjg.sjg_316_22","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 2
Abstract
Background: Image-enhanced endoscopy (IEE) has been used in the differentiation between neoplastic and non-neoplastic colorectal lesions through microvasculature analysis. This study aimed to evaluate the computer-aided diagnosis (CADx) mode of the CAD EYE system for the optical diagnosis of colorectal lesions and compare it with the performance of an expert, in addition to evaluating the computer-aided detection (CADe) mode in terms of polyp detection rate (PDR) and adenoma detection rate (ADR).
Methods: A prospective study was conducted to evaluate the performance of CAD EYE using blue light imaging (BLI), dichotomizing lesions into hyperplastic and neoplastic, and of an expert based on the Japan Narrow-Band Imaging Expert Team (JNET) classification for the characterization of lesions. After white light imaging (WLI) diagnosis, magnification was used on all lesions, which were removed and examined histologically. Diagnostic criteria were evaluated, and PDR and ADR were calculated.
Results: A total of 110 lesions (80 (72.7%) dysplastic lesions and 30 (27.3%) nondysplastic lesions) were evaluated in 52 patients, with a mean lesion size of 4.3 mm. Artificial intelligence (AI) analysis showed 81.8% accuracy, 76.3% sensitivity, 96.7% specificity, 98.5% positive predictive value (PPV), and 60.4% negative predictive value (NPV). The kappa value was 0.61, and the area under the receiver operating characteristic curve (AUC) was 0.87. Expert analysis showed 93.6% accuracy, 92.5% sensitivity, 96.7% specificity, 98.7% PPV, and 82.9% NPV. The kappa value was 0.85, and the AUC was 0.95. Overall, PDR was 67.6% and ADR was 45.9%.
Conclusions: The CADx mode showed good accuracy in characterizing colorectal lesions, but the expert assessment was superior in almost all diagnostic criteria. PDR and ADR were high.
期刊介绍：
Accounts of Chemical Research presents short, concise and critical articles offering easy-to-read overviews of basic research and applications in all areas of chemistry and biochemistry. These short reviews focus on research from the author’s own laboratory and are designed to teach the reader about a research project. In addition, Accounts of Chemical Research publishes commentaries that give an informed opinion on a current research problem. Special Issues online are devoted to a single topic of unusual activity and significance.
Accounts of Chemical Research replaces the traditional article abstract with an article "Conspectus." These entries synopsize the research affording the reader a closer look at the content and significance of an article. Through this provision of a more detailed description of the article contents, the Conspectus enhances the article's discoverability by search engines and the exposure for the research.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
