Jin Kim, Chan Woo Kwak, Saangyong Uhmn, Junghoon Lee, Sangjun Yoo, Min Chul Cho, Hwancheol Son, Hyeon Jeong, Min Soo Choo
{"title":"A Novel Deep Learning-based Artificial Intelligence System for Interpreting Urolithiasis in Computed Tomography.","authors":"Jin Kim, Chan Woo Kwak, Saangyong Uhmn, Junghoon Lee, Sangjun Yoo, Min Chul Cho, Hwancheol Son, Hyeon Jeong, Min Soo Choo","doi":"10.1016/j.euf.2024.07.003","DOIUrl":null,"url":null,"abstract":"<p><strong>Background and objective: </strong>Our aim was to develop an artificial intelligence (AI) system for detection of urolithiasis in computed tomography (CT) images using advanced deep learning capable of real-time calculation of stone parameters such as volume and density, which are essential for treatment decisions. The performance of the system was compared to that of urologists in emergency room (ER) scenarios.</p><p><strong>Methods: </strong>Axial CT images for patients who underwent stone surgery between August 2022 and July 2023 comprised the data set, which was divided into 70% for training, 10% for internal validation, and 20% for testing. Two urologists and an AI specialist annotated stones using Labelimg for ground-truth data. The YOLOv4 architecture was used for training, with acceleration via an RTX 4900 graphics processing unit (GPU). External validation was performed using CT images for 100 patients with suspected urolithiasis.</p><p><strong>Key findings and limitations: </strong>The AI system was trained on 39 433 CT images, of which 9.1% were positive. The system achieved accuracy of 95%, peaking with a 1:2 positive-to-negative sample ratio. In a validation set of 5736 images (482 positive), accuracy remained at 95%. Misses (2.6%) were mainly irregular stones. False positives (3.4%) were often due to artifacts or calcifications. External validation using 100 CT images from the ER revealed accuracy of 94%; cases that were missed were mostly ureterovesical junction stones, which were not included in the training set. The AI system surpassed human specialists in speed, analyzing 150 CT images in 13 s, versus 38.6 s for evaluation by urologists and 23 h for formal reading. The AI system calculated stone volume in 0.2 s, versus 77 s for calculation by urologists.</p><p><strong>Conclusions and clinical implications: </strong>Our AI system, which uses advanced deep learning, assists in diagnosing urolithiasis with 94% accuracy in real clinical settings and has potential for rapid diagnosis using standard consumer-grade GPUs.</p><p><strong>Patient summary: </strong>We developed a new AI (artificial intelligence) system that can quickly and accurately detect kidney stones in CT (computed tomography) scans. Testing showed that this system is highly effective, with accuracy of 94% for real cases in the emergency department. It is much faster than traditional methods and provides rapid and reliable results to help doctors in making better treatment decisions for their patients.</p>","PeriodicalId":12160,"journal":{"name":"European urology focus","volume":" ","pages":""},"PeriodicalIF":4.8000,"publicationDate":"2024-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"European urology focus","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.euf.2024.07.003","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"UROLOGY & NEPHROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background and objective: Our aim was to develop an artificial intelligence (AI) system for detection of urolithiasis in computed tomography (CT) images using advanced deep learning capable of real-time calculation of stone parameters such as volume and density, which are essential for treatment decisions. The performance of the system was compared to that of urologists in emergency room (ER) scenarios.
Methods: Axial CT images for patients who underwent stone surgery between August 2022 and July 2023 comprised the data set, which was divided into 70% for training, 10% for internal validation, and 20% for testing. Two urologists and an AI specialist annotated stones using Labelimg for ground-truth data. The YOLOv4 architecture was used for training, with acceleration via an RTX 4900 graphics processing unit (GPU). External validation was performed using CT images for 100 patients with suspected urolithiasis.
Key findings and limitations: The AI system was trained on 39 433 CT images, of which 9.1% were positive. The system achieved accuracy of 95%, peaking with a 1:2 positive-to-negative sample ratio. In a validation set of 5736 images (482 positive), accuracy remained at 95%. Misses (2.6%) were mainly irregular stones. False positives (3.4%) were often due to artifacts or calcifications. External validation using 100 CT images from the ER revealed accuracy of 94%; cases that were missed were mostly ureterovesical junction stones, which were not included in the training set. The AI system surpassed human specialists in speed, analyzing 150 CT images in 13 s, versus 38.6 s for evaluation by urologists and 23 h for formal reading. The AI system calculated stone volume in 0.2 s, versus 77 s for calculation by urologists.
Conclusions and clinical implications: Our AI system, which uses advanced deep learning, assists in diagnosing urolithiasis with 94% accuracy in real clinical settings and has potential for rapid diagnosis using standard consumer-grade GPUs.
Patient summary: We developed a new AI (artificial intelligence) system that can quickly and accurately detect kidney stones in CT (computed tomography) scans. Testing showed that this system is highly effective, with accuracy of 94% for real cases in the emergency department. It is much faster than traditional methods and provides rapid and reliable results to help doctors in making better treatment decisions for their patients.
期刊介绍:
European Urology Focus is a new sister journal to European Urology and an official publication of the European Association of Urology (EAU).
EU Focus will publish original articles, opinion piece editorials and topical reviews on a wide range of urological issues such as oncology, functional urology, reconstructive urology, laparoscopy, robotic surgery, endourology, female urology, andrology, paediatric urology and sexual medicine. The editorial team welcome basic and translational research articles in the field of urological diseases. Authors may be solicited by the Editor directly. All submitted manuscripts will be peer-reviewed by a panel of experts before being considered for publication.