K Villringer, R Sokiranski, R Opfer, L Spies, M Hamann, A Bormann, M Brehmer, I Galinovic, J B Fiebach
{"title":"融入临床工作流程的人工智能算法可确保高质量的急性颅内出血 CT 诊断。","authors":"K Villringer, R Sokiranski, R Opfer, L Spies, M Hamann, A Bormann, M Brehmer, I Galinovic, J B Fiebach","doi":"10.1007/s00062-024-01461-9","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Intracranial hemorrhage (ICH) is a life-threatening condition requiring rapid diagnostic and therapeutic action. This study evaluates whether Artificial intelligence (AI) can provide high-quality ICH diagnostics and turnaround times suitable for routine radiological practice.</p><p><strong>Methods: </strong>A convolutional neural network (CNN) was trained and validated to detect ICHs on DICOM images of cranial CT (CCT) scans, utilizing about 674,000 individually labeled slices. The CNN was then incorporated into a commercial AI engine and seamlessly integrated into three pilot centers in Germany. A real-world test-dataset was extracted and manually annotated by two experienced experts. The performance of the AI algorithm against the two raters was assessed and compared to the inter-rater agreement. The overall time ranging from data acquisition to the delivery of the AI results was analyzed.</p><p><strong>Results: </strong>Out of 6284 CCT examinations acquired in three different centers, 947 (15%) had ICH. Breakdowns of hemorrhage types included 8% intraparenchymal, 3% intraventricular, 6% subarachnoidal, 7% subdural, < 1% epidural hematomas. Comparing the AI's performance on a subset of 255 patients with two expert raters, it achieved a sensitivity of 0.90, a specificity of 0.96, an accuracy of 0.96. The corresponding inter-rater agreement was 0.84, 0.98, and 0.96. The overall median processing times for the three centers were 9, 11, and 12 min, respectively.</p><p><strong>Conclusion: </strong>We showed that an AI algorithm for the automatic detection of ICHs can be seamlessly integrated into clinical workflows with minimal turnaround time. The accuracy was on par with radiology experts, making the system suitable for routine clinical use.</p>","PeriodicalId":10391,"journal":{"name":"Clinical Neuroradiology","volume":" ","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2024-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Artificial Intelligence Algorithm Integrated into the Clinical Workflow Can Ensure High Quality Acute Intracranial Hemorrhage CT Diagnostic.\",\"authors\":\"K Villringer, R Sokiranski, R Opfer, L Spies, M Hamann, A Bormann, M Brehmer, I Galinovic, J B Fiebach\",\"doi\":\"10.1007/s00062-024-01461-9\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>Intracranial hemorrhage (ICH) is a life-threatening condition requiring rapid diagnostic and therapeutic action. This study evaluates whether Artificial intelligence (AI) can provide high-quality ICH diagnostics and turnaround times suitable for routine radiological practice.</p><p><strong>Methods: </strong>A convolutional neural network (CNN) was trained and validated to detect ICHs on DICOM images of cranial CT (CCT) scans, utilizing about 674,000 individually labeled slices. The CNN was then incorporated into a commercial AI engine and seamlessly integrated into three pilot centers in Germany. A real-world test-dataset was extracted and manually annotated by two experienced experts. The performance of the AI algorithm against the two raters was assessed and compared to the inter-rater agreement. The overall time ranging from data acquisition to the delivery of the AI results was analyzed.</p><p><strong>Results: </strong>Out of 6284 CCT examinations acquired in three different centers, 947 (15%) had ICH. Breakdowns of hemorrhage types included 8% intraparenchymal, 3% intraventricular, 6% subarachnoidal, 7% subdural, < 1% epidural hematomas. Comparing the AI's performance on a subset of 255 patients with two expert raters, it achieved a sensitivity of 0.90, a specificity of 0.96, an accuracy of 0.96. The corresponding inter-rater agreement was 0.84, 0.98, and 0.96. The overall median processing times for the three centers were 9, 11, and 12 min, respectively.</p><p><strong>Conclusion: </strong>We showed that an AI algorithm for the automatic detection of ICHs can be seamlessly integrated into clinical workflows with minimal turnaround time. The accuracy was on par with radiology experts, making the system suitable for routine clinical use.</p>\",\"PeriodicalId\":10391,\"journal\":{\"name\":\"Clinical Neuroradiology\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2024-09-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Clinical Neuroradiology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1007/s00062-024-01461-9\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"Medicine\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Neuroradiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00062-024-01461-9","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0
摘要
目的:颅内出血(ICH)是一种危及生命的疾病,需要快速诊断和治疗。本研究评估了人工智能(AI)能否提供高质量的 ICH 诊断和适合常规放射实践的周转时间:方法:对卷积神经网络(CNN)进行了训练和验证,以利用约 674,000 个单独标记的切片在头颅 CT(CCT)扫描的 DICOM 图像上检测 ICH。然后,CNN 被集成到一个商业人工智能引擎中,并无缝集成到德国的三个试点中心。两个经验丰富的专家提取了真实世界的测试数据集,并进行了人工标注。评估了人工智能算法在两位评分者面前的表现,并与评分者之间的一致性进行了比较。分析了从数据采集到提供人工智能结果的整个时间范围:在三个不同中心采集的 6284 例 CCT 检查中,947 例(15%)有 ICH。出血类型的分类包括:8%实质内出血、3%脑室内出血、6%蛛网膜下腔出血、7%硬膜下出血:我们的研究表明,用于自动检测 ICH 的人工智能算法可以无缝集成到临床工作流程中,而且周转时间极短。其准确性与放射科专家不相上下,因此该系统适合常规临床使用。
An Artificial Intelligence Algorithm Integrated into the Clinical Workflow Can Ensure High Quality Acute Intracranial Hemorrhage CT Diagnostic.
Purpose: Intracranial hemorrhage (ICH) is a life-threatening condition requiring rapid diagnostic and therapeutic action. This study evaluates whether Artificial intelligence (AI) can provide high-quality ICH diagnostics and turnaround times suitable for routine radiological practice.
Methods: A convolutional neural network (CNN) was trained and validated to detect ICHs on DICOM images of cranial CT (CCT) scans, utilizing about 674,000 individually labeled slices. The CNN was then incorporated into a commercial AI engine and seamlessly integrated into three pilot centers in Germany. A real-world test-dataset was extracted and manually annotated by two experienced experts. The performance of the AI algorithm against the two raters was assessed and compared to the inter-rater agreement. The overall time ranging from data acquisition to the delivery of the AI results was analyzed.
Results: Out of 6284 CCT examinations acquired in three different centers, 947 (15%) had ICH. Breakdowns of hemorrhage types included 8% intraparenchymal, 3% intraventricular, 6% subarachnoidal, 7% subdural, < 1% epidural hematomas. Comparing the AI's performance on a subset of 255 patients with two expert raters, it achieved a sensitivity of 0.90, a specificity of 0.96, an accuracy of 0.96. The corresponding inter-rater agreement was 0.84, 0.98, and 0.96. The overall median processing times for the three centers were 9, 11, and 12 min, respectively.
Conclusion: We showed that an AI algorithm for the automatic detection of ICHs can be seamlessly integrated into clinical workflows with minimal turnaround time. The accuracy was on par with radiology experts, making the system suitable for routine clinical use.
期刊介绍:
Clinical Neuroradiology provides current information, original contributions, and reviews in the field of neuroradiology. An interdisciplinary approach is accomplished by diagnostic and therapeutic contributions related to associated subjects.
The international coverage and relevance of the journal is underlined by its being the official journal of the German, Swiss, and Austrian Societies of Neuroradiology.