Seung Hyo Lee, Won Pyo Hong, Joonghee Kim, Youngjin Cho, Eunkyoung Lee
{"title":"Smartphone AI vs. Medical Experts: A Comparative Study in Prehospital STEMI Diagnosis.","authors":"Seung Hyo Lee, Won Pyo Hong, Joonghee Kim, Youngjin Cho, Eunkyoung Lee","doi":"10.3349/ymj.2023.0341","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Prehospital telecardiology facilitates early ST-elevation myocardial infarction (STEMI) detection, yet its widespread implementation remains challenging. Extracting digital STEMI biomarkers from printed electrocardiograms (ECGs) using phone cameras could offer an affordable and scalable solution. This study assessed the feasibility of this approach with real-world prehospital ECGs.</p><p><strong>Materials and methods: </strong>Patients suspected of having STEMI by emergency medical technicians (EMTs) were identified from a policy research dataset. A deep learning-based ECG analyzer (QCG™ analyzer) extracted a STEMI biomarker (qSTEMI) from prehospital ECGs. The biomarker was compared to a group of human experts, including five emergency medical service directors (board-certified emergency physicians) and three interventional cardiologists based on their consensus score (number of participants answering \"yes\" for STEMI). Non-inferiority of the biomarker was tested using a 0.100 margin of difference in sensitivity and specificity.</p><p><strong>Results: </strong>Among 53 analyzed patients (24 STEMI, 45.3%), the area under the receiver operating characteristic curve of qSTEMI and consensus score were 0.815 (0.691-0.938) and 0.736 (0.594-0.879), respectively (<i>p</i>=0.081). Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of qSTEMI were 0.750 (0.583-0.917), 0.862 (0.690-0.966), 0.826 (0.679-0.955), and 0.813 (0.714-0.929), respectively. For the consensus score, sensitivity, specificity, PPV, and NPV were 0.708 (0.500-0.875), 0.793 (0.655-0.966), 0.750 (0.600-0.941), and 0.760 (0.655-0.880), respectively. The 95% confidence interval of sensitivity and specificity differences between qSTEMI and consensus score were 0.042 (-0.099-0.182) and 0.103 (-0.043-0.250), respectively, confirming qSTEMI's non-inferiority.</p><p><strong>Conclusion: </strong>The digital STEMI biomarker, derived from printed prehospital ECGs, demonstrated non-inferiority to expert consensus, indicating a promising approach for enhancing prehospital telecardiology.</p>","PeriodicalId":23765,"journal":{"name":"Yonsei Medical Journal","volume":"65 3","pages":"174-180"},"PeriodicalIF":2.6000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10896668/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Yonsei Medical Journal","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3349/ymj.2023.0341","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: Prehospital telecardiology facilitates early ST-elevation myocardial infarction (STEMI) detection, yet its widespread implementation remains challenging. Extracting digital STEMI biomarkers from printed electrocardiograms (ECGs) using phone cameras could offer an affordable and scalable solution. This study assessed the feasibility of this approach with real-world prehospital ECGs.
Materials and methods: Patients suspected of having STEMI by emergency medical technicians (EMTs) were identified from a policy research dataset. A deep learning-based ECG analyzer (QCG™ analyzer) extracted a STEMI biomarker (qSTEMI) from prehospital ECGs. The biomarker was compared to a group of human experts, including five emergency medical service directors (board-certified emergency physicians) and three interventional cardiologists based on their consensus score (number of participants answering "yes" for STEMI). Non-inferiority of the biomarker was tested using a 0.100 margin of difference in sensitivity and specificity.
Results: Among 53 analyzed patients (24 STEMI, 45.3%), the area under the receiver operating characteristic curve of qSTEMI and consensus score were 0.815 (0.691-0.938) and 0.736 (0.594-0.879), respectively (p=0.081). Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of qSTEMI were 0.750 (0.583-0.917), 0.862 (0.690-0.966), 0.826 (0.679-0.955), and 0.813 (0.714-0.929), respectively. For the consensus score, sensitivity, specificity, PPV, and NPV were 0.708 (0.500-0.875), 0.793 (0.655-0.966), 0.750 (0.600-0.941), and 0.760 (0.655-0.880), respectively. The 95% confidence interval of sensitivity and specificity differences between qSTEMI and consensus score were 0.042 (-0.099-0.182) and 0.103 (-0.043-0.250), respectively, confirming qSTEMI's non-inferiority.
Conclusion: The digital STEMI biomarker, derived from printed prehospital ECGs, demonstrated non-inferiority to expert consensus, indicating a promising approach for enhancing prehospital telecardiology.
期刊介绍：
The goal of the Yonsei Medical Journal (YMJ) is to publish high quality manuscripts dedicated to clinical or basic research. Any authors affiliated with an accredited biomedical institution may submit manuscripts of original articles, review articles, case reports, brief communications, and letters to the Editor.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
