Maren Maanja MD, PhD , Peter A. Noseworthy MD, FHRS , Jeffrey B. Geske MD , Michael J. Ackerman MD, PhD , Adelaide M. Arruda-Olson MD, PhD , Steve R. Ommen MD , Zachi I. Attia PhD , Paul A. Friedman MD, FHRS , Konstantinos C. Siontis MD, FHRS
{"title":"Tandem deep learning and logistic regression models to optimize hypertrophic cardiomyopathy detection in routine clinical practice","authors":"Maren Maanja MD, PhD , Peter A. Noseworthy MD, FHRS , Jeffrey B. Geske MD , Michael J. Ackerman MD, PhD , Adelaide M. Arruda-Olson MD, PhD , Steve R. Ommen MD , Zachi I. Attia PhD , Paul A. Friedman MD, FHRS , Konstantinos C. Siontis MD, FHRS","doi":"10.1016/j.cvdhj.2022.10.002","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>An electrocardiogram (ECG)-based artificial intelligence (AI) algorithm has shown good performance in detecting hypertrophic cardiomyopathy (HCM). However, its application in routine clinical practice may be challenging owing to the low disease prevalence and potentially high false-positive rates.</p></div><div><h3>Objective</h3><p>Identify clinical characteristics associated with true- and false-positive HCM AI-ECG results to improve its clinical application.</p></div><div><h3>Methods</h3><p>We reviewed the records of the 200 patients with highest HCM AI-ECG scores in January 2021 at our institution. Logistic regression was used to create a clinical variable–based “Candidacy for HCM Detection (HCM-DETECT)” score, differentiating true-positive from false-positive AI-ECG results. We validated the HCM-DETECT score in an independent cohort of 200 patients with the highest AI-ECG scores from January 2022.</p></div><div><h3>Results</h3><p>In the 2021 cohort (median age 71 [interquartile range 58–80] years, 48% female), the rates of true-positive, false-positive, and indeterminate AI-ECG results for HCM detection were 36%, 48%, and 16%, respectively. In the 2022 cohort, the rates were 26%, 47%, and 27%, respectively. The HCM-DETECT score included age, coronary artery disease, prior pacemaker, and prior cardiac valve surgery, and had an area under the receiver operating characteristic curve of 0.81 (95% confidence interval 0.73–0.87) for differentiating true- vs false-positive AI results. When the 2022 cohort was limited to HCM detection candidates identified with the HCM-DETECT score, the false-positive AI-ECG rate was reduced from 47% to 13.5%.</p></div><div><h3>Conclusion</h3><p>Application of a clinical score (HCM-DETECT) in tandem with an AI-ECG model improved HCM detection yield, reducing the false-positive rate of AI-ECG more than 3-fold.</p></div>","PeriodicalId":72527,"journal":{"name":"Cardiovascular digital health journal","volume":"3 6","pages":"Pages 289-296"},"PeriodicalIF":2.6000,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/fa/9d/main.PMC9795257.pdf","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cardiovascular digital health journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666693622001670","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CARDIAC & CARDIOVASCULAR SYSTEMS","Score":null,"Total":0}
引用次数: 1
Abstract
Background
An electrocardiogram (ECG)-based artificial intelligence (AI) algorithm has shown good performance in detecting hypertrophic cardiomyopathy (HCM). However, its application in routine clinical practice may be challenging owing to the low disease prevalence and potentially high false-positive rates.
Objective
Identify clinical characteristics associated with true- and false-positive HCM AI-ECG results to improve its clinical application.
Methods
We reviewed the records of the 200 patients with highest HCM AI-ECG scores in January 2021 at our institution. Logistic regression was used to create a clinical variable–based “Candidacy for HCM Detection (HCM-DETECT)” score, differentiating true-positive from false-positive AI-ECG results. We validated the HCM-DETECT score in an independent cohort of 200 patients with the highest AI-ECG scores from January 2022.
Results
In the 2021 cohort (median age 71 [interquartile range 58–80] years, 48% female), the rates of true-positive, false-positive, and indeterminate AI-ECG results for HCM detection were 36%, 48%, and 16%, respectively. In the 2022 cohort, the rates were 26%, 47%, and 27%, respectively. The HCM-DETECT score included age, coronary artery disease, prior pacemaker, and prior cardiac valve surgery, and had an area under the receiver operating characteristic curve of 0.81 (95% confidence interval 0.73–0.87) for differentiating true- vs false-positive AI results. When the 2022 cohort was limited to HCM detection candidates identified with the HCM-DETECT score, the false-positive AI-ECG rate was reduced from 47% to 13.5%.
Conclusion
Application of a clinical score (HCM-DETECT) in tandem with an AI-ECG model improved HCM detection yield, reducing the false-positive rate of AI-ECG more than 3-fold.