Development and external validation of a clinical prediction model for new-onset atrial fibrillation in intensive care: a multicentre, retrospective cohort study.
Jonathan P Bedford, Oliver Redfern, Stephen Gerry, Robert Hatch, Liza Keating, David Clifton, Gary S Collins, Peter J Watkinson
{"title":"Development and external validation of a clinical prediction model for new-onset atrial fibrillation in intensive care: a multicentre, retrospective cohort study.","authors":"Jonathan P Bedford, Oliver Redfern, Stephen Gerry, Robert Hatch, Liza Keating, David Clifton, Gary S Collins, Peter J Watkinson","doi":"10.1016/j.landig.2025.100896","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>New-onset atrial fibrillation, a condition associated with adverse outcomes in the short and long term, is common in patients admitted to intensive care units (ICUs). Identifying patients at high risk could inform trials of preventive interventions and help to target such interventions. We aimed to develop and externally validate a prediction model for new-onset atrial fibrillation in patients admitted to ICUs.</p><p><strong>Methods: </strong>We conducted a multicentre, retrospective cohort study in three ICUs across the UK and four ICUs across the USA. Patients aged 16 years and older admitted to an ICU for more than 3 h without a history or presentation of clinically significant arrhythmia were eligible for inclusion. We analysed clinical variables to investigate the associations between predetermined candidate variables and risk of new-onset atrial fibrillation and to develop a model to estimate these risks. We developed the METRIC-AF model, a machine learning model incorporating dynamic variables. Model performance was assessed through internal-external cross-validation during model development and externally validated by use of multicentre data from ICUs across the UK. We then developed a simple graphical prediction tool using three important predictors.</p><p><strong>Findings: </strong>Among 39 084 eligible patients admitted to an ICU between 2008 and 2019, 2797 (7·2%) developed new-onset atrial fibrillation during the first 7 days of their ICU stay. We identified multiple non-linear associations between candidate variables and risk of new-onset atrial fibrillation, including hypomagnesaemia at serum concentrations below 0·70 mmol/L. The final METRIC-AF model contained ten routinely collected clinical variables. Compared with a published logistic regression model, the METRIC-AF model showed superior calibration, net benefit across clinically relevant risk thresholds, and discriminative performance (C statistic 0·812 [95% CI 0·805-0·822] vs 0·786 [0·778-0·801]; p=0·0003). The simple graphical tool performed well in attributing the risk of new-onset atrial fibrillation in the external validation dataset (C statistic 0·727 [95% CI 0·716-0·739]).</p><p><strong>Interpretation: </strong>The METRIC-AF model and its companion graphical tool could support the identification of patients at increased risk of developing new-onset atrial fibrillation during ICU admission, informing targeted prophylactic strategies and trial enrichment by use of routinely available clinical data. An online app also developed as part of the study allows for the exploration of prediction generation among individuals and external validation in prospective studies.</p><p><strong>Funding: </strong>National Institute for Health and Care Research (NIHR) and NIHR Oxford Biomedical Research Centre.</p>","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":" ","pages":"100896"},"PeriodicalIF":24.1000,"publicationDate":"2025-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Lancet Digital Health","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.landig.2025.100896","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICAL INFORMATICS","Score":null,"Total":0}
引用次数: 0
Abstract
Background: New-onset atrial fibrillation, a condition associated with adverse outcomes in the short and long term, is common in patients admitted to intensive care units (ICUs). Identifying patients at high risk could inform trials of preventive interventions and help to target such interventions. We aimed to develop and externally validate a prediction model for new-onset atrial fibrillation in patients admitted to ICUs.
Methods: We conducted a multicentre, retrospective cohort study in three ICUs across the UK and four ICUs across the USA. Patients aged 16 years and older admitted to an ICU for more than 3 h without a history or presentation of clinically significant arrhythmia were eligible for inclusion. We analysed clinical variables to investigate the associations between predetermined candidate variables and risk of new-onset atrial fibrillation and to develop a model to estimate these risks. We developed the METRIC-AF model, a machine learning model incorporating dynamic variables. Model performance was assessed through internal-external cross-validation during model development and externally validated by use of multicentre data from ICUs across the UK. We then developed a simple graphical prediction tool using three important predictors.
Findings: Among 39 084 eligible patients admitted to an ICU between 2008 and 2019, 2797 (7·2%) developed new-onset atrial fibrillation during the first 7 days of their ICU stay. We identified multiple non-linear associations between candidate variables and risk of new-onset atrial fibrillation, including hypomagnesaemia at serum concentrations below 0·70 mmol/L. The final METRIC-AF model contained ten routinely collected clinical variables. Compared with a published logistic regression model, the METRIC-AF model showed superior calibration, net benefit across clinically relevant risk thresholds, and discriminative performance (C statistic 0·812 [95% CI 0·805-0·822] vs 0·786 [0·778-0·801]; p=0·0003). The simple graphical tool performed well in attributing the risk of new-onset atrial fibrillation in the external validation dataset (C statistic 0·727 [95% CI 0·716-0·739]).
Interpretation: The METRIC-AF model and its companion graphical tool could support the identification of patients at increased risk of developing new-onset atrial fibrillation during ICU admission, informing targeted prophylactic strategies and trial enrichment by use of routinely available clinical data. An online app also developed as part of the study allows for the exploration of prediction generation among individuals and external validation in prospective studies.
Funding: National Institute for Health and Care Research (NIHR) and NIHR Oxford Biomedical Research Centre.
期刊介绍:
The Lancet Digital Health publishes important, innovative, and practice-changing research on any topic connected with digital technology in clinical medicine, public health, and global health.
The journal’s open access content crosses subject boundaries, building bridges between health professionals and researchers.By bringing together the most important advances in this multidisciplinary field,The Lancet Digital Health is the most prominent publishing venue in digital health.
We publish a range of content types including Articles,Review, Comment, and Correspondence, contributing to promoting digital technologies in health practice worldwide.