Mohammed Almubayyidh, Adrian R Parry-Jones, David A Jenkins
{"title":"Development and internal validation of prehospital prediction models for identifying intracerebral haemorrhage in suspected stroke patients.","authors":"Mohammed Almubayyidh, Adrian R Parry-Jones, David A Jenkins","doi":"10.1136/bmjno-2024-000878","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Distinguishing patients with intracerebral haemorrhage (ICH) from other suspected stroke cases in the prehospital setting is crucial for determining the appropriate level of care and minimising the onset-to-treatment time, thereby potentially improving outcomes. Therefore, we developed prehospital prediction models to identify patients with ICH among suspected stroke cases.</p><p><strong>Methods: </strong>Data were obtained from the Field Administration of Stroke Therapy-Magnesium prehospital stroke trial, where paramedics evaluated multiple variables in suspected stroke cases within the first 2 hours from the last known well time. A total of 19 candidate predictors were included to minimise overfitting and were subsequently refined through the backward exclusion of non-significant predictors. We used logistic regression and eXtreme Gradient Boosting (XGBoost) models to evaluate the performance of the predictors. Model performance was assessed using the area under the receiver operating characteristic curve (AUC), confusion matrix metrics and calibration measures. Additionally, models were internally validated and corrected for optimism through bootstrapping. Furthermore, a nomogram was built to facilitate paramedics in estimating the probability of ICH.</p><p><strong>Results: </strong>We analysed 1649 suspected stroke cases, of which 373 (23%) were finally diagnosed with ICH. From the 19 candidate predictors, 9 were identified as independently associated with ICH (p<0.05). Male sex, arm weakness, worsening neurological status and high systolic blood pressure were positively associated with ICH. Conversely, a history of hyperlipidaemia, atrial fibrillation, coronary artery disease, ischaemic stroke and improving neurological status were associated with other diagnoses. Both logistic regression and XGBoost demonstrated good calibration and predictive performance, with optimism-corrected sensitivities ranging from 47% to 49%, specificities from 89% to 90% and AUCs from 0.796 to 0.801.</p><p><strong>Conclusions: </strong>Our models demonstrate good predictive performance in distinguishing patients with ICH from other diagnoses, making them potentially useful tools for prehospital ICH management.</p>","PeriodicalId":52754,"journal":{"name":"BMJ Neurology Open","volume":null,"pages":null},"PeriodicalIF":2.1000,"publicationDate":"2024-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11529750/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMJ Neurology Open","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1136/bmjno-2024-000878","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q3","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Introduction: Distinguishing patients with intracerebral haemorrhage (ICH) from other suspected stroke cases in the prehospital setting is crucial for determining the appropriate level of care and minimising the onset-to-treatment time, thereby potentially improving outcomes. Therefore, we developed prehospital prediction models to identify patients with ICH among suspected stroke cases.
Methods: Data were obtained from the Field Administration of Stroke Therapy-Magnesium prehospital stroke trial, where paramedics evaluated multiple variables in suspected stroke cases within the first 2 hours from the last known well time. A total of 19 candidate predictors were included to minimise overfitting and were subsequently refined through the backward exclusion of non-significant predictors. We used logistic regression and eXtreme Gradient Boosting (XGBoost) models to evaluate the performance of the predictors. Model performance was assessed using the area under the receiver operating characteristic curve (AUC), confusion matrix metrics and calibration measures. Additionally, models were internally validated and corrected for optimism through bootstrapping. Furthermore, a nomogram was built to facilitate paramedics in estimating the probability of ICH.
Results: We analysed 1649 suspected stroke cases, of which 373 (23%) were finally diagnosed with ICH. From the 19 candidate predictors, 9 were identified as independently associated with ICH (p<0.05). Male sex, arm weakness, worsening neurological status and high systolic blood pressure were positively associated with ICH. Conversely, a history of hyperlipidaemia, atrial fibrillation, coronary artery disease, ischaemic stroke and improving neurological status were associated with other diagnoses. Both logistic regression and XGBoost demonstrated good calibration and predictive performance, with optimism-corrected sensitivities ranging from 47% to 49%, specificities from 89% to 90% and AUCs from 0.796 to 0.801.
Conclusions: Our models demonstrate good predictive performance in distinguishing patients with ICH from other diagnoses, making them potentially useful tools for prehospital ICH management.
导言:在院前环境中将脑内出血(ICH)患者与其他疑似卒中病例区分开来,对于确定适当的护理级别、最大限度地缩短发病到治疗的时间,从而改善预后至关重要。因此,我们开发了院前预测模型来识别疑似中风病例中的 ICH 患者:方法:数据来自 "卒中治疗现场管理-镁院前卒中试验",在该试验中,医护人员评估了疑似卒中病例从最后一次已知痊愈时间起 2 小时内的多个变量。共纳入了 19 个候选预测因子,以尽量减少过度拟合,随后通过反向排除非显著预测因子对其进行了改进。我们使用逻辑回归和梯度提升(XGBoost)模型来评估预测因子的性能。我们使用接收者工作特征曲线下面积(AUC)、混淆矩阵指标和校准测量来评估模型的性能。此外,还通过自举法对模型进行了内部验证和乐观校正。此外,我们还建立了一个提名图,以方便医护人员估计 ICH 的概率:结果:我们分析了 1649 例疑似中风病例,其中 373 例(23%)最终确诊为 ICH。在 19 个候选预测因子中,有 9 个被确定为与 ICH 独立相关(p结论:我们的模型在区分 ICH 患者和其他诊断方面表现出良好的预测性能,使其成为院前 ICH 管理的潜在有用工具。