Derivation and Validation of Thresholds Using Synthetic Data Methods for Single-Test Screening of Emergency Department Patients with Possible Acute Myocardial Infarction Using a Point-of-Care Troponin Assay.

IF 1.8 Q3 MEDICAL LABORATORY TECHNOLOGY
John W Pickering, Joanna M Young, Peter M George, Antony S Watson, Sally J Aldous, Toby Verryt, Richard W Troughton, Christopher J Pemberton, A Mark Richards, Louise A Cullen, Fred S Apple, Martin P Than
{"title":"Derivation and Validation of Thresholds Using Synthetic Data Methods for Single-Test Screening of Emergency Department Patients with Possible Acute Myocardial Infarction Using a Point-of-Care Troponin Assay.","authors":"John W Pickering, Joanna M Young, Peter M George, Antony S Watson, Sally J Aldous, Toby Verryt, Richard W Troughton, Christopher J Pemberton, A Mark Richards, Louise A Cullen, Fred S Apple, Martin P Than","doi":"10.1093/jalm/jfae001","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Single-sample (screening) rule-out of acute myocardial infarction (AMI) with troponin requires derivation of a single-test screening threshold. In data sets with small event numbers, the lowest one or two concentrations of myocardial infarction (MI) patients dictate the threshold. This is not optimal. We aimed to demonstrate a process incorporating both real and synthetic data for deriving such thresholds using a novel pre-production high-precision point-of-care assay.</p><p><strong>Methods: </strong>cTnI concentrations were measured from thawed plasma using the Troponin I Next (TnI-Nx) assay (i-STAT; Abbott) in adults on arrival to the emergency department with symptoms suggestive of AMI. The primary outcome was an AMI or cardiac death within 30 days. We used internal-external validation with synthetic data production based on clinical and demographic data, plus the measured TnI-Nx concentration, to derive and validate decision thresholds for TnI-Nx. The target low-risk threshold was a sensitivity of 99% and a high-risk threshold specificity of >95%.</p><p><strong>Results: </strong>In total, 1356 patients were included, of whom 191 (14.1%) had the primary outcome. A total of 500 synthetic data sets were constructed. The mean low-risk threshold was determined to be 5 ng/L. This categorized 38% (95% CI, 6%-68%) to low-risk with a sensitivity of 99.0% (95% CI, 98.6%-99.5%) and a negative predictive value of 99.4% (95% CI, 97.6%-99.8%). A similarly derived high-risk threshold of 25 ng/L had a specificity of 95.0% (95% CI, 94.8%-95.1%) and a positive predictive value of 74.8% (95% CI, 71.5%-78.0%).</p><p><strong>Conclusions: </strong>With the TnI-Nx assay, we successfully demonstrated an approach using synthetic data generation to derive low-risk thresholds for safe and effective screening.</p>","PeriodicalId":46361,"journal":{"name":"Journal of Applied Laboratory Medicine","volume":null,"pages":null},"PeriodicalIF":1.8000,"publicationDate":"2024-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Applied Laboratory Medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/jalm/jfae001","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MEDICAL LABORATORY TECHNOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Single-sample (screening) rule-out of acute myocardial infarction (AMI) with troponin requires derivation of a single-test screening threshold. In data sets with small event numbers, the lowest one or two concentrations of myocardial infarction (MI) patients dictate the threshold. This is not optimal. We aimed to demonstrate a process incorporating both real and synthetic data for deriving such thresholds using a novel pre-production high-precision point-of-care assay.

Methods: cTnI concentrations were measured from thawed plasma using the Troponin I Next (TnI-Nx) assay (i-STAT; Abbott) in adults on arrival to the emergency department with symptoms suggestive of AMI. The primary outcome was an AMI or cardiac death within 30 days. We used internal-external validation with synthetic data production based on clinical and demographic data, plus the measured TnI-Nx concentration, to derive and validate decision thresholds for TnI-Nx. The target low-risk threshold was a sensitivity of 99% and a high-risk threshold specificity of >95%.

Results: In total, 1356 patients were included, of whom 191 (14.1%) had the primary outcome. A total of 500 synthetic data sets were constructed. The mean low-risk threshold was determined to be 5 ng/L. This categorized 38% (95% CI, 6%-68%) to low-risk with a sensitivity of 99.0% (95% CI, 98.6%-99.5%) and a negative predictive value of 99.4% (95% CI, 97.6%-99.8%). A similarly derived high-risk threshold of 25 ng/L had a specificity of 95.0% (95% CI, 94.8%-95.1%) and a positive predictive value of 74.8% (95% CI, 71.5%-78.0%).

Conclusions: With the TnI-Nx assay, we successfully demonstrated an approach using synthetic data generation to derive low-risk thresholds for safe and effective screening.

使用床旁肌钙蛋白检测法对急诊科可能患有急性心肌梗死的患者进行单次检测筛查时,使用合成数据法推导和验证阈值。
背景:用肌钙蛋白单样本(筛查)排除急性心肌梗死(AMI)需要推导出一个单次检测筛查阈值。在事件数量较少的数据集中,心肌梗死(MI)患者中浓度最低的一两个人决定了阈值。这种方法并不理想。方法:使用肌钙蛋白 I Next (TnI-Nx)检测法(i-STAT;雅培)从解冻的血浆中测量成人的 cTnI 浓度,这些成人在到达急诊科时有急性心肌梗死的症状。主要结果是 30 天内发生急性心肌梗死或心源性死亡。我们利用基于临床和人口统计学数据以及测量的 TnI-Nx 浓度生成的合成数据进行了内部-外部验证,从而得出并验证了 TnI-Nx 的决策阈值。目标低风险阈值的灵敏度为 99%,高风险阈值的特异性大于 95%:共纳入 1356 例患者,其中 191 例(14.1%)有主要结果。共构建了 500 个合成数据集。平均低风险阈值被确定为 5 ng/L。这将 38% (95% CI,6%-68%)的患者归类为低风险,灵敏度为 99.0%(95% CI,98.6%-99.5%),阴性预测值为 99.4%(95% CI,97.6%-99.8%)。同样得出的 25 ng/L 高风险阈值的特异性为 95.0%(95% CI,94.8%-95.1%),阳性预测值为 74.8%(95% CI,71.5%-78.0%):通过 TnI-Nx 检测,我们成功地展示了一种利用合成数据生成的方法,从而得出安全有效筛查的低风险阈值。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Applied Laboratory Medicine
Journal of Applied Laboratory Medicine MEDICAL LABORATORY TECHNOLOGY-
CiteScore
3.70
自引率
5.00%
发文量
137
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信