DxGoals:DxGoals: A Software Tool for Determining and Analyzing Clinically Meaningful Classification Accuracy Goals for Diagnostic Tests.

IF 1.8 Q3 MEDICAL LABORATORY TECHNOLOGY
Ngoc-Ty Nguyen, Gene A Pennello
{"title":"DxGoals:DxGoals: A Software Tool for Determining and Analyzing Clinically Meaningful Classification Accuracy Goals for Diagnostic Tests.","authors":"Ngoc-Ty Nguyen, Gene A Pennello","doi":"10.1093/jalm/jfae054","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>To evaluate diagnostic tests for low prevalence conditions, classification accuracy metrics such as sensitivity, specificity, and positive likelihood ratio (PLR) and negative likelihood ratio (NLR) are advantageous because they are prevalence-independent and thus estimable in studies enriched for the condition. However, classification accuracy goals are often chosen without a clear understanding of whether they are clinically meaningful. Pennello (2021) proposed a risk stratification framework for determining classification accuracy goals. A software application is needed to determine the goals and provide data analysis.</p><p><strong>Methods: </strong>We introduce DxGoals, a freely available, R-Shiny software application for determining, visualizing, and analyzing classification accuracy goals for diagnostic tests. Given prevalence p for the target condition and specification that a test's positive and negative predictive values PPVand NPV=1-cNPV should satisfy PPV>PPV* and cNPV<cNPV*, DxGoals uses Bayes Theorem to determine equivalent goals for PLR and NLR and implied goals for sensitivity and specificity. When study data are provided, DxGoals analyzes whether the determined goals are met with statistical significance. When comparing 2 tests, DxGoals translates a superiority or noninferiority goals for the differences PPV-p and p-cNPV to equivalent goals for PLR and NLR and analyzes the goals when data are provided.</p><p><strong>Results: </strong>We illustrate DxGoals on tests for penicillin allergy, ovarian cancer, and cervical cancer. The inputs cNPV*,p, and PPV* were informed by clinical management guidelines.</p><p><strong>Conclusions: </strong>DxGoals facilitates determination, visualization, and analysis of clinically meaningful standalone and comparative classification accuracy goals. It is a potentially useful tool for diagnostic test evaluation.</p>","PeriodicalId":46361,"journal":{"name":"Journal of Applied Laboratory Medicine","volume":null,"pages":null},"PeriodicalIF":1.8000,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DxGoals: A Software Tool for Determining and Analyzing Clinically Meaningful Classification Accuracy Goals for Diagnostic Tests.\",\"authors\":\"Ngoc-Ty Nguyen, Gene A Pennello\",\"doi\":\"10.1093/jalm/jfae054\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>To evaluate diagnostic tests for low prevalence conditions, classification accuracy metrics such as sensitivity, specificity, and positive likelihood ratio (PLR) and negative likelihood ratio (NLR) are advantageous because they are prevalence-independent and thus estimable in studies enriched for the condition. However, classification accuracy goals are often chosen without a clear understanding of whether they are clinically meaningful. Pennello (2021) proposed a risk stratification framework for determining classification accuracy goals. A software application is needed to determine the goals and provide data analysis.</p><p><strong>Methods: </strong>We introduce DxGoals, a freely available, R-Shiny software application for determining, visualizing, and analyzing classification accuracy goals for diagnostic tests. Given prevalence p for the target condition and specification that a test's positive and negative predictive values PPVand NPV=1-cNPV should satisfy PPV>PPV* and cNPV<cNPV*, DxGoals uses Bayes Theorem to determine equivalent goals for PLR and NLR and implied goals for sensitivity and specificity. When study data are provided, DxGoals analyzes whether the determined goals are met with statistical significance. When comparing 2 tests, DxGoals translates a superiority or noninferiority goals for the differences PPV-p and p-cNPV to equivalent goals for PLR and NLR and analyzes the goals when data are provided.</p><p><strong>Results: </strong>We illustrate DxGoals on tests for penicillin allergy, ovarian cancer, and cervical cancer. The inputs cNPV*,p, and PPV* were informed by clinical management guidelines.</p><p><strong>Conclusions: </strong>DxGoals facilitates determination, visualization, and analysis of clinically meaningful standalone and comparative classification accuracy goals. It is a potentially useful tool for diagnostic test evaluation.</p>\",\"PeriodicalId\":46361,\"journal\":{\"name\":\"Journal of Applied Laboratory Medicine\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2024-09-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Applied Laboratory Medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1093/jalm/jfae054\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"MEDICAL LABORATORY TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Applied Laboratory Medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/jalm/jfae054","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MEDICAL LABORATORY TECHNOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

背景:在评估低流行率疾病的诊断检测时,灵敏度、特异性、阳性似然比(PLR)和阴性似然比(NLR)等分类准确性指标很有优势,因为这些指标与流行率无关,因此可在丰富的疾病研究中进行估计。然而,在选择分类准确性目标时,往往并不清楚这些目标是否具有临床意义。Pennello(2021 年)提出了一个用于确定分类准确性目标的风险分层框架。我们需要一款应用软件来确定目标并提供数据分析:我们介绍 DxGoals,这是一款免费提供的 R-Shiny 应用软件,用于确定、可视化和分析诊断测试的分类准确性目标。给定目标病症的流行率 p,并规定检验的阳性预测值 PPV 和阴性预测值 NPV=1-cNPV 应满足 PPV>PPV* 和 cNPVResults:我们以青霉素过敏、卵巢癌和宫颈癌检测为例说明 DxGoals。输入的 cNPV*、p 和 PPV* 均参考了临床管理指南:DxGoals有助于确定、可视化和分析具有临床意义的独立和比较分类准确性目标。结论:DxGoals 便于确定、可视化和分析具有临床意义的独立和比较分类准确性目标,是诊断测试评估的潜在有用工具。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
DxGoals: A Software Tool for Determining and Analyzing Clinically Meaningful Classification Accuracy Goals for Diagnostic Tests.

Background: To evaluate diagnostic tests for low prevalence conditions, classification accuracy metrics such as sensitivity, specificity, and positive likelihood ratio (PLR) and negative likelihood ratio (NLR) are advantageous because they are prevalence-independent and thus estimable in studies enriched for the condition. However, classification accuracy goals are often chosen without a clear understanding of whether they are clinically meaningful. Pennello (2021) proposed a risk stratification framework for determining classification accuracy goals. A software application is needed to determine the goals and provide data analysis.

Methods: We introduce DxGoals, a freely available, R-Shiny software application for determining, visualizing, and analyzing classification accuracy goals for diagnostic tests. Given prevalence p for the target condition and specification that a test's positive and negative predictive values PPVand NPV=1-cNPV should satisfy PPV>PPV* and cNPV

Results: We illustrate DxGoals on tests for penicillin allergy, ovarian cancer, and cervical cancer. The inputs cNPV*,p, and PPV* were informed by clinical management guidelines.

Conclusions: DxGoals facilitates determination, visualization, and analysis of clinically meaningful standalone and comparative classification accuracy goals. It is a potentially useful tool for diagnostic test evaluation.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Applied Laboratory Medicine
Journal of Applied Laboratory Medicine MEDICAL LABORATORY TECHNOLOGY-
CiteScore
3.70
自引率
5.00%
发文量
137
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信