Matthew S Goldberg, Clay J Cockerell, Jason H Rogers, Jennifer J Siegel, Brooke H Russell, Gregory A Hosler, Etan Marks
{"title":"Appropriate Statistical Methods to Assess Cross-study Diagnostic 23-Gene Expression Profile Test Performance for Cutaneous Melanocytic Neoplasms.","authors":"Matthew S Goldberg, Clay J Cockerell, Jason H Rogers, Jennifer J Siegel, Brooke H Russell, Gregory A Hosler, Etan Marks","doi":"10.1097/DAD.0000000000002808","DOIUrl":null,"url":null,"abstract":"<p><strong>Abstract: </strong>Comparing studies of molecular ancillary diagnostic tests for difficult-to-diagnose cutaneous melanocytic neoplasms presents a methodological challenge, given the disparate ways accuracy metrics are calculated. A recent report by Boothby-Shoemaker et al investigating the real-world accuracy of the 23-gene expression profile (23-GEP) test highlights this methodological difficulty, reporting lower accuracy than previously observed. However, their calculation method-with indeterminate test results defined as either false positive or false negative-was different than those used in previous studies. We corrected for these differences and recalculated their reported accuracy metrics in the same manner as the previous studies to enable appropriate comparison with previously published reports. This corrected analysis showed a sensitivity of 92.1% (95% confidence interval [CI], 82.1%-100%) and specificity of 94.4% (91.6%-96.9%). We then compared these results directly to previous studies with >25 benign and >25 malignant cases with outcomes and/or concordant histopathological diagnosis by ≥3 dermatopathologists. All studies assessed had enrollment imbalances of benign versus malignant patients (0.8-7.0 ratio), so balanced cohorts were resampled according to the lowest common denominator to calculate point estimates and CIs for accuracy metrics. Overall, we found no statistically significant differences in the ranges of 23-GEP sensitivity, 90.4%-96.3% (95% CI, 80.8%-100%), specificity, 87.3%-96.2% (78.2%-100%), positive predictive value, 88.5%-96.1% (81.5%-100%), or negative predictive value, 91.1%-96.3% (83.6%-100%) between previous studies and the cohort from Boothby-Shoemaker et al with this unified methodological approach. Rigorous standardization of calculation methods is necessary when the goal is direct cross-study comparability.</p>","PeriodicalId":50967,"journal":{"name":"American Journal of Dermatopathology","volume":null,"pages":null},"PeriodicalIF":1.1000,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American Journal of Dermatopathology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/DAD.0000000000002808","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"DERMATOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract: Comparing studies of molecular ancillary diagnostic tests for difficult-to-diagnose cutaneous melanocytic neoplasms presents a methodological challenge, given the disparate ways accuracy metrics are calculated. A recent report by Boothby-Shoemaker et al investigating the real-world accuracy of the 23-gene expression profile (23-GEP) test highlights this methodological difficulty, reporting lower accuracy than previously observed. However, their calculation method-with indeterminate test results defined as either false positive or false negative-was different than those used in previous studies. We corrected for these differences and recalculated their reported accuracy metrics in the same manner as the previous studies to enable appropriate comparison with previously published reports. This corrected analysis showed a sensitivity of 92.1% (95% confidence interval [CI], 82.1%-100%) and specificity of 94.4% (91.6%-96.9%). We then compared these results directly to previous studies with >25 benign and >25 malignant cases with outcomes and/or concordant histopathological diagnosis by ≥3 dermatopathologists. All studies assessed had enrollment imbalances of benign versus malignant patients (0.8-7.0 ratio), so balanced cohorts were resampled according to the lowest common denominator to calculate point estimates and CIs for accuracy metrics. Overall, we found no statistically significant differences in the ranges of 23-GEP sensitivity, 90.4%-96.3% (95% CI, 80.8%-100%), specificity, 87.3%-96.2% (78.2%-100%), positive predictive value, 88.5%-96.1% (81.5%-100%), or negative predictive value, 91.1%-96.3% (83.6%-100%) between previous studies and the cohort from Boothby-Shoemaker et al with this unified methodological approach. Rigorous standardization of calculation methods is necessary when the goal is direct cross-study comparability.
期刊介绍:
The American Journal of Dermatopathology offers outstanding coverage of the latest diagnostic approaches and laboratory techniques, as well as insights into contemporary social, legal, and ethical concerns. Each issue features review articles on clinical, technical, and basic science advances and illuminating, detailed case reports.
With the The American Journal of Dermatopathology you''ll be able to:
-Incorporate step-by-step coverage of new or difficult-to-diagnose conditions from their earliest histopathologic signs to confirmatory immunohistochemical and molecular studies.
-Apply the latest basic science findings and clinical approaches to your work right away.
-Tap into the skills and expertise of your peers and colleagues the world over peer-reviewed original articles, "Extraordinary cases reports", coverage of practical guidelines, and graphic presentations.
-Expand your horizons through the Journal''s idea-generating forum for debating controversial issues and learning from preeminent researchers and clinicians