{"title":"Prospective Validation of a Suicide Event Risk Model in Transgender Patients.","authors":"Robert A Becker, Colin G Walsh","doi":"","DOIUrl":null,"url":null,"abstract":"<p><p>Suicide risk prediction models offer a promising avenue for early intervention, but their effectiveness in underrepresented populations remain uncertain. This study evaluated VSAIL's, a real-world, externally validated, and deployed suicide risk prediction model, performance in predicting suicide risk among transgender individuals. Transgender individuals were identified from electronic health record data and transgender status was verified via manual chart review. Results indicated modest discriminative ability (AUROC=0.777, AUPRC=0.115), however, a high rate of false negatives (77%), and significant miscalibration (Brier=0.023, Spiegelhalter's z-statistic p<0.001) reduced clinical utility. Findings underscore the importance of targeted subgroup validation and highlight limitations of general population-trained models in accurately identifying suicide risk among transgender patients. They also suggest the need for ongoing algorithm monitoring and subgroup-aware modeling strategies to improve predictive equity in marginalized populations.</p>","PeriodicalId":72180,"journal":{"name":"AMIA ... Annual Symposium proceedings. AMIA Symposium","volume":"2024 ","pages":"196-201"},"PeriodicalIF":0.0000,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12919586/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"AMIA ... Annual Symposium proceedings. AMIA Symposium","FirstCategoryId":"1085","ListUrlMain":"","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Suicide risk prediction models offer a promising avenue for early intervention, but their effectiveness in underrepresented populations remain uncertain. This study evaluated VSAIL's, a real-world, externally validated, and deployed suicide risk prediction model, performance in predicting suicide risk among transgender individuals. Transgender individuals were identified from electronic health record data and transgender status was verified via manual chart review. Results indicated modest discriminative ability (AUROC=0.777, AUPRC=0.115), however, a high rate of false negatives (77%), and significant miscalibration (Brier=0.023, Spiegelhalter's z-statistic p<0.001) reduced clinical utility. Findings underscore the importance of targeted subgroup validation and highlight limitations of general population-trained models in accurately identifying suicide risk among transgender patients. They also suggest the need for ongoing algorithm monitoring and subgroup-aware modeling strategies to improve predictive equity in marginalized populations.