Development and International Evaluation of an Artificial Intelligence–based Model (PROGRxN-BCa) Using the World Health Organization 2004/2022 Grading System to Predict Progression Risk and Improve Substratification for Non–muscle-invasive Bladder Cancer
Jethro C.C. Kwong, Zizo Al-Daqqaq, Yashan Chelliahpillai, Soomin Lee, Kellie Kim, Maximiliano Ringa, Andrew Feifer, Katherine Lajkosz, Marian S. Wettstein, Amy Chan, Taeweon Lee, Myky Nguyen, Wassim Kassouf, Peter C. Black, Rodney H. Breau, Michele Lodde, Adrian Fairey, Jean-Baptiste Lattouf, Claudio Jeldres, Ricardo Rendon, Girish S. Kulkarni
{"title":"Development and International Evaluation of an Artificial Intelligence–based Model (PROGRxN-BCa) Using the World Health Organization 2004/2022 Grading System to Predict Progression Risk and Improve Substratification for Non–muscle-invasive Bladder Cancer","authors":"Jethro C.C. Kwong, Zizo Al-Daqqaq, Yashan Chelliahpillai, Soomin Lee, Kellie Kim, Maximiliano Ringa, Andrew Feifer, Katherine Lajkosz, Marian S. Wettstein, Amy Chan, Taeweon Lee, Myky Nguyen, Wassim Kassouf, Peter C. Black, Rodney H. Breau, Michele Lodde, Adrian Fairey, Jean-Baptiste Lattouf, Claudio Jeldres, Ricardo Rendon, Girish S. Kulkarni","doi":"10.1016/j.eururo.2025.09.4145","DOIUrl":null,"url":null,"abstract":"<h3>Background and objective</h3>Current non–muscle-invasive bladder cancer (NMIBC) tools perform suboptimally in predicting progression risk to potentially lethal muscle-invasive disease. We aimed to improve risk assessment using artificial intelligence approaches (PROGression Risk assessment in NMIBC [PROGRxN-BCa]).<h3>Methods</h3>PROGRxN-BCa was trained using 14 clinicopathological features on 3324 NMIBC patients treated from 2005 to 2022 at four Canadian institutions. External testing was performed on 9335 patients treated from 2005 to 2023 across 30 North American and European institutions. The primary outcome was time to progression (muscle-invasive or metastatic disease). PROGRxN-BCa was compared with the European Association of Urology (EAU) risk calculator. Performance was characterised using concordance index (c-index), calibration plots, instability assessments, decision curve analysis, and an algorithmic audit.<h3>Key findings and limitations</h3>During a median follow-up of 3.3 yr (interquartile range 1.6–5.8), 1405 of 12659 patients progressed. In the external testing cohort, PROGRxN-BCa had significantly higher c-index (0.79, 95% confidence interval [CI] 0.77–0.80) and net benefit overall and across different subgroups compared with the EAU risk calculator (0.71, 95% CI 0.70–0.73, <em>p</em> < 0.001). This improvement was consistent regardless of treatment with bacillus Calmette-Guérin, adherence to guideline-concordant care, and World Health Organization 1973 or 2004/2022 grading system, and was consistent among patients with at least 5 yr of follow-up. It also outperformed other guideline-endorsed tools and a previously published artificial intelligence model. Compared with guideline recommendations, PROGRxN-BCa improved substratification of intermediate-risk patients into distinct risk tertiles, with estimated 5-yr progression risks of 2%, 7%, and 15%—the latter in line with high-risk NMIBC.<h3>Conclusions and clinical implications</h3>PROGRxN-BCa outperformed current tools in the largest NMIBC cohort of its kind. Its integration into guidelines could improve risk stratification and patient management.","PeriodicalId":12223,"journal":{"name":"European urology","volume":"107 1","pages":""},"PeriodicalIF":25.2000,"publicationDate":"2025-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"European urology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.eururo.2025.09.4145","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"UROLOGY & NEPHROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background and objective
Current non–muscle-invasive bladder cancer (NMIBC) tools perform suboptimally in predicting progression risk to potentially lethal muscle-invasive disease. We aimed to improve risk assessment using artificial intelligence approaches (PROGression Risk assessment in NMIBC [PROGRxN-BCa]).
Methods
PROGRxN-BCa was trained using 14 clinicopathological features on 3324 NMIBC patients treated from 2005 to 2022 at four Canadian institutions. External testing was performed on 9335 patients treated from 2005 to 2023 across 30 North American and European institutions. The primary outcome was time to progression (muscle-invasive or metastatic disease). PROGRxN-BCa was compared with the European Association of Urology (EAU) risk calculator. Performance was characterised using concordance index (c-index), calibration plots, instability assessments, decision curve analysis, and an algorithmic audit.
Key findings and limitations
During a median follow-up of 3.3 yr (interquartile range 1.6–5.8), 1405 of 12659 patients progressed. In the external testing cohort, PROGRxN-BCa had significantly higher c-index (0.79, 95% confidence interval [CI] 0.77–0.80) and net benefit overall and across different subgroups compared with the EAU risk calculator (0.71, 95% CI 0.70–0.73, p < 0.001). This improvement was consistent regardless of treatment with bacillus Calmette-Guérin, adherence to guideline-concordant care, and World Health Organization 1973 or 2004/2022 grading system, and was consistent among patients with at least 5 yr of follow-up. It also outperformed other guideline-endorsed tools and a previously published artificial intelligence model. Compared with guideline recommendations, PROGRxN-BCa improved substratification of intermediate-risk patients into distinct risk tertiles, with estimated 5-yr progression risks of 2%, 7%, and 15%—the latter in line with high-risk NMIBC.
Conclusions and clinical implications
PROGRxN-BCa outperformed current tools in the largest NMIBC cohort of its kind. Its integration into guidelines could improve risk stratification and patient management.
期刊介绍:
European Urology is a peer-reviewed journal that publishes original articles and reviews on a broad spectrum of urological issues. Covering topics such as oncology, impotence, infertility, pediatrics, lithiasis and endourology, the journal also highlights recent advances in techniques, instrumentation, surgery, and pediatric urology. This comprehensive approach provides readers with an in-depth guide to international developments in urology.