External validation and refinement of the Psychosis Polyrisk Score to detect individuals at clinical high risk for psychosis.

IF 6.6 0 PSYCHIATRY
Riccardo Stefanelli, Dominic Oliver, Stefano Damiani, Marika Orlandi, Umberto Provenzani, Elisa Bortolin, Margherita Rovida, Jean Addington, Luis Alameda, Celso Arango, Nicholas J Breitborde, Matthew Broome, Kristin S Cadenhead, Monica E Calkins, Ricardo E Carrion, Rolando I Castillo-Passi, Yu Hai Eric Chen, Jimmy Choi, Philippe Conus, Barbara A Cornblatt, Covadonga M Díaz-Caneja, Lauren M Ellman, Pablo A Gaspar, Carla Gerber, Louise Birkedal Glenthøj, Leslie E Horton, Christy Lm Hui, Joseph Kambeitz, Lana Kambeitz-Ilankovic, Matcheri S Keshavan, Minah Kim, Sung-Wan Kim, Nikolaos Koutsouleris, Jun Soo Kwon, Kerstin Langbein, Daniel Mamah, Daniel H Mathalon, Vijay A Mittal, Meredete Nordentoft, Godfrey D Pearlson, Nora Penzel, Jesus Perez, Diana O Perkins, Albert R Powers, Jack R Rogers, Fred W Sabb, Jason Schiffman, Jai Shah, Steven M Silverstein, Stefan Smesny, William S Stone, Gregory P Strauss, Judy L Thompson, Rachel Upthegrove, Swapna Verma, Jijun Wang, Daniel H Wolf, TianHong Zhang, Sylvain Bouix, Cheryl M Corcoran, Tina Kapur, Ofer Pasternak, Carrie Bearden, Rene S Kahn, John M Kane, Patrick D McGorry, Barnaby Nelson, Martha E Shenton, Scott W Woods, Paolo Fusar-Poli
{"title":"External validation and refinement of the Psychosis Polyrisk Score to detect individuals at clinical high risk for psychosis.","authors":"Riccardo Stefanelli, Dominic Oliver, Stefano Damiani, Marika Orlandi, Umberto Provenzani, Elisa Bortolin, Margherita Rovida, Jean Addington, Luis Alameda, Celso Arango, Nicholas J Breitborde, Matthew Broome, Kristin S Cadenhead, Monica E Calkins, Ricardo E Carrion, Rolando I Castillo-Passi, Yu Hai Eric Chen, Jimmy Choi, Philippe Conus, Barbara A Cornblatt, Covadonga M Díaz-Caneja, Lauren M Ellman, Pablo A Gaspar, Carla Gerber, Louise Birkedal Glenthøj, Leslie E Horton, Christy Lm Hui, Joseph Kambeitz, Lana Kambeitz-Ilankovic, Matcheri S Keshavan, Minah Kim, Sung-Wan Kim, Nikolaos Koutsouleris, Jun Soo Kwon, Kerstin Langbein, Daniel Mamah, Daniel H Mathalon, Vijay A Mittal, Meredete Nordentoft, Godfrey D Pearlson, Nora Penzel, Jesus Perez, Diana O Perkins, Albert R Powers, Jack R Rogers, Fred W Sabb, Jason Schiffman, Jai Shah, Steven M Silverstein, Stefan Smesny, William S Stone, Gregory P Strauss, Judy L Thompson, Rachel Upthegrove, Swapna Verma, Jijun Wang, Daniel H Wolf, TianHong Zhang, Sylvain Bouix, Cheryl M Corcoran, Tina Kapur, Ofer Pasternak, Carrie Bearden, Rene S Kahn, John M Kane, Patrick D McGorry, Barnaby Nelson, Martha E Shenton, Scott W Woods, Paolo Fusar-Poli","doi":"10.1136/bmjment-2026-302838","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The Psychosis Polyrisk Score (PPS) was developed to characterise exposure to environmental and developmental risk factors for psychosis. In previous studies, the PPS showed promise particularly in discriminating between individuals at clinical high risk for psychosis (CHR-P) and community controls (CC).</p><p><strong>Objectives: </strong>This study aimed to (1) perform an external validation of the PPS model in a large independent sample and (2) refine the model using expanded predictor data.</p><p><strong>Methods: </strong>Participants were recruited through the AMP SCZ program: n=1642 CHR-P, n=519 CC. We performed a formal external validation of the PPS original model. The model was then refined incorporating expanded predictor data (perceived loneliness, neighbourhood quality) and increasing the granularity of existing predictors (ethnicity, childhood trauma, parental severe mental illness). Next, we evaluated the refined model through repeated nested cross-validation and compared it to the original model retrained in the new dataset. Discrimination (Harrell's C-index) and calibration (intercept and slope) were used to assess model performance.</p><p><strong>Findings: </strong>The externally validated PPS original model showed good discrimination (C=0.777, 95% CI 0.756 to 0.797) between CHR-P and CC and good calibration (intercept=0; slope=1.003) after recalibration. The refined PPS model exhibited higher internally cross-validated discrimination than the retrained original model (C=0.876, 95% CI 0.860 to 0.891 vs C=0.796, 95% CI 0.775 to 0.816), as well as good calibration performance (intercept=-0.008; slope=1.031).</p><p><strong>Conclusions: </strong>The PPS showed good generalisability to a large, independent sample, and performance improved after model refinement.</p><p><strong>Clinical implications: </strong>The PPS represents a potential scalable tool within stepped assessment frameworks for identifying individuals who warrant further CHR-P assessment.</p><p><strong>Trial registration number: </strong>NCT05905003.</p>","PeriodicalId":72434,"journal":{"name":"BMJ mental health","volume":"29 1","pages":""},"PeriodicalIF":6.6000,"publicationDate":"2026-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13629901/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMJ mental health","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1136/bmjment-2026-302838","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"PSYCHIATRY","Score":null,"Total":0}
引用次数: 0

Abstract

Background: The Psychosis Polyrisk Score (PPS) was developed to characterise exposure to environmental and developmental risk factors for psychosis. In previous studies, the PPS showed promise particularly in discriminating between individuals at clinical high risk for psychosis (CHR-P) and community controls (CC).

Objectives: This study aimed to (1) perform an external validation of the PPS model in a large independent sample and (2) refine the model using expanded predictor data.

Methods: Participants were recruited through the AMP SCZ program: n=1642 CHR-P, n=519 CC. We performed a formal external validation of the PPS original model. The model was then refined incorporating expanded predictor data (perceived loneliness, neighbourhood quality) and increasing the granularity of existing predictors (ethnicity, childhood trauma, parental severe mental illness). Next, we evaluated the refined model through repeated nested cross-validation and compared it to the original model retrained in the new dataset. Discrimination (Harrell's C-index) and calibration (intercept and slope) were used to assess model performance.

Findings: The externally validated PPS original model showed good discrimination (C=0.777, 95% CI 0.756 to 0.797) between CHR-P and CC and good calibration (intercept=0; slope=1.003) after recalibration. The refined PPS model exhibited higher internally cross-validated discrimination than the retrained original model (C=0.876, 95% CI 0.860 to 0.891 vs C=0.796, 95% CI 0.775 to 0.816), as well as good calibration performance (intercept=-0.008; slope=1.031).

Conclusions: The PPS showed good generalisability to a large, independent sample, and performance improved after model refinement.

Clinical implications: The PPS represents a potential scalable tool within stepped assessment frameworks for identifying individuals who warrant further CHR-P assessment.

Trial registration number: NCT05905003.

外部验证和完善精神病多重风险评分,以检测临床精神病高风险个体。
背景:精神病多重风险评分(PPS)是用来描述暴露于精神病的环境和发育风险因素的特征。在之前的研究中,PPS尤其在区分临床精神病高危人群(chrp)和社区对照组(CC)方面表现出了希望。目的:本研究旨在(1)在一个大的独立样本中对PPS模型进行外部验证,(2)使用扩展的预测数据来完善模型。方法:通过AMP SCZ程序招募参与者:n=1642 chrp, n=519 CC。我们对PPS原始模型进行了正式的外部验证。然后,将扩展的预测数据(感知孤独、社区质量)纳入模型,并增加现有预测数据(种族、童年创伤、父母严重精神疾病)的粒度,对模型进行了改进。接下来,我们通过重复嵌套交叉验证来评估改进后的模型,并将其与在新数据集中重新训练的原始模型进行比较。判别(Harrell’sc指数)和校准(截距和斜率)被用来评估模型的性能。结果:外部验证的PPS原始模型在chrp - p和CC之间具有良好的判别性(C=0.777, 95% CI 0.756 ~ 0.797),重新校准后具有良好的校准性(截距=0,斜率=1.003)。与重新训练的原始模型相比,改进后的PPS模型具有更高的内部交叉验证判别性(C=0.876, 95% CI 0.860 ~ 0.891 vs C=0.796, 95% CI 0.775 ~ 0.816),并且具有良好的校准性能(截距=-0.008,斜率=1.031)。结论:PPS在大量独立样本中表现出良好的通用性,并且经过模型改进后性能有所提高。临床意义:PPS代表了一种潜在的可扩展的工具,在分级评估框架中,用于识别需要进一步进行hr - p评估的个体。试验注册号:NCT05905003。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
6.80
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书