Comparing predictive validity of Youth Level of Service/Case Management Inventory scores in Indigenous and non-Indigenous Canadian youth.

Abstract

Objective: There is an increasing recognition of the necessity to establish the predictive validity of risk assessment scores within specific population subgroups, particularly those (including Indigenous peoples) who are overrepresented in the criminal justice system. I compared measures of discrimination and calibration of the Youth Level of Service/Case Management Inventory (YLS/CMI) in Indigenous and non-Indigenous youth probationers in Ontario, Canada.

Hypotheses: Compared with non-Indigenous youth, Indigenous youth would have higher risk scores and reoffense rates. The YLS/CMI would predict reoffending and time to reoffense significantly and comparably for Indigenous and non-Indigenous youth, but there would be group difference discrimination (sensitivity, specificity) and calibration (positive predictive value, negative predictive value).

Method: Justice ministry-supplied data on 400 Indigenous and non-Indigenous youth (330 male, 70 female) individually matched on key background variables were analyzed to provide measures of discrimination and calibration of the YLS/CMI, with 3-year recidivism as the primary outcome.

Results: Indigenous youth were assessed at significantly higher risk than non-Indigenous youth (d = .60); 70% of Indigenous youth and 46% of non-Indigenous youth reoffended (ϕ = .24). Overall measures of discrimination (area under the curve) and calibration (logistic regression) were significant and did not differ across groups. Cross-area under the curve results indicated that the YLS/CMI discriminated Indigenous recidivists from non-Indigenous nonrecidivists but differentiated Indigenous nonrecidivists from non-Indigenous recidivists at chance level. In addition, recidivism was underestimated for low-risk Indigenous youth compared with non-Indigenous youth, but specificity was also low; only 28% of Indigenous youth who did not reoffend were assessed as low risk. Results were largely consistent across male and female youth.

Conclusions: Examining subgroup predictive validity using multiple indices provides important information that should inform policy and practice discussions regarding fair use of risk assessment tools. (PsycInfo Database Record (c) 2024 APA, all rights reserved).