A Reanalysis: SRSS-IE Internalizing Cut Scores to Support Data-Informed Decision-Making in Secondary Schools

Abstract

We report results from this psychometric study, examining convergent validity between internalizing subscale (SRSS-I4) scores from the revised version of the teacher-completed Student Risk Screening Scale for Internalizing and Externalizing behavior (SRSS-IE 9) and the internalizing subscale from the Teacher Report Form (TRF). Using the sample of nine middle and high schools across two Midwestern states with 227 sixth- through twelfth-grade students, we replicated the data analytic plan used to determine initial cutting scores for use in secondary schools. Results from logistic regression and receiver operator characteristic curves suggested the following preliminary SRSS-I4 risk categories for secondary students: 0 to 2 low, 3 moderate, and 4 to 12 high risk for internalizing behavior patterns relative to the TRF internalizing subscale score. We intended to conduct subsequent analysis to address the nested nature of the data. However, 43.70% of teachers rated only one student on the TRF, resulting in there not being enough observations per classroom estimate a meaningful and accurate random slope in many cases. We discuss limitations and directions for future research, encouraging replication before shifting screening practices in middle and high schools.