Assessing Program Fidelity Patterns within the IPS for Young Adults in Norway.

Abstract

Purpose: Evidence-based practices require fidelity scales to ensure widespread implementation. IPS (Individual placement and support) is an evidence-based supported employment practice for adults with mental health conditions. In 2021, the IPS program for young adults was launched nationwide in Norway, utilizing IPS-Y, a fidelity scale specifically designed for young adults. This study has three primary objectives: 1) to describe the variability in IPS-Y fidelity at scale and item levels, 2) to assess the scale's internal consistency, and 3) to assess IPS specialists' and IPS supervisors' experiences of participating in fidelity assessments.

Materials and methods: A total of 52 fidelity assessments (20 conducted by independent assessors and 32 self-assessed) of 47 IPS young adults' services were completed between March 14, 2022, and June 26, 2023. Additionally, 58 open-ended responses by IPS specialists and supervisors were analyzed.

Results: Fidelity assessment ratings varied between items and services. Items measuring collaboration with mental health services and community outreach received significantly lower ratings. The IPS-Y fidelity scale and subscales demonstrated good internal consistency. Analyses of the open-ended responses showed that IPS specialists and IPS supervisors responded positively to the fidelity assessments, although some found them time-consuming and challenging.

Discussion: These findings suggest that program fidelity was effectively measured through the fidelity assessments and that the practitioners experienced the fidelity assessments as necessary for their learning.

Conclusion: Regular fidelity assessments of the IPS young adults program help maintain its quality and provide valuable learning opportunities for those involved.