A scoping review of program evaluations in non-profit alcohol and other drugs service settings: Considerations for service and research partnerships

Introduction

The non-profit sector contributes significantly to preventing and reducing harm from alcohol and other drugs (AOD). However, it can experience challenges when demonstrating impact via feasible and rigorous evaluation.

Methods

We conducted a scoping review to identify characteristics of, and barriers/enablers to, evaluations completed in non-profit AOD services, and to ascertain the degree of collaboration between researchers and service providers during three evaluation phases (preparatory, conduct; and dissemination and implementation). We searched EMBASE and Medline from inception to February 2023 for evaluations completed in small to medium non-profit AOD services. Screening and extraction were completed by three reviewers independently, and 80 % were checked by an additional reviewer.

Results

Ultimately, 56 records were included in this study. Included evaluations were largely initiated by researchers, with limited input from service providers in setting the agenda for the evaluations (preparatory phase) or translating findings into practice (dissemination and implementation phase). Where collaborations between researchers and service providers were in place, they generated funding and strong engagement with participants, leading to better recruitment, more complete data collection, and enhanced evaluation outcomes.

Conclusion

The review raises important implications for researchers and service providers to prioritise meaningful collaboration and innovation to inform appropriate selection of evaluation topics and designs. Specifically, such evaluations should generate knowledge which can be translated into practice, demonstrating the impact of services and programs and an evidence base built in the non-profit sector.