Steps for Planning Health Program Evaluations: From Program Logic to Data Collection and Reporting Plans

There is a lack of evidence generated by health program evaluation in rural contexts [1, 2]. Evaluation of health programs is important for determining outcomes and impact [3], providing evidence for policy and funding decisions [4], and to drive continuous improvement of health programs that address inequalities in rural health outcomes [5, 6]. There are several challenges to healthcare evaluation in rural settings [1, 2, 4-6]. These can include resource limitations such as shortages of healthcare professionals, facilities, infrastructure, and funding, as well as geographical barriers such as vast distances and transportation issues, which may impede stakeholder engagement and data collection processes. Program evaluation must be tailored to the unique cultural and social contexts of rural communities. For example, qualitative data from interviews, video and audio recordings, and written feedback can provide useful evidence of outcomes and experiences of receiving care but may not be deemed appropriate in some communities. The views and support of Elders and other community leaders can guide the design and implementation of culturally safe and welcoming program evaluation activity. While a detailed explanation of these issues and management strategies is beyond the scope of this article, suggestions for approaching some of these issues are noted, and more information about managing these issues can be found.

Given these challenges, rural clinicians and health program managers are often well placed to lead the evaluation of health programs. However, they may not be familiar with evaluation methods. This article provides an overview of a simple step-by-step process for planning health program evaluation and demonstrates a method for developing data collection and reporting plans from a program logic document.

Evaluation of health programs is recognised as essential for providing evidence that can ultimately address inequality of health outcomes in rural communities [4-6]. However, this evidence is lacking for many rural health services [1, 2]. Our paper shares a simple introduction to operationalising a data collection and reporting plan from program logic. This method has been successfully implemented across several rural-based health and wellbeing programs, including a multidisciplinary paediatric outreach clinic, peer navigator, diabetes mentoring, Sense rugby (a rugby skill program for children with disability), as well as a school-based reading program. It may be useful to leaders in rural health who are considering program evaluation. Future research will evaluate and further develop this method with a focus on rural health programs.

Matt Thomas: conceptualization, writing – original draft, methodology. Justine Summers: writing – review and editing. Sherryn Honeywood: writing – review and editing, methodology. Alyssa Fitzgerald: methodology, writing – review and editing. Donna Ambler: methodology, writing – review and editing. Kylie Falciani: methodology, writing – review and editing. Amanda Cook: methodology, writing – review and editing. Kelly Smith: methodology, writing – review and editing. Dean Bright: methodology, writing – review and editing. Michelle Lindsay: methodology, writing – review and editing. Catherine Sanford: methodology, writing – review and editing.

The authors declare no conflicts of interest.