Impact of a monitoring and evaluation training in 3 PEPFAR-supported countries

Abstract

Background

The second phase of the U.S. President’s Emergency Plan for AIDS Relief (PEPFAR) transitioned from scaling up HIV prevention and treatment to promoting sustainability and capacity building for programs monitoring performance and evaluating key program indicators. We assessed the success of a monitoring and evaluation (M&E) curriculum designed to build capacity in three PEPFAR-supported countries.

Methods

We customized M&E trainings based on country-specific epidemic control priorities in Ethiopia, Guatemala, and Cameroon. The M&E curriculum included five modules and three evaluation activities to assess impact: (i) in-person pre-post confidence assessment surveys (CAS), (ii) in-person pre-post knowledge tests (PPKT), and (iii) electronic 6–12 months post-training translating knowledge into practice (TKP) surveys. Pre- and post-training results were compared within and across countries and triangulation with the qualitative data evaluated overall success.

Results

Among 188 participants attending M&E trainings, 154 (82 %) responded to CAS and 165 (88 %) participants from Ethiopia and Cameroon completed PPKT. Overall CAS scores between pre- and post-test improved [Score mean difference:1.5–1.9]. PPKT indicated statistically significant knowledge gained. One out of five TKP respondents provided direct application examples from the M&E training.

Conclusion

While feedback was predominantly positive overall, revisions were recommended for three of the five modules. Developing a customizable and adaptable M&E curriculum may sustain countries’ ability to monitor their progress towards epidemic control.