{"title":"在《总统艾滋病紧急救援计划》支持的 3 个国家开展监测和评估培训的影响","authors":"Anna Russell , Smita Ghosh , Niharika Tiwari , Clarissa Valdez , Leigh Tally , Lindsay Templin , Danielle Pappas , Samantha Gross , Biniyam Eskinder , Sisay Alemayehu Abayneh , Elizabeth Kamga , Colince Keleko , Spence Lloyd , Nasim Farach , Sherri Pals , Eboni Galloway , Sadhna Patel , John Aberle-Grasse","doi":"10.1016/j.evalprogplan.2024.102479","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>The second phase of the U.S. President’s Emergency Plan for AIDS Relief (PEPFAR) transitioned from scaling up HIV prevention and treatment to promoting sustainability and capacity building for programs monitoring performance and evaluating key program indicators. We assessed the success of a monitoring and evaluation (M&E) curriculum designed to build capacity in three PEPFAR-supported countries.</p></div><div><h3>Methods</h3><p>We customized M&E trainings based on country-specific epidemic control priorities in Ethiopia, Guatemala, and Cameroon. The M&E curriculum included five modules and three evaluation activities to assess impact: (i) in-person pre-post confidence assessment surveys (CAS), (ii) in-person pre-post knowledge tests (PPKT), and (iii) electronic 6–12 months post-training translating knowledge into practice (TKP) surveys. Pre- and post-training results were compared within and across countries and triangulation with the qualitative data evaluated overall success.</p></div><div><h3>Results</h3><p>Among 188 participants attending M&E trainings, 154 (82 %) responded to CAS and 165 (88 %) participants from Ethiopia and Cameroon completed PPKT. Overall CAS scores between pre- and post-test improved [Score mean difference:1.5–1.9]. PPKT indicated statistically significant knowledge gained. One out of five TKP respondents provided direct application examples from the M&E training.</p></div><div><h3>Conclusion</h3><p>While feedback was predominantly positive overall, revisions were recommended for three of the five modules. Developing a customizable and adaptable M&E curriculum may sustain countries’ ability to monitor their progress towards epidemic control.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"108 ","pages":"Article 102479"},"PeriodicalIF":1.5000,"publicationDate":"2024-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0149718924000818/pdfft?md5=917aa6a7c123652b45ece7302674c8b7&pid=1-s2.0-S0149718924000818-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Impact of a monitoring and evaluation training in 3 PEPFAR-supported countries\",\"authors\":\"Anna Russell , Smita Ghosh , Niharika Tiwari , Clarissa Valdez , Leigh Tally , Lindsay Templin , Danielle Pappas , Samantha Gross , Biniyam Eskinder , Sisay Alemayehu Abayneh , Elizabeth Kamga , Colince Keleko , Spence Lloyd , Nasim Farach , Sherri Pals , Eboni Galloway , Sadhna Patel , John Aberle-Grasse\",\"doi\":\"10.1016/j.evalprogplan.2024.102479\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Background</h3><p>The second phase of the U.S. President’s Emergency Plan for AIDS Relief (PEPFAR) transitioned from scaling up HIV prevention and treatment to promoting sustainability and capacity building for programs monitoring performance and evaluating key program indicators. We assessed the success of a monitoring and evaluation (M&E) curriculum designed to build capacity in three PEPFAR-supported countries.</p></div><div><h3>Methods</h3><p>We customized M&E trainings based on country-specific epidemic control priorities in Ethiopia, Guatemala, and Cameroon. The M&E curriculum included five modules and three evaluation activities to assess impact: (i) in-person pre-post confidence assessment surveys (CAS), (ii) in-person pre-post knowledge tests (PPKT), and (iii) electronic 6–12 months post-training translating knowledge into practice (TKP) surveys. Pre- and post-training results were compared within and across countries and triangulation with the qualitative data evaluated overall success.</p></div><div><h3>Results</h3><p>Among 188 participants attending M&E trainings, 154 (82 %) responded to CAS and 165 (88 %) participants from Ethiopia and Cameroon completed PPKT. Overall CAS scores between pre- and post-test improved [Score mean difference:1.5–1.9]. PPKT indicated statistically significant knowledge gained. One out of five TKP respondents provided direct application examples from the M&E training.</p></div><div><h3>Conclusion</h3><p>While feedback was predominantly positive overall, revisions were recommended for three of the five modules. Developing a customizable and adaptable M&E curriculum may sustain countries’ ability to monitor their progress towards epidemic control.</p></div>\",\"PeriodicalId\":48046,\"journal\":{\"name\":\"Evaluation and Program Planning\",\"volume\":\"108 \",\"pages\":\"Article 102479\"},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2024-08-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0149718924000818/pdfft?md5=917aa6a7c123652b45ece7302674c8b7&pid=1-s2.0-S0149718924000818-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Evaluation and Program Planning\",\"FirstCategoryId\":\"90\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0149718924000818\",\"RegionNum\":4,\"RegionCategory\":\"社会学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"SOCIAL SCIENCES, INTERDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Evaluation and Program Planning","FirstCategoryId":"90","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0149718924000818","RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"SOCIAL SCIENCES, INTERDISCIPLINARY","Score":null,"Total":0}
Impact of a monitoring and evaluation training in 3 PEPFAR-supported countries
Background
The second phase of the U.S. President’s Emergency Plan for AIDS Relief (PEPFAR) transitioned from scaling up HIV prevention and treatment to promoting sustainability and capacity building for programs monitoring performance and evaluating key program indicators. We assessed the success of a monitoring and evaluation (M&E) curriculum designed to build capacity in three PEPFAR-supported countries.
Methods
We customized M&E trainings based on country-specific epidemic control priorities in Ethiopia, Guatemala, and Cameroon. The M&E curriculum included five modules and three evaluation activities to assess impact: (i) in-person pre-post confidence assessment surveys (CAS), (ii) in-person pre-post knowledge tests (PPKT), and (iii) electronic 6–12 months post-training translating knowledge into practice (TKP) surveys. Pre- and post-training results were compared within and across countries and triangulation with the qualitative data evaluated overall success.
Results
Among 188 participants attending M&E trainings, 154 (82 %) responded to CAS and 165 (88 %) participants from Ethiopia and Cameroon completed PPKT. Overall CAS scores between pre- and post-test improved [Score mean difference:1.5–1.9]. PPKT indicated statistically significant knowledge gained. One out of five TKP respondents provided direct application examples from the M&E training.
Conclusion
While feedback was predominantly positive overall, revisions were recommended for three of the five modules. Developing a customizable and adaptable M&E curriculum may sustain countries’ ability to monitor their progress towards epidemic control.
期刊介绍:
Evaluation and Program Planning is based on the principle that the techniques and methods of evaluation and planning transcend the boundaries of specific fields and that relevant contributions to these areas come from people representing many different positions, intellectual traditions, and interests. In order to further the development of evaluation and planning, we publish articles from the private and public sectors in a wide range of areas: organizational development and behavior, training, planning, human resource development, health and mental, social services, mental retardation, corrections, substance abuse, and education.