Evaluation and Program Planning最新文献

{"title":"How did the transition toward virtual education change lecturers’ appraisal forms?","authors":"Emanuel Tamir ,&nbsp;Yonatan Shertzer ,&nbsp;Edna Rabenu ,&nbsp;Orit Gilor ,&nbsp;Yair Maayan","doi":"10.1016/j.evalprogplan.2026.102771","DOIUrl":"10.1016/j.evalprogplan.2026.102771","url":null,"abstract":"<div><div>This study explores the change in expectations for institutional lecturers during the transition to virtual education before and during the COVID-19 pandemic. Our goal is to examine how the criteria used to evaluate lecturers’ performance, as operationalized in student evaluations of teaching (SET), both reflect and shape lecturer roles during the shift to virtual education. The research relies on analysis of feedback forms, including an examination of teaching committee protocols, interviews with academic managers holding positions in teaching centers, and program and department heads. The findings indicate that the role of lecturers expanded broadly, including increased responsibilities towards students and the integration of digital technology into teaching. The discussion draws on Herbert Simon's 'Satisficing' theory and Charles Lindblom's 'Incrementalism' theory to interpret the approach of academic institutions toward the evolving role of lecturers in virtual education. This study contributes to the definition of effective teaching standards and high-quality education and helps institutions to customize their lecturer training for the digital age.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"117 ","pages":"Article 102771"},"PeriodicalIF":2.0,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146175337","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Midline qualitative evaluation of an integrated health, livelihood, agriculture, and conservation program: Application of the RE-AIM framework","authors":"Fikadu Mitiku ,&nbsp;Adugna Eneyew Bekele ,&nbsp;Beressa Azmeraw ,&nbsp;Amdemichael Mulugeta ,&nbsp;Gardachew Tiruneh ,&nbsp;Jemal Abafita ,&nbsp;Elizabeth Millar ,&nbsp;Janine Barden-O’Fallon","doi":"10.1016/j.evalprogplan.2026.102752","DOIUrl":"10.1016/j.evalprogplan.2026.102752","url":null,"abstract":"<div><div>The population, health, environment and development (PHED) approach has been recognized for providing a more holistic and synergetic approach to program implementation than the single-sector approach. However, evidence is still needed to support the theory that multi-sectoral integration is more effective than a siloed approach. In this study, we applied the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework for midline evaluation of an integrated health, livelihood, agriculture and conservation program in Southwest Oromia, Ethiopia that specifically targeted women and youth. The data were collected through key informant interviews (KIIs), focus group discussions (FGDs) and most significant change (MSC). The findings show that the project successfully reached target beneficiaries with livelihood interventions, such as through village saving and loan associations, which were seen as important hubs for linkages to other sectors and services. Regular communication, coordination and alignment of goals with local government stakeholders supported successful program implementation, adoption and sustainability of the multi-sectoral approach. The findings highlighted the need for strategies to enhance women’s and youth’s participation, and to increase government ownership to ensure sustainability. Additionally, we found the RE-AIM framework to be flexible and adaptable for application in a qualitative PHED program evaluation.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"116 ","pages":"Article 102752"},"PeriodicalIF":2.0,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145980702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluating policy impact under sparse and staggered adoption. A synthetic difference-in-differences application to EU rural development measures","authors":"Roberto Esposti","doi":"10.1016/j.evalprogplan.2026.102751","DOIUrl":"10.1016/j.evalprogplan.2026.102751","url":null,"abstract":"<div><div>This paper investigates how farmers respond to targeted policy measures under the EU Common Agricultural Policy (CAP), focusing on whether voluntary adoption, often driven by private motivations, also leads to outcomes of societal interest. To address the methodological challenges posed by staggered and sparse treatment adoption, the study employs a Synthetic Difference-in-Differences (SDID) approach. A theoretical framework is developed to distinguish between private and societal outcomes of policy adoption. The empirical analysis uses a balanced panel of Italian farms from 2014 to 2022 and focuses on selected second-pillar CAP measures. Results reveal that while some measures significantly affect private outcomes (e.g., farm income or productivity), their impact on societal outcomes (e.g., environmental indicators) is weaker and more volatile. The paper discusses key challenges in identifying and estimating effects with few, heterogeneous treated units and staggered policy uptake. While SDID is well-suited to such contexts, its real-world application may face practical limitations.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"116 ","pages":"Article 102751"},"PeriodicalIF":2.0,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145929310","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Significance and implementation challenges of participatory monitoring and evaluation of HIV/AIDS programmes in local government authorities: Evidence from Iringa Region, Tanzania","authors":"Chakupewa J. Mpambije ,&nbsp;Easter Mbunju","doi":"10.1016/j.evalprogplan.2026.102762","DOIUrl":"10.1016/j.evalprogplan.2026.102762","url":null,"abstract":"<div><div>HIV/AIDS continues to affect people in resource-constrained countries, including Tanzania. In response to this, different HIV/AIDS programmes have been implemented in Tanzania, especially Iringa Region. In implementing such HIV/AIDS programmes, the role of Participatory Monitoring and Evaluation (PM&amp;E) cannot be underestimated. However, it is not clear to what extent PM&amp;E has been integrated, which limits the effectiveness of HIV/AIDS programmes. This question has been interrogated following HIV/AIDS programmes implemented in Kilolo District in Iringa Region. The study involved 222 respondents, with 200 for quantitative data and 22 for qualitative data. Data were collected through structured interviews, in-depth interviews and documentary reviews and thematic analysis was employed for qualitative data, while descriptive statistics were used to analyse quantitative data. Findings revealed that PM&amp;E has the potential to ensure the effectiveness and sustainability of HIV/AIDS programmes. However, PM&amp;E faced diverse impediments, including weak stakeholder participation (67 %), inadequate financial resources (88 %), and insufficient PM&amp;E skills among practitioners (70 %). Indeed, effective performance of HIV/AIDS programmes requires effective integration of PM&amp;E to enhance the outcomes. Thus, more effort is needed during PM&amp;E processes to increase inclusiveness among stakeholders and sharpen the skills of PM&amp;E practitioners at the local government level.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"116 ","pages":"Article 102762"},"PeriodicalIF":2.0,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146120465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Using radio jingles to promote use of a family planning call center: A comparative interrupted time series analysis","authors":"Dominique Meekers ,&nbsp;Olaniyi Olutola ,&nbsp;Lynn Abu Turk ,&nbsp;Tolulope Aremu","doi":"10.1016/j.evalprogplan.2026.102760","DOIUrl":"10.1016/j.evalprogplan.2026.102760","url":null,"abstract":"<div><div>This paper measures the effect of a radio jingle campaign promoting a family planning call center in Nigeria on the number of information requests received. Campaign effect is measured using comparative interrupted time series. Without the radio campaign, the number of calls from the intervention group is assumed to have been parallel to that observed in the control group. The campaign effect is estimated as the difference between the actual and projected number of calls received. Before the campaign, the monthly number of calls was stagnant, averaging below 500 calls per month. The campaign increased the monthly number of calls increased by about 360. However, this effect was temporary, which minimal gain after the campaign ended. <em>Discussion:</em> The comparative interrupted time series show that the radio campaigns substantially increased the demand for family planning information from the call center. However, there is no solid evidence that the radio jingle campaign had a longer-term effect on use of the call center after the radio broadcasts ended. Although short-term effects could be important if they benefited disadvantaged groups that cannot easily be reached through other means, we recommend that future campaigns be re-designed to facilitate permanent increases in call center use. Key lessons learned include that traditional mass media campaigns may not suffice to achieve widespread use of phone-based health services, that it is important to consider alternative strategies to promote the services, and that analyses of routine data (e.g., the monthly number of clients), can be invaluable for assessing their impact.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"116 ","pages":"Article 102760"},"PeriodicalIF":2.0,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146079132","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Improving foster care and juvenile justice services: A community-based participatory mixed-methods study in Iowa and Illinois","authors":"Melissa Sharer ,&nbsp;Emily Gordon ,&nbsp;Stephanie Hernandez ,&nbsp;Joseph Golden ,&nbsp;Malia Duffy ,&nbsp;Nicole Cisne Durbin","doi":"10.1016/j.evalprogplan.2026.102763","DOIUrl":"10.1016/j.evalprogplan.2026.102763","url":null,"abstract":"<div><div>This mixed-methods study, grounded in Community-Based Participatory Research (CBPR) principles, examines how providers working in social services linked to foster care and juvenile justice systems propose to better serve vulnerable youth and families in the bi-state Quad Cities region (Iowa and Illinois, USA). Co-designed and initiated by Family Resources, this community-led research addresses the question: What are the barriers and enablers related to entering and exiting social services for vulnerable youth and their families? Survey tools were co-created with community providers to identify service gaps, systemic barriers and enablers, and benefits of existing services. Using convenience sampling, 133 human service professionals (social work, education, juvenile justice) completed surveys with both quantitative items and qualitative open-ended questions. Findings reveal a critical paradox linked to availability and accessibility, as while services exist in communities, macrosystemic Social Determinants of Health (SDOH), particularly housing instability (74 % of respondents) and transportation limitations (73 %), may render services inaccessible to families who need them most. Results indicate 74 % identify insufficient early intervention as a primary barrier, while 76 % confirm that using a comprehensive strength-based assessment can reinforce resilience. Framed by Bronfenbrenner's ecological model, findings demonstrate that interventions must address macrosystemic forces (SDOH) while also building \"linkages of trust\" to reduce risk, optimize existing resources, and promote positive youth and family development. Practice implications include prioritizing cross-sector collaboration, early intervention, and addressing structural barriers to move beyond service availability toward true equitable accessibility for vulnerable youth and families.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"116 ","pages":"Article 102763"},"PeriodicalIF":2.0,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146127016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Development and testing of an evidence-informed structured survey tool for planning tailored technical assistance","authors":"Sarah Moreland-Russell ,&nbsp;Jessica Gannon ,&nbsp;Kim Prewitt ,&nbsp;Louise Farah Saliba","doi":"10.1016/j.evalprogplan.2026.102761","DOIUrl":"10.1016/j.evalprogplan.2026.102761","url":null,"abstract":"<div><div>Technical assistance (TA) provides training to improve program development or implementation. This study developed an evidence-informed TA survey tool for planning tailored TA. The survey captures the recipients' preferred TA delivery methods by activity categories and TA duration and identifies barriers and facilitators to TA engagement. Two phases were carried out: 1) outlining the survey components and assessing face and content validity, and 2) testing the survey with state tobacco control staff and analyzing the survey responses using descriptive statistics. Twenty-seven tobacco control managers and staff representing 14 U.S. state tobacco control programs participated in testing the survey. The final survey included 21 questions. Virtual meetings were the preferred TA delivery method for three TA activities: 1) professional development, 2) coaching and mentoring, and 3) collaborative work. The preferred duration was 1.4–3.0 h/month. Respondents wanted pragmatic information with actionable steps (92 %) and examples of similar challenges other programs address (89 %) in the TA sessions. Respondents pointed to low organizational capacity (76 %) and competing priorities (76 %) as barriers to TA engagement. The TA survey allows TA providers to identify TA recipients' preferences regarding TA activities and delivery methods, the TA duration, and potential barriers preventing recipients from participating in TA sessions.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"116 ","pages":"Article 102761"},"PeriodicalIF":2.0,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146024424","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Sustainable livelihoods amidst industry disruption: The case of slaughterhouse closures in Uttar Pradesh's leather industry","authors":"Nitika Sharma,&nbsp;Pinaki Dasgupta,&nbsp;Rutuja Bhange","doi":"10.1016/j.evalprogplan.2025.102748","DOIUrl":"10.1016/j.evalprogplan.2025.102748","url":null,"abstract":"<div><div>The leather industry holds an important position in India’s overall trade, with Uttar Pradesh (UP) emerging as a major leather production centre and industry. The sudden closure of slaughterhouses has not only impacted employers and owners of slaughterhouses but also the livelihoods of those indirectly dependent on them. This study utilizes the Sustainable Livelihood Approach (SLA) and has done thematic analysis to analyse the positive and negative impact of the closure on stakeholders, which is often overlooked in the literature before. Through qualitative research and in-depth interviews with 31 stakeholders, the study identifies livelihood challenges and opportunities and recommends strategies for improvement in areas such as sustainable slaughtering practices, government support and involvement, the role of businesses, and the contributions of NGOs. A revised SLA framework is proposed using useful insights for future policy changes.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102748"},"PeriodicalIF":2.0,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145884311","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Measuring the impact of a novel program in a Family Treatment Court: Quality of life, mental health, and self-esteem inventories in program evaluation","authors":"Julie B. Raines","doi":"10.1016/j.evalprogplan.2025.102734","DOIUrl":"10.1016/j.evalprogplan.2025.102734","url":null,"abstract":"<div><div>Family Treatment Courts (FTCs) accept parents in civil neglect cases where the parent is suffering from substance use and/or mental health issues. Modeled after adult drug treatment courts, FTCs coordinate substance use and mental health treatment, as well as other social support services for participants like housing and employment. Recently, one FTC in the United States began providing additional supervised and monitored visitation to participants within their FTC program, as well as one-on-one evidence-based parenting education. Called Enhanced Parenting Time (EPT), the goal of this innovative program is to motivate FTC participants with extra visitation while simultaneously improving parenting skills. As part of a program evaluation paid for by the Office of Juvenile Justice and Delinquency Prevention (OJJDP), three separate instruments were used to determine the impact EPT had on its participants. Comparison data collected from the Quality-of-Life Scales (QOLS), Mental Health Continuum – Short Form (MHC-SF), and Rosenberg Self Esteem scale (RSE) yielded differences between EPT participants and non-EPT participants. This research focuses on the use of these instruments in an impact evaluation of a novel treatment court program in the United States and contributes to evaluation methodology frameworks for treatment court programs.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102734"},"PeriodicalIF":2.0,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145645881","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Designing, developing and applying an instructional framework for a neonatal resuscitation program: Action research","authors":"Ayşe Şenoğlu ,&nbsp;Zekiye Karaçam ,&nbsp;Ali Tanju Altunsu","doi":"10.1016/j.evalprogplan.2025.102747","DOIUrl":"10.1016/j.evalprogplan.2025.102747","url":null,"abstract":"<div><div>This research was conducted to design, develop, and implement an in-house training framework aimed at improving the skills of healthcare professionals in newborn resuscitation practices. Action research has an inherently researcher–participant collaborative nature. An action research design was employed in this study, which was carried out with healthcare workers at a state hospital providing maternity services from February 1, 2020, to January 31, 2022. Both qualitative (observations, individual interviews and a focus group interview) and quantitative (knowledge assessment tests) data collection techniques were utilized in the study. Data were collected from researcher notes, the Neonatal Resuscitation Program (NRP) Knowledge Assessment Test, the Post-Training NRP Knowledge Assessment Test, observations, individual interviews, and focus group discussions. Quantitative data were analyzed using descriptive statistics, the Mann-Whitney U, Kruskal-Wallis and Wilcoxon tests; content analysis was employed for qualitative data. When the NRP Knowledge Assessment Test and the Post-training NRP Knowledge Assessment Test median scores were compared, it was found that the median NRP knowledge assessment test score was 43.0 (29.0–52.0), and the median post-training NRP knowledge assessment test score was 88.0 (85.0–93.0). A statistically significant difference was observed in the comparison of the participants' median scores in the NRP knowledge assessment test and the post-training NRP knowledge assessment test (p &lt; 0.001). According to the data from the individual interviews, it was found that the participants felt challenged by neonatal resuscitation, they did not use many aspects of their knowledge, there were communication problems between teams, and they expressed a need for training. It was observed that the participants could not perform the required routine practices fully and accurately and additionally could not perform neonatal resuscitation practices, including neonatal assessments, in line with the algorithms. During this action research, the deficiencies in medical equipment for neonatal resuscitation practices identified in the institution where the study was conducted were eliminated and the equipment was made operational and usable. Improvements were also made in the use of risk assessment and recording forms, the provision of flow charts and informative documents in the practice areas, and the organization of the working system of midwives. During this process, theoretical and practical training was provided to improve the knowledge and skills of health personnel in neonatal resuscitation practices. In addition, four mentors were trained and assigned to ensure the sustainability of all the improvements made. This research has revealed institutional infrastructure problems, along with knowledge and application deficiencies regarding neonatal resuscitation practices among healthcare professionals.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102747"},"PeriodicalIF":2.0,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145884313","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}