Evaluation and Program Planning最新文献

{"title":"Implementation evaluation of an intervention aimed at reducing test anxiety in adolescents","authors":"Gabriela Campeau ,&nbsp;Gabrielle Yale-Soulière ,&nbsp;Lyse Turgeon ,&nbsp;Kassandra Berniqué ,&nbsp;Kim Archambault","doi":"10.1016/j.evalprogplan.2025.102731","DOIUrl":"10.1016/j.evalprogplan.2025.102731","url":null,"abstract":"<div><h3>Introduction</h3><div>Approximately 15 % of adolescents experience test anxiety in school settings. This type of anxiety, characterized by worries and physiological reactions to school assessments, can lead to significant academic and psychological difficulties. In response to the lack of effective school-based interventions, the <em>Pastel</em> workshops were developed. This targeted group intervention, which combines a cognitive-behavioral approach with study skills training, has demonstrated significant effects in reducing test anxiety in at-risk adolescents.</div></div><div><h3>Objectives</h3><div>This study aims to: 1) determine whether the training provided by Boscoville to program facilitators was properly implemented, 2) evaluate the implementation of the Pastel workshops, and 3) explore the facilitators and barriers encountered in supporting facilitators and implementing the workshops.</div></div><div><h3>Methodology</h3><div>The sample includes 24 students aged 14–17 in grades 10 and 11 from five schools who participated in the workshops, and nine professionals who facilitated them. Fidelity, delivered dosage, quality of delivery, and attendance and homework completion were measured to evaluate the implementation, while semi-structured interviews with the youth and facilitators were conducted to assess the implementation context.</div></div><div><h3>Results</h3><div>Findings show an overall score of 84 % for the evaluation of the training implementation and an average adherence score of 79 % for the workshop implementation. The context evaluation identified enablers and challenges based on Domitrovich’s multilevel framework, across societal, environmental, intervention-specific, and support system levels. Key enablers included the involvement of a third-party organization, the group-based format, strong motivation among facilitators, the relevance of the strategies presented, and the quality of the training. However, challenges emerged at multiple levels, including limited engagement for some participants, issues related to the organization of the workshop content, suboptimal quality of some implementation materials, and time constraints related to preparation and facilitation.</div></div><div><h3>Conclusion</h3><div>This study highlights that successful implementation of school-based psychosocial programs relies on thorough planning that integrates both core components and contextual factors. When combined with strong facilitator support, such planning fosters high fidelity, quality delivery, and sustained participant engagement.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102731"},"PeriodicalIF":2.0,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145558249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Youth Alcohol, Tobacco, and Other Drug (ATOD) use rates in a municipal youth and family master plan","authors":"David Tataw","doi":"10.1016/j.evalprogplan.2025.102693","DOIUrl":"10.1016/j.evalprogplan.2025.102693","url":null,"abstract":"<div><h3>Background and objective</h3><div>The purpose of this study was to determine if community-wide activities in the Pomona Youth and Family Master Plan (PYFMP) might have influenced youth ATOD use changes in Pomona and in comparison to the US national jurisdiction.</div></div><div><h3>Methods</h3><div>An integrated framework encompassing social cognitive theory and the risk and protective factors approach guided the study using a pre-post quasi-experimental design and z-test analysis. Same-group and independent group comparisons within and across school grades, intervention years, and jurisdictions were conducted in a quasi-experimental design. The baseline (2005–06) and follow-up (2009–10) samples were as follows: Pomona sample was 3967(2005–06) and 2693(2009–10); and for the US, the samples were 122,243(2005–06) and 101,141(2009–10). Contemporary and context-sensitive evaluation paradigms shape the study's design, plan of analysis, and results interpretation.</div></div><div><h3>Results</h3><div>Within the five years under study, overall youth ATOD use trends in Pomona, particularly in comparison with US trends, showed a slow, but clear and positive shift.</div></div><div><h3>Discussion and conclusion</h3><div>Though PYFMP interventions might have positively impacted ATOD use among Pomona Youth, the pace of change was slow. Future studies should examine the following factors not investigated in this study: specific community-level factors that might have influenced individual youth ATOD use; the effect of underlying socioeconomic and resource factors on youth ATOD use; and the role of micro-level factors and interventions. Some evaluation lessons learned include involving evaluators in planning, being flexible with plans of analysis, and considering context when interpreting results.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102693"},"PeriodicalIF":2.0,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144997784","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The coupling coordination development of rural medical health service and rural economy: Evidence from China","authors":"Junjie Zhao ,&nbsp;Ye Ding ,&nbsp;Shangren Qin","doi":"10.1016/j.evalprogplan.2025.102732","DOIUrl":"10.1016/j.evalprogplan.2025.102732","url":null,"abstract":"<div><div>The equity of rural medical health services and their coordination with the rural economy needs to be clarified. This article reports on the coupling coordination development of rural medical health services and the economy in China. We used panel data for 29 provincial-level administrative regions in China from 2009 to 2019 to analyze the development level and coupling coordination degree of rural medical health services and rural economy from a spatial and temporal perspective. Using a spatial autocorrelation test, the correlation of the coupling coordination degree of each administrative region and the spatial clustering characteristics of the coupling coordination degree of the east, central, west, and northeast regions was analyzed. Results showed that the level of development of the two subsystems turned from 2014. The rural economy was gradually catching up with medical and health services, yet rural health services had always been important in the development of the system, coupling coordination degree. Spatially, the development level and coupling coordination of the subsystem showed a “high eastern” distribution pattern, while the inequity among provincial-level administrative regions in the east was more significant. The subsystems of 29 provincial-level administrative regions exhibited both spatial-temporal differences and positive spatial correlation. The phenomenon of regional differentiation and imbalance still exists in rural China. It indicates that neighboring regions influence each other and produce a spillover effect, so promoting regional linkage can better promote balanced regional development. These findings will help the government to implement targeted policies to improve health quality and health equity in rural areas.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102732"},"PeriodicalIF":2.0,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145551537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluation of tourist importance-performance for supporting adaptive marine conservation programs through marine natural capital","authors":"I Wayan Koko Suryawan ,&nbsp;Sapta Suhardono ,&nbsp;Van Viet Nguyen ,&nbsp;Chun-Hung Lee","doi":"10.1016/j.evalprogplan.2025.102724","DOIUrl":"10.1016/j.evalprogplan.2025.102724","url":null,"abstract":"<div><div>This study utilizes Importance-Performance Analysis (IPA) and regression modeling to critically evaluate tourist perceptions and their engagement in marine conservation programs in Bali, Indonesia, emphasizing the intricate relationships between human activities and environmental outcomes. Focusing on four adaptive capacity components including asset, knowledge, flexibility, and engagement, this research assesses the disparity between tourists’ expectations and the actual performance of natural capital initiatives, while providing a socio-economic analysis of these gaps. The target demographic of tourists typically exhibits higher income levels (greater than IDR 5,000,000), low travel frequencies (1 trip per year), moderate support for local natural capital initiatives (rated 2 on a scale), and a higher education level (bachelor’s degree and above). These attributes significantly shape their perceptions and interactions with the marine environment. The findings reveal substantial discrepancies, particularly in educational and engagement activities, which these well-educated and economically capable tourists value highly but report as underperforming. Moreover, the study elucidates how overall perceptions of importance and performance significantly influence tourists’ willingness to financially support conservation efforts. This analysis underlines the necessity for tourism operators to enhance the quality, interactivity, and visibility of conservation activities to effectively increase support. Strategic recommendations are proposed to refine these conservation practices, better aligning them with both tourist expectations and sustainable environmental goals. These recommendations aim to optimize the effectiveness and sustainability of marine conservation efforts, thereby ensuring they achieve significant environmental benefits while simultaneously enhancing tourist satisfaction and supporting sustainable tourism development.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102724"},"PeriodicalIF":2.0,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145519548","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Causal decision-making for speed camera allocation: Methodology and an application","authors":"Yingheng Zhang ,&nbsp;Haojie Li","doi":"10.1016/j.evalprogplan.2025.102713","DOIUrl":"10.1016/j.evalprogplan.2025.102713","url":null,"abstract":"<div><div>Speed enforcement cameras are implemented worldwide to regulate driving behaviours and enhance road traffic safety. Proper allocation of speed cameras is quite important. In practice, we should first identify road sites likely to experience larger crash reductions with speed cameras, but this step is commonly simplified as ranking sites based on the historical crash frequency. This paper proposes the use of causal decision-making to refine speed camera allocation rules. Within this framework, the heterogeneous treatment effects (HTEs) of speed cameras on crash frequency across different sites are first modelled by applying causal machine learning methods. Subsequently, by exploiting the trained HTE model, sites with larger predicted road safety benefits (i.e., crash reductions) will be prioritised for allocation. A UK case study is presented to demonstrate the superiority of the proposed method. Different speed camera allocation rules, including the HTE-based, historical crash-based, and random allocation, are compared with respect to the number of prevented road traffic crashes. Our empirical results indicate that a larger number of past crashes in general implies a larger safety benefit of the speed camera. Therefore, the historical crash frequency could be regarded as a useful criterion for camera site selection in the absence of additional information. Nonetheless, the HTE-based rule has been found to further enhance the allocation performance. That is, more road traffic crashes could be prevented by adopting the HTE-based rule. In future transportation research and practice, the causal decision-making framework could be applied more generally to costly resource allocation tasks.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102713"},"PeriodicalIF":2.0,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145158703","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"","authors":"Melanie Hwalek","doi":"10.1016/j.evalprogplan.2025.102735","DOIUrl":"10.1016/j.evalprogplan.2025.102735","url":null,"abstract":"","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"115 ","pages":"Article 102735"},"PeriodicalIF":2.0,"publicationDate":"2025-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145685298","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Ex-post impact analysis of the Philippine pig repopulation program","authors":"Lary Nel B. Abao ,&nbsp;Ruth M. Sonaco ,&nbsp;Miguel V. Guioguio ,&nbsp;Alvin Paul J. Dirain ,&nbsp;Roland Y. Fajardo ,&nbsp;Joseph Frank Mgaya","doi":"10.1016/j.evalprogplan.2025.102675","DOIUrl":"10.1016/j.evalprogplan.2025.102675","url":null,"abstract":"<div><div>The 3-year Integrated National Swine Production Initiatives for Recovery and Expansion (INSPIRE) program is the national repopulation and recovery program of the Philippine Department of Agriculture-National Livestock Program, offering a mix of interventions aimed at reviving the swine industry, which was significantly impacted by African Swine Fever (ASF). The study focused on the interventions provided to the three regions with the highest allocation from fiscal years (FYs) 2022 and 2023: Central Luzon, CALABARZON, and the Davao region. A combination of SARIMA modeling and financial analyses was employed to measure the impacts of the repopulation program.</div><div>Two forecasts were created: one assumes a situation without African swine fever outbreaks, using datasets from 2000Q1 to 2019Q2, whereas the other reflects the situation prior to the implementation of the INSPIRE program, which utilizes datasets from 2000Q1 to 2021Q4.</div><div>The study estimated the impact of the INSPIRE program in these three regions, revealing that Central Luzon and CALABARZON significantly benefited from the program. Without the INSPIRE program, pig production in Central Luzon could have been wiped out by the second quarter of 2022 (2022Q2), whereas CALABARZON would have faced a similar scenario by the first quarter of 2023 (2023Q1). In contrast, the INSPIRE program had a lesser impact in the Davao Region, as it was affected by ASF later.</div><div>The cost benefit analysis and net present value of the program investments yielded favorable ratios that indicate their financial viability and success. Based on the impact analysis, it is recommended that the swine repopulation program be continued beyond 2025 with increased funding.</div><div>This is the first study in the Philippines which utilizes time series SARIMA forecasting to evaluate the impact of a pig repopulation program.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"113 ","pages":"Article 102675"},"PeriodicalIF":2.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144852920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Building capacity for health research in higher education: Evaluating readiness for research and scholarship","authors":"Kelly A. Laurila ,&nbsp;Katharine Sanderson ,&nbsp;Taylor S. Lane ,&nbsp;Diane Stearns ,&nbsp;Derrick C. Tabor ,&nbsp;Julie A. Baldwin","doi":"10.1016/j.evalprogplan.2025.102672","DOIUrl":"10.1016/j.evalprogplan.2025.102672","url":null,"abstract":"<div><div>This case study examines key components of research readiness for Doctoral Universities with High Research Activity (R2) through the lens of the National Institutes of Health (NIH) funded Research Centers in Minority Institutions (RCMI) program. While there are long-standing systems in place for ranking research institutions based on grant expenditures, there is a need to establish methods to evaluate institutions’ readiness for externally funded competitive research. Drawing on literature across multiple disciplines and framed in alignment with the RCMI program goals, the authors developed a multidimensional instrument to examine research readiness centered on two primary domains (investigator and institutional readiness). The largest barriers to proposal development and conducting research/scholarship projects were managing time for competing expectations including scholarship, teaching, mentoring students, and service and recruiting skilled students who are prepared to assist the research process (respectively). Building research capacity requires research infrastructure, equitable distribution of institutional and grant resources, protected time for research, and focused areas research. Findings inform evaluation methods to assess research readiness, identify indicators and set benchmarks to measure changes in capacity and offer strategies for universities to enhance research capacity-building efforts and optimize institutions’ ability to conduct NIH mission relevant research.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"113 ","pages":"Article 102672"},"PeriodicalIF":2.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144896087","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Peer mentoring, university dropout and academic performance before, during, and after the pandemic in Spain","authors":"Aitana González-Ortiz-de-Zárate,&nbsp;Miguel Aurelio Alonso-García,&nbsp;María de los Ángeles Gómez-Flechoso,&nbsp;Irene Aliagas","doi":"10.1016/j.evalprogplan.2025.102676","DOIUrl":"10.1016/j.evalprogplan.2025.102676","url":null,"abstract":"<div><div>Peer mentoring programs in higher education aim to facilitate student integration and enhance both retention and academic performance. This study investigated the effectiveness of a peer mentoring program at a Spanish university over five academic years (2018–19–2022–23), encompassing the COVID-19 pandemic. Employing a quasi-experimental posttest-only control group design, we analyzed data from 4962 students (mentees: n = 2481; controls: n = 2481). Statistical analyses included independent t-tests, Cohen's d, phi coefficient, chi-square tests, and two-way ANOVA. Results demonstrated significantly lower dropout rates and higher academic performance among mentees compared to controls across all study years. These positive effects were observed inconsistently across most of the studied student characteristics, including gender, study choice order, region of origin, and field of study. Furthermore, our findings supported the mediating role of academic performance in the relationship between peer mentoring and dropout. This research provides valuable empirical evidence that supports the theoretical frameworks on peer mentoring, student development, and successful integration within the context of higher education, particularly during times of crisis.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"113 ","pages":"Article 102676"},"PeriodicalIF":2.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144858074","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The social role of peripheral universities and tax exemptions, the Italian case","authors":"A. Nifo ,&nbsp;S. Ruberto ,&nbsp;G. Vecchione","doi":"10.1016/j.evalprogplan.2025.102691","DOIUrl":"10.1016/j.evalprogplan.2025.102691","url":null,"abstract":"<div><div>In the dynamic center-periphery, the universities located in the peripheral areas, characterized by income, employment and infrastructural gaps, as well as increasing rates of skilled migration, have experienced increasing difficulties in recent years in terms of enrolment, recruitment and the ability to intercept sources of funding. This dynamic is particularly present in the Italian system, characterized by structural weaknesses that persist for at least a decade. In Italy, this marginalization phenomenon is impoverishing peripherical Universities jeopardising their role as civic actors for the most peripheral territories. This paper addresses the case of Italian universities in which we are witnessing the gradual decline of universities in the more peripheral areas and a constant growth of universities located in the most dynamic center of the country, as emerged within a working group operating between 2020 and 2021 on behalf of the Ministry of University. In this scenario by 2040, in line with demographic estimates, some universities in peripheral areas may need to close, resulting in a social and economic impoverishment of their home territories. This paper aims to evaluate the introduction of tax exemptions measures introduced in 2017 and extended by the government in 2021 in the aim of stemming this decline. The results of our analysis indicate that tax exemptions and more generous bursaries positively affect the retention rate of central universities and the attraction rate of the peripheral ones. Hence, it represents a significant policy factor capable of increasing the presence of universities in peripheral regions and, consequently, their capacity to generate societal impact within them.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"113 ","pages":"Article 102691"},"PeriodicalIF":2.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144911764","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}