Evaluation and Program Planning最新文献

{"title":"A participatory systems approach in community health promotion: Lessons learnt from an overall evaluation of a program to reduce health inequities","authors":"Annemarie Wagemakers ,&nbsp;Samantha Elkhuizen ,&nbsp;Anner Bindels ,&nbsp;Marte Wachter ,&nbsp;Dagmar Niewold ,&nbsp;Marthe Derkzen ,&nbsp;Kristina Thompson","doi":"10.1016/j.evalprogplan.2025.102695","DOIUrl":"10.1016/j.evalprogplan.2025.102695","url":null,"abstract":"<div><div>To address the complexity and multi-level dynamics in health promotion, participatory and systems approaches have recently gained attention. We combined these into a participatory systems approach, which actively involves stakeholders in the planning, implementation, and evaluation of health promotion initiatives. This approach promotes cross-sector collaboration, shared understanding, joint decision-making, empowerment, and acknowledges the dynamic, interconnected factors that influence health over time. However, practical guidance on how to implement and evaluate such complex programs remains limited, particularly on aligning implementation and evaluation. We applied a participatory systems approach to the planning and implementation of an overall evaluation of a program aimed at enhancing the health of families in vulnerable positions in the Netherlands, with the goal of sharing lessons learnt from this process. From the program, four projects in four municipalities were selected for this study. We studied the processes and results of the overall evaluation in four iterative steps: conducting participatory action research with the four projects, semi-structured interviews with the four case managers, three consortium reflection and learning sessions and document analysis. We identified five themes: flexibility; research and practice needs; research capacity; roles of stakeholders and defining boundaries. The main lessons from our participatory systems approach are: flexibility is needed to realise stakeholder participation; balance research with practice; ensure adequate research capacity; define the roles of stakeholders and explore system boundaries continuously. The implementation of these lessons is supported by a reflection and learning culture. These lessons are relevant for practitioners, researchers, policymakers and citizens in effectively planning, implementing and evaluating health promotion programs.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"113 ","pages":"Article 102695"},"PeriodicalIF":2.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144916867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Teaching diversity, inspiring change: Evaluating Anti-Bias Education training program in preschoolers","authors":"Çağla Banko-Bal ,&nbsp;Berrin Akman","doi":"10.1016/j.evalprogplan.2025.102655","DOIUrl":"10.1016/j.evalprogplan.2025.102655","url":null,"abstract":"<div><div>This study aims to evaluate the outcomes of the ABE (Anti-Bias Education) Training Program for early childhood educators by examining its impact on teachers' attitudes, self-awareness, and children's attitudes. A training program for preschool teachers was developed and implemented. Educators were informed about ABE and instructed to do ABE-related activities in their classrooms to evaluate children’s attitudes. The study used a nested mixed design and involved 129 preschoolers and 12 preschool teachers for experimental groups and 43 preschoolers and 5 teachers for control group. ABE Attitude Scale and ABE Self-Awareness Scale were used to examine teachers’ data while Respect for Differences Attitude Scale was used for children. The results demonstrated that the ABE Training Program was effective for both teachers and children at experimental group. The program improved teachers' perspectives and self-awareness on ABE. Moreover, children's appreciation for diversity was heightened after the activities implemented by the educators. The proposal is to expand this training program to all preschools to improve the positive attitudes of teachers and children regarding diversity.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102655"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144634030","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Realist evaluation of a CBT-based stress management intervention for Danish patients on sick leave due to work-related stress: A study protocol","authors":"Charlotte Brøgger Bond ,&nbsp;Lars Peter Andreas Brandt ,&nbsp;Daniel Navy Ditlevsen ,&nbsp;Sonia Dalkin ,&nbsp;Morten Vejs Willert ,&nbsp;Lotte Nygaard Andersen","doi":"10.1016/j.evalprogplan.2025.102634","DOIUrl":"10.1016/j.evalprogplan.2025.102634","url":null,"abstract":"<div><div>Cognitive behavioural therapy (CBT) is the most widely used stress management intervention for work-related stress, however the effect on return to work is unclear. Further, there is a lack of knowledge about the mechanisms and contexts that make CBT interventions work (or not). This project aims to use a realist evaluation approach to explore the outcomes of a stress management intervention at a Danish Occupational Health Clinic and to understand if, how and why it works (mechanisms), for whom and in what circumstances (contexts). Firstly, the initial programme theory (IPT) will be elicited. Secondly, the IPT will be tested using a mix of methods. The primary outcome of the intervention; return to work, will be assessed in a quasi-experimental study using register data on sick-leave compensation. In a cohort study explanatory variables from patient surveys and national registries associated with outcomes will be explored. Finally, realist theory driven interviews with patients will explore what works, for whom in what context. The data will be analysed using a realist logic, and synthesized to refine, refute, or confirm the IPT. The refined programme theory will offer insights about what patient groups benefit from the intervention (if any), under what circumstances, and why.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102634"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144270732","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Using a systems lens in evaluations at the nexus of environment and development","authors":"Jeneen R. Garcia ,&nbsp;Juha I. Uitto","doi":"10.1016/j.evalprogplan.2025.102560","DOIUrl":"10.1016/j.evalprogplan.2025.102560","url":null,"abstract":"<div><div>This article advocates for the integration of systems thinking into evaluations, particularly in the context of Coupled Human and Natural Systems (CHANS). Development interventions often generate unintended environmental consequences that undermine their social, economic and environmental sustainability. The paper outlines a conceptual framework for understanding CHANS, highlighting the perils of neglecting environmental dimensions, such as exacerbating climate change, biodiversity loss, and pollution, which in turn compromise development outcomes. Using examples from evaluations conducted by the Global Environment Facility Independent Evaluation Office (GEF IEO), the authors underscore the importance of evaluating results relative to an intervention’s specific context, looking beyond an intervention’s geographical and temporal coverage, identifying root causes, and integrating multisectoral and multidisciplinary perspectives as a way to more systematically assess unintended effects and the likelihood of an intervention’s outcomes being sustained. The article also provides guidance on when and how to incorporate the environmental dimension into evaluations, and highlights the need to adopt tools that support the use of a systems lens, especially the mapping and measurement of environmental change. The article concludes that using a systems lens in evaluation is both an ethical imperative and a practical necessity to enhance the effectiveness and sustainability of development interventions. This approach positions evaluation as a critical tool in advancing global sustainability goals.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102560"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144611692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Cross-border e-commerce business environment evaluation for Chinese provinces using a combined Entropy-TOPSIS approach","authors":"Huan Zhou ,&nbsp;Yilin Guo ,&nbsp;Yu Li","doi":"10.1016/j.evalprogplan.2025.102658","DOIUrl":"10.1016/j.evalprogplan.2025.102658","url":null,"abstract":"<div><div>The good business environment of cross-border e-commerce (CBEC) can promote economic development and corporate innovation. Improving the business environment of CBEC has a favorable influence on the digital economy development. To improve the business environment targeted at cross-border e-commerce, we propose a combined approach of Entropy-TOPSIS to evaluate the business environment of CBEC. We construct an evaluation index system containing four dimensions and 12 first-level and 33 s-level indicators. The panel data of 31 provinces in China from 2013 to 2020 are collected to evaluate the business environment of CBEC. The results show that Guangdong has the highest comprehensive score for the CBEC business environment and the business environment of CBEC is uneven among provinces. The economic and market environment dimension, human resource dimension, and technology and innovation environment dimension of 31 provinces are highly coupled with the comprehensive performance. The three dimensions are the key factors constraining the construction of the business environment for CBEC. The relationship between the results of the business environment assessment and the actual situation are analyzed in further discussion, demonstrating the validity of the evaluation results. Finally, recommendations are proposed for improving the business environment of cross-border e-commerce.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102658"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144665569","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluating the English for General Purposes (EGP) program at a Taiwanese University: A CIPP (context, input, process, and product) model study","authors":"Shu-Hsiu Huang","doi":"10.1016/j.evalprogplan.2025.102662","DOIUrl":"10.1016/j.evalprogplan.2025.102662","url":null,"abstract":"<div><div>English has been the only compulsory foreign language taught in colleges in Taiwan since 2005. It was referred to as 'English for General Purposes (EGP)' and was taught not only for students' further major-related studies, but also for future job competitiveness. With the implementation of 'The Program on Bilingual Education for Students in College (BEST)' in the second half of 2021, the importance of English has been further strengthened, which has intensified the missions carried by EGP. Consequently, the subject needed to be examined for potential ingrained problems and ways to improve it. The present study collected and analyzed the perspectives of 470 non-English major students at a university in Taiwan on the EGP curriculum, using four factors (context, input, process, and product, or CIPP) as well as gender, grade level, and language proficiency as variables. The results showed that students generally reacted positively to the current EGP curriculum, especially with respect to the process factor. Gender had a significant effect on perceptions, but there were no differences in perceptions based on students' English proficiency levels and grade levels. It is suggested that EGP curriculum designers should consider these differences in their future development of EGP courses.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102662"},"PeriodicalIF":2.0,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144748594","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Direct measurement of learning outcomes in higher education: A proposal of nine standardized scales for continuous improvement in engineering programs","authors":"Mónica Hernández-Campos ,&nbsp;Jorge Esteban Prado-Calderón ,&nbsp;Antonio Gonzalez-Torres ,&nbsp;Francisco José García-Peñalvo","doi":"10.1016/j.evalprogplan.2025.102638","DOIUrl":"10.1016/j.evalprogplan.2025.102638","url":null,"abstract":"<div><div>Despite the growing interest in measuring learning outcomes as evidence of comprehensive education in higher education institutions, objectively assessing these outcomes remains a challenge. This study addresses this problem by developing and validating nine standardized direct assessment scales tailored for engineering programs, with the goal of enhancing quality assurance. Study 1 focused on designing indicators for the scales through expert workshops and peer judgment processes, looking for content validity using Fleiss Kappa. Study 2 involved instructors using these instruments to assess various learning outcomes in a STEM-focused university. Analysis of 1420 assessments revealed strong validity and reliability indicators, including unifactorial structures, high reliability, discrimination, and appropriate difficulty levels for all scales. The research contributes evidence supporting the content validity of these assessment instruments, offering valuable tools for researchers and practitioners in engineering education to support continuous improvement. These scales have the potential to support future comparative research, inform quality assurance decisions, and enhance comprehensive education practices. Finally, the study discusses its limitations and provides directions for future research.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102638"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144314036","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Community members’ and community partners’ perspectives on community readiness to address youth violence prevention in a low-income urban community","authors":"Terri N. Sullivan ,&nbsp;Katherine M. Ross ,&nbsp;Carine E. Leslie ,&nbsp;Daniella Tailor ,&nbsp;Angela Angulo","doi":"10.1016/j.evalprogplan.2025.102623","DOIUrl":"10.1016/j.evalprogplan.2025.102623","url":null,"abstract":"<div><div>Youth violence is a significant public health concern in the U.S. The current study identified qualitative themes related to aspects of community readiness including biggest concerns about youth violence, knowledge of youth violence prevention efforts, community climate, priorities for mobilization, and community resources in an urban, economically marginalized community. A total of 10 community members and 26 community partners including service providers and organization leaders participated in qualitative interviews. Study findings identified themes across the above aspects of community readiness that highlighted the devastating costs of youth violence for families, including being a victim of violence and the continual worry about youths’ safety that impacted day-to-day living and emotional health. In describing biggest concerns, community climate, and priorities for mobilization, participants focused on the need to address social and structural community-level risk factors for youth violence. Participants also described perspectives on barriers and supports related to community members’ openness to change, and discussed community strengths and resources. These results offered a context-specific picture of community readiness that has implications for youth violence prevention.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102623"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144314038","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Applying the RE-AIM framework to evaluate a diabetes prevention intervention delivered through a food bank","authors":"Elizabeth M. Felter ,&nbsp;Morgan Smith ,&nbsp;Kate Cheyne ,&nbsp;Martha Y. Orozco ,&nbsp;Eric A. Steiner ,&nbsp;Yuae Park ,&nbsp;Tiffany L. Gary-Webb","doi":"10.1016/j.evalprogplan.2025.102615","DOIUrl":"10.1016/j.evalprogplan.2025.102615","url":null,"abstract":"<div><h3>Background</h3><div>Food insecurity correlates with poorer general health and health outcomes, increased risk for chronic diseases, including diabetes, and increased healthcare expenditures.</div></div><div><h3>Objective</h3><div>To describe the application of the RE-AIM framework to evaluate the feasibility and effectiveness of an intervention aimed at improving diet, physical activity, and food security of food bank clients who were at risk for prediabetes.</div></div><div><h3>Methods</h3><div>Food bank clients in Alameda County, CA were screened for eligibility and enrolled (n = 249) in a 12-month program that provided supplemental healthy food, text-based targeted health promotion education, connection to community-based diabetes prevention programs (DPP), and referrals to healthcare. Project staff collected data through baseline, 6- and 12-month surveys, stakeholder interviews, and text-message engagement levels. We employed the RE-AIM framework to analyze program reach, effectiveness, adoption, implementation, and maintenance.</div></div><div><h3>Results</h3><div>There was high eligibility for, and interest in, the program. Program participants reported significant improvements in physical activity, nutrition, food security scores, and high satisfaction levels. However, connecting participants to DPP programming was challenging due to the infrastructure for DPP programs.</div></div><div><h3>Conclusions</h3><div>Food banks can effectively address prediabetes risk factors in food-insecure populations, but significant challenges remain in scaling DPP infrastructure for at-risk populations.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102615"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144314034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A digital media campaign to promote awareness of housing rights: Process evaluation of the Know Your Housing Rights campaign","authors":"Erika Bonnevie ,&nbsp;Sierra Smith ,&nbsp;Laura Lagunez-Ndereba ,&nbsp;Ellen Lawton ,&nbsp;Nick Garza ,&nbsp;Joe Smyser","doi":"10.1016/j.evalprogplan.2025.102642","DOIUrl":"10.1016/j.evalprogplan.2025.102642","url":null,"abstract":"<div><div>Housing security is a key social determinant of health, yet many individuals remain unaware of their rights and available resources. This study presents a process evaluation of the Know Your Housing Rights campaign, a digital media initiative designed to raise awareness of housing rights in Los Angeles and Denver counties.The campaign partnered with social media influencers and digital advertisements to engage target populations, directing them to an informational website with local resources. Fifty influencers participated, reaching a combined audience of over 1.2 million followers. A mixed-methods evaluation assessed campaign implementation, reach, and engagement through digital analytics, sentiment analysis of audience responses, and surveys and interviews with influencers. Findings suggest that influencer-driven content was well received, with predominantly positive audience sentiment and engagement. Influencers reported that participation aligned with their brand and were enthusiastic about disseminating housing rights information. The Know Your Housing Rights campaign illustrates the potential of digital media and influencer partnerships in promoting housing security messages. This approach offers a model for efforts targeting housing rights and other complex social determinants of health through digital strategies.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102642"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144502701","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}