Evaluation and Program Planning最新文献

{"title":"Established but unused? An empirical study on the impact of health records on the utilization of basic public health services in China","authors":"Xiafei Tao ,&nbsp;Si Shi ,&nbsp;Junqiang Liu","doi":"10.1016/j.evalprogplan.2025.102654","DOIUrl":"10.1016/j.evalprogplan.2025.102654","url":null,"abstract":"<div><h3>Objectives</h3><div>Health records are crucial for implementing basic public health services (BPHSs) in China, yet their utilization rate lags behind the coverage rate. This study aimed to provide insights into the underutilization issue by exploring whether health records facilitate the utilization of other BPHSs.</div></div><div><h3>Methods</h3><div>We conducted empirical analyses to examine the impact of health records on the utilization of two specific BPHSs: health education and health management services for patients with hypertension and type 2 diabetes mellitus (T2DM). Multiple linear regression and binary logistic models were employed in the analyses. Additionally, we used the propensity score matching approach to address potential biases.</div></div><div><h3>Results</h3><div>Health records significantly enhanced the diversity of health education attended by residents, fostered active engagement in health education, and facilitated the utilization of corresponding health management services for patients with hypertension and T2DM.</div></div><div><h3>Conclusions</h3><div>Despite widespread skepticism concerning the utilization rate of health records, our findings provided empirical evidence that health records may benefit citizens’ self-health management and the utilization of other BPHSs. However, the specific mechanism of this impact needs to be further investigated. This study offers insights into the evaluation of public health programs in the Chinese context and highlights their implications for promoting health equity.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102654"},"PeriodicalIF":1.5,"publicationDate":"2025-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144663488","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Approaches to incorporating equity into program evaluation: A scoping review","authors":"Oeishi Faruquzzaman ,&nbsp;Samson Tse ,&nbsp;Ruth Cameron ,&nbsp;Kenny Chee ,&nbsp;Maritt Kirst ,&nbsp;Ciann Wilson","doi":"10.1016/j.evalprogplan.2025.102648","DOIUrl":"10.1016/j.evalprogplan.2025.102648","url":null,"abstract":"<div><div>Recognizing the ways in which traditional program evaluation approaches can perpetuate and reinforce systemic oppression, the field of program evaluation is at a crossroads. There is a newfound focus on promoting and advancing social justice and equity in the field of program evaluation. There are various fields of evaluation that have a focus on equity, with some types of evaluation such as decolonial and culturally responsive evaluation having been well established and new approaches such as equitable evaluation. The present scoping review sought to create a snapshot of existing equitable evaluation and other evaluation approach literature that seek to advance equity in process and/or outcome. A scoping review of English academic and grey literature (<em>N</em> = 42) of equity-focused or promoting evaluation frameworks such as equitable evaluation, culturally responsive, anti-racist, decolonial, and Indigenous evaluation was conducted. After reviewing the literature, we identified seven common themes for advancing equity in evaluation: a consideration of context, engaging with program partners, adapting traditional evaluation instruments and methods, utilizing a strengths-based focus, engaging in self-reflection and self-learning, shifting/addressing power imbalances, and the use of participatory methods. Identified themes can act as guiding principles, with which to advance equity-focused evaluation practices. Implications and future directions in promoting social justice in the field of program evaluation are discussed.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102648"},"PeriodicalIF":1.5,"publicationDate":"2025-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144611693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluating sport-for-development outcome measures used in a living lab setting: Process, improvements, and insights","authors":"Bhanu Sharma ,&nbsp;Jackie Robinson ,&nbsp;Benjamin B. Arhen ,&nbsp;Brian W. Timmons ,&nbsp;Bryan Heal ,&nbsp;Marika Warner","doi":"10.1016/j.evalprogplan.2025.102647","DOIUrl":"10.1016/j.evalprogplan.2025.102647","url":null,"abstract":"<div><h3>Background</h3><div>Sport-for-development (SFD) is an innovative approach utilizing sport to foster positive physical, mental, and social outcomes among children and youth, particularly those from underserved backgrounds. Living labs, which emphasize participant-centered research conducted in natural, real-world environments, present unique challenges for outcome measurement, including reduced control over conditions, variability in participant engagement, and logistical issues that complicate standardized data collection. Further, there are few outcome measures that are developed for SFD measurement in living lab settings. For these reasons, outcome measurement in a living lab setting remains challenging.</div></div><div><h3>Objective</h3><div>Our objective was to evaluate a set of outcome measures that have been administered in a living lab setting to better understand their performance, reliability, and areas for improvement.</div></div><div><h3>Methods</h3><div>SFD programming was delivered in a living lab setting at a large facility located in an urban center in Toronto, Canada. We evaluated 11, self-reported, Likert-style outcome measures against 8 key metrics used in Classical Test Theory to understand (for example) floor-and-ceiling effects, inter-item correlations, internal consistency, and test-retest reliability. Data were collected from 2019 to 2024 across multiple cohorts aged 6–29 years, involving diverse SFD programs.</div></div><div><h3>Results</h3><div>Our analysis of 2656 questionnaire completions demonstrated strengths in data collection, including complete response rates with minimal missing data (91 % of outcome measures met missingness thresholds), yet also highlighted issues primarily related to single-item-endorsement and inter-item correlations (with 38 % and 19 % of outcome measures meeting these thresholds, respectively). These insights prompted iterative improvements to the evaluation tools, such as modifying Likert scale response formats to include more response categories (and thereby reducing the impact of binning of responses).</div></div><div><h3>Conclusions</h3><div>Evaluating our outcome measures provided insight into how they can be improved for administration in a living-lab setting. The results emphasize the need for context-appropriate tools to effectively capture nuanced SFD program impacts and underscore the importance of ongoing validation to improve both research quality and practical implementation in living lab environments.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102647"},"PeriodicalIF":1.5,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144571576","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A systematic review of school-based disaster risk reduction strategies in India","authors":"Tisha Goswami ,&nbsp;Ansar Ahmad","doi":"10.1016/j.evalprogplan.2025.102646","DOIUrl":"10.1016/j.evalprogplan.2025.102646","url":null,"abstract":"<div><div>India is a diverse country, which experiences different types of disasters in different geographical regions. To reduce the impact of such disasters, the schools need to adopt relevant Disaster Risk Reduction (DRR) strategies and equip the students with relevant disaster knowledge to face future disasters. This study presents a systematic review of research on DRR initiatives aimed at Indian school students. The second section of the paper identified the main themes and pertinent recommendations gleaned from those studies. The studies were searched from January 1, 2000, to January 31, 2024, using specific keywords related to DDR, schools, and students. 67 relevant studies, including articles, book chapters, conference papers, and theses, were finalized using PRISMA guidelines. The components of the finalized studies were analyzed based on the year of publication, type of studies, type of data analyzed, the methods used for analysis, the study areas, and the kind of disasters studied. Then, the four themes were identified for thematic analysis: (1) the need to incorporate DRR in the school curriculum (46 %), (2) the emergence of online education as a DRR strategy (27 %), (3) the impact of disasters on disadvantaged students and their mental health (16 %), and (4) the importance of safe and resilient school infrastructure (11 %). The study concluded that the implementation of DRR in Indian schools is necessary to establish a resilient education system that can withstand future disasters. It suggested sensitizing the researchers to conduct more research in this field in India along with the cooperative efforts of all stakeholders in strengthening DRR in the schools.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102646"},"PeriodicalIF":1.5,"publicationDate":"2025-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144523466","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Protocol for the pragmatic evaluation of the Department of the Air Force’s Personal Financial Readiness Program","authors":"Catherine Walker O’Neal ,&nbsp;Mallory Lucier-Greer ,&nbsp;Evin W. Richardson ,&nbsp;Haley E. Miranda ,&nbsp;Allan Tate ,&nbsp;Brian K. McKay","doi":"10.1016/j.evalprogplan.2025.102645","DOIUrl":"10.1016/j.evalprogplan.2025.102645","url":null,"abstract":"<div><div>Federal policy mandates that United States military members receive numerous financial trainings across their career to improve their financial literacy and equip them to make informed financial decisions that, ultimately, promote positive individual and family well-being. Connected to this mandate, systematic evaluation efforts of the Department of the Air Force’s Personal Financial Readiness program were initiated to identify program outcomes and downstream results while simultaneously informing program improvements and modifications. When situated in a discussion of evaluation theory and design practices, documenting these outcome and process evaluation protocols can provide valuable insight for scientist-practitioners designing multi-site program evaluations in the context of real-world constraints, as is often the case for large institutions, including the military. The evaluation design includes a prospective cohort design for the <em>outcome</em> evaluation with surveys completed before and after training and 3- and 6-months following training. The surveys provide data on short-, mid-, and long-term outcomes. Data collected for the <em>process</em> evaluation, include targeted surveys and interviews with individuals conducting and participating in the training. Together, this protocol illustrates a theory-informed evaluation design of a complex, multi-site set of trainings utilizing diverse data collection methods to conduct a rigorous outcome and process evaluation.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102645"},"PeriodicalIF":1.5,"publicationDate":"2025-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144535974","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Index-based assessment of stakeholder perception for participatory sustainable soil and water resources in a mountainous landscape","authors":"Fatemeh Kateb,&nbsp;Abazar Esmali Ouri ,&nbsp;Raoof Mostafazadeh,&nbsp;Meraj Sharari,&nbsp;Zeinab Hazbavi","doi":"10.1016/j.evalprogplan.2025.102643","DOIUrl":"10.1016/j.evalprogplan.2025.102643","url":null,"abstract":"<div><div>The development and restoration of watersheds to achieve optimal conditions necessitates the involvement of the local community at various stages, including planning, implementation, and maintenance of watershed management projects. Identifying suitable indicators to measure the level of participation of people and stakeholders across these stages can help overcome barriers to participation in soil and water conservation efforts. This study estimates stakeholder participation in watershed management among different occupational groups (farmers, ranchers/farmers, employees/retirees, and others) in a mountainous watershed in Iran, using descriptive-analytical methods and field surveys across several villages in a mountainous region, and from a total of 842 households, Cochran’s formula determined a sample size of 86 households. Participation Indices were calculated for each occupational group. Farmers had the highest Participation Index in all stages, while employees/retirees had the lowest. Participation varied by village from 0.01 to 0.07. Low participation, due to a lack of knowledge about project implementation processes, employing non-native labor, and conflicts between the government and local communities, was lower than expected. Consequently, the overall level of stakeholder participation was lower than expected across various working groups, emphasizing the need for targeted managerial and executive actions and policies to remove barriers to participation throughout the planning processes. This finding emphasizes on the necessity of addressing the identified barriers to enhance local community involvement, and setting tailored strategies and policies to foster more active and informed participation in watershed management initiatives.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102643"},"PeriodicalIF":1.5,"publicationDate":"2025-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144517626","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A digital media campaign to promote awareness of housing rights: Process evaluation of the Know Your Housing Rights campaign","authors":"Erika Bonnevie ,&nbsp;Sierra Smith ,&nbsp;Laura Lagunez-Ndereba ,&nbsp;Ellen Lawton ,&nbsp;Nick Garza ,&nbsp;Joe Smyser","doi":"10.1016/j.evalprogplan.2025.102642","DOIUrl":"10.1016/j.evalprogplan.2025.102642","url":null,"abstract":"<div><div>Housing security is a key social determinant of health, yet many individuals remain unaware of their rights and available resources. This study presents a process evaluation of the Know Your Housing Rights campaign, a digital media initiative designed to raise awareness of housing rights in Los Angeles and Denver counties.The campaign partnered with social media influencers and digital advertisements to engage target populations, directing them to an informational website with local resources. Fifty influencers participated, reaching a combined audience of over 1.2 million followers. A mixed-methods evaluation assessed campaign implementation, reach, and engagement through digital analytics, sentiment analysis of audience responses, and surveys and interviews with influencers. Findings suggest that influencer-driven content was well received, with predominantly positive audience sentiment and engagement. Influencers reported that participation aligned with their brand and were enthusiastic about disseminating housing rights information. The Know Your Housing Rights campaign illustrates the potential of digital media and influencer partnerships in promoting housing security messages. This approach offers a model for efforts targeting housing rights and other complex social determinants of health through digital strategies.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102642"},"PeriodicalIF":1.5,"publicationDate":"2025-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144502701","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Challenges to the implementation of guidance and counseling program in secondary schools of Tigray regional state, Ethiopia","authors":"Alemat Abay,&nbsp;Kibrom Adane,&nbsp;Teklay G.her","doi":"10.1016/j.evalprogplan.2025.102637","DOIUrl":"10.1016/j.evalprogplan.2025.102637","url":null,"abstract":"<div><div>The purpose of this study was to investigate the factors challenging the implementation of guidance and counseling program in secondary schools of Tigray as perceived by Students and Teachers. The study was a descriptive survey design. By using a self-response questionnaire, data were collected from a sample of 738 (334 Teachers and 404 Students) drawn from the target population of 1888 Teachers and 51291 Students, respectively. Stratified sampling design ending up with simple random sampling was used to select the sample subject. With the help of SPSS 20, the collected data were analyzed by using frequency, percentage, graphs, Mean &amp; standard deviation, and t-test. The findings revealed that the Guidance and Counseling program in the schools was observed to have been challenged with deficiencies in: the Counselor’s competency &amp; professional Ethics; Office Setting (Physical &amp; Psychological); Students’ Perception &amp; Awareness of the service; Support &amp; Awareness by Teachers &amp; school Leaders; and Time (Adequacy &amp; Schedule). In addition, the Teachers’ and Students’ Awareness on: the presence of the guidance and counseling service; types of service available in the center; and benefits of the service to students were revealed to significantly explain the perceptions they hold concerning the role of guidance and counseling service. Further, about half of the Teachers and 66.34 % of the Students were found holding Medium to Low level of perception scores on the role of guidance and counseling service. Thus, it was concluded that the Schools’ guidance and counseling program was not in a position of supporting students in alleviating problems related to academic, vocational, social, and personal/emotional matters.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102637"},"PeriodicalIF":1.5,"publicationDate":"2025-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144514293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Development of a health promoting sports clubs intervention: An intervention mapping process analysis","authors":"Van Hoye ,&nbsp;Stacey Johnson ,&nbsp;Florence Rostan ,&nbsp;Fabienne Lemonnier ,&nbsp;Benjamin Tezier ,&nbsp;Susanna Geidne ,&nbsp;Alex Donaldson ,&nbsp;Anne Vuillemin","doi":"10.1016/j.evalprogplan.2025.102640","DOIUrl":"10.1016/j.evalprogplan.2025.102640","url":null,"abstract":"<div><div>Developing and implementing health promotion interventions in sports clubs is challenging. Implementing interventions in real world settings should be specific to a sports club’s context, particularly their voluntary nature. The present study maps and analyzes the development of the PROSCeSS intervention, designed to support sports clubs to implement health promotion. A case study design mobilising Intervention Mapping — needs assessment, matrix of change, theory of action, program design, plan for adoption and implementation and evaluation — describes the multi-phase intervention. Results encompass the main findings from i) a literature review and a concept mapping study as a needs assessment; ii) a Delphi study and health promoting sports club intervention framework to design the matrix of change; iii) a case study among sports clubs and sports federations to select the theory of action; iv) the intervention co-construction to create the program; v) results from a pilot study to validate the plan for adoption; and vi) implementation and presentation of the e-PROSCeSS questionnaire creation and hybrid type-3 protocol as an evaluation method. The discussion explores the tensions created between evidence driven strategies and the habits of sports clubs, the use of top-down versus bottom-up approaches and reflections on the recursive rather than linear process adopted by the authors.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102640"},"PeriodicalIF":1.5,"publicationDate":"2025-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144502702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Developing guiding principles with a community of neurodiverse individuals: An essential first step toward principles-focused evaluation","authors":"Jennifer Jewiss ,&nbsp;Valerie F. Wood ,&nbsp;Katharine G. Shepherd ,&nbsp;Dorsey Massey ,&nbsp;Allison Kleinman ,&nbsp;Caitlin McInerney","doi":"10.1016/j.evalprogplan.2025.102641","DOIUrl":"10.1016/j.evalprogplan.2025.102641","url":null,"abstract":"<div><div>Leaders of organizations serving individuals with disabilities often view their work as rooted in core values. Michael Quinn Patton, a prominent evaluation expert, provides an opportunity to frame the development and evaluation of organizational endeavors around guiding principles or values in action. The following account illustrates how a principles-focused approach can meaningfully engage adults with disabilities in evaluation efforts, empowering individuals that are frequently excluded. We describe the process used to develop a set of guiding principles for Adaptations, a non-residential community serving neurodiverse adults at the Jack and Shirley Silver Center for Diverse Abilities. This six-month evaluation technical assistance project was designed to explore how Adaptations might approach evaluation in a manner that aligns with its core values of belonging, inclusion, and self-determination. To inform the development of Adaptations' six guiding principles, we orchestrated a day-long workshop with a cross-section of community members. The principles subsequently informed the organization’s internal data collection efforts. The article concludes with reflections on lessons learned, including the value of approaching this effort with a co-learning lens and engaging community members in identifying guiding principles for future use in principles-focused evaluation.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102641"},"PeriodicalIF":1.5,"publicationDate":"2025-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144563584","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}