{"title":"A university and community partnership that built capacity through program evaluation","authors":"Candace Lind , Beth Archer-Kuhn , Natalie Beltrano , Lisa Garrisen , Janet Hettler , Sandra M. Reilly , Leianne Vye-Rogers , Justine Reyes","doi":"10.1016/j.evalprogplan.2025.102669","DOIUrl":"10.1016/j.evalprogplan.2025.102669","url":null,"abstract":"<div><div>A community organization-university partnership was formed to complete program evaluation research to enhance the effectiveness of the organization in its efforts to improve the resiliency of families in crisis or in need of respite. Incorporating the voices of staff and former families who had the critical expertise and lived experiences with programs and evaluative tools undergirded this work. Six themes arose from focus groups and interview data that provided recommendations for leadership on the evaluative process and tools used and informed the literature review. The theoretical approach to this research highlighted program inequities and illuminated the need for more culturally safe program evaluation practices that respect diversity and inclusivity and focus on equity-building designs. Although time-consuming, front-line staff became familiar with their own program logic models, understood how they connected to their day-to-day work with children and families, and developed a sense of ownership through hands-on involvement. Importantly, logic model development was demystified. Recognizing the organization needed a less intimidating visual representation of their logic models, a one-page version was developed for each program along with fuller versions. A repository of measures developed for staff will ensure ongoing access to evidence-informed tools for updating the evaluative framework for their programs.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102669"},"PeriodicalIF":2.0,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144738120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jessica Antunes de Oliveira , Marco Tulio Aniceto França
{"title":"Evaluating the impact of the Programa Saúde na Escola on adolescent sexual and reproductive health in Brazil: A quasi-experimental analysis using propensity score matching","authors":"Jessica Antunes de Oliveira , Marco Tulio Aniceto França","doi":"10.1016/j.evalprogplan.2025.102661","DOIUrl":"10.1016/j.evalprogplan.2025.102661","url":null,"abstract":"<div><div>Promoting access to knowledge about sexual and reproductive health in schools is important for adolescents' development, serving as a protective factor against risky sexual behaviors. Therefore, the objective of the study is to evaluate the impact of the <em>Programa Saúde na Escola</em> (PSE) on sexual- and reproductive-health indicators, such as condom use and knowledge on the topic, using data from <em>Pesquisa Nacional de Saúde Escolar</em> (PeNSE) from 2019. The study is designed to provide representative results of students regularly enrolled in public and private schools across the entire national territory, using a probabilistic sample of Brazilian students. After adjustments, the final sample totaled 6.663 observations of students from public schools. In a quasi-experimental approach, a propensity score matching model is used, to compare students attending schools that participate in the program (treatment group) with those attending non-participating schools (control group). The results show that students from schools participating in the PSE report receiving more guidance on preventing pregnancy, sexually transmitted infection, and how to obtain free condoms. Furthermore, students at schools participating in the program start their sexual life slightly earlier. Significant results are found for the total sample and for girls. The variables related to effective condom use are not significant in any specification. These findings suggest that although access to information has increased, no changes in behavior are perceived, which opens space to consider improvements in the implementation of the program, such as strengthening partnerships with basic health units. A sensitivity analysis using the Rosenbaum limits test indicates no bias in the sample.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102661"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144714182","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Index-based assessment of stakeholder perception for participatory sustainable soil and water resources in a mountainous landscape","authors":"Fatemeh Kateb, Abazar Esmali Ouri , Raoof Mostafazadeh, Meraj Sharari, Zeinab Hazbavi","doi":"10.1016/j.evalprogplan.2025.102643","DOIUrl":"10.1016/j.evalprogplan.2025.102643","url":null,"abstract":"<div><div>The development and restoration of watersheds to achieve optimal conditions necessitates the involvement of the local community at various stages, including planning, implementation, and maintenance of watershed management projects. Identifying suitable indicators to measure the level of participation of people and stakeholders across these stages can help overcome barriers to participation in soil and water conservation efforts. This study estimates stakeholder participation in watershed management among different occupational groups (farmers, ranchers/farmers, employees/retirees, and others) in a mountainous watershed in Iran, using descriptive-analytical methods and field surveys across several villages in a mountainous region, and from a total of 842 households, Cochran’s formula determined a sample size of 86 households. Participation Indices were calculated for each occupational group. Farmers had the highest Participation Index in all stages, while employees/retirees had the lowest. Participation varied by village from 0.01 to 0.07. Low participation, due to a lack of knowledge about project implementation processes, employing non-native labor, and conflicts between the government and local communities, was lower than expected. Consequently, the overall level of stakeholder participation was lower than expected across various working groups, emphasizing the need for targeted managerial and executive actions and policies to remove barriers to participation throughout the planning processes. This finding emphasizes on the necessity of addressing the identified barriers to enhance local community involvement, and setting tailored strategies and policies to foster more active and informed participation in watershed management initiatives.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102643"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144517626","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Challenges to the implementation of guidance and counseling program in secondary schools of Tigray regional state, Ethiopia","authors":"Alemat Abay, Kibrom Adane, Teklay G.her","doi":"10.1016/j.evalprogplan.2025.102637","DOIUrl":"10.1016/j.evalprogplan.2025.102637","url":null,"abstract":"<div><div>The purpose of this study was to investigate the factors challenging the implementation of guidance and counseling program in secondary schools of Tigray as perceived by Students and Teachers. The study was a descriptive survey design. By using a self-response questionnaire, data were collected from a sample of 738 (334 Teachers and 404 Students) drawn from the target population of 1888 Teachers and 51291 Students, respectively. Stratified sampling design ending up with simple random sampling was used to select the sample subject. With the help of SPSS 20, the collected data were analyzed by using frequency, percentage, graphs, Mean & standard deviation, and t-test. The findings revealed that the Guidance and Counseling program in the schools was observed to have been challenged with deficiencies in: the Counselor’s competency & professional Ethics; Office Setting (Physical & Psychological); Students’ Perception & Awareness of the service; Support & Awareness by Teachers & school Leaders; and Time (Adequacy & Schedule). In addition, the Teachers’ and Students’ Awareness on: the presence of the guidance and counseling service; types of service available in the center; and benefits of the service to students were revealed to significantly explain the perceptions they hold concerning the role of guidance and counseling service. Further, about half of the Teachers and 66.34 % of the Students were found holding Medium to Low level of perception scores on the role of guidance and counseling service. Thus, it was concluded that the Schools’ guidance and counseling program was not in a position of supporting students in alleviating problems related to academic, vocational, social, and personal/emotional matters.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102637"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144514293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Does transitional housing matter? The contributions of a housing program on homeless youth’s outcomes","authors":"Pushpanjali Dashora , Shiva Kiaras","doi":"10.1016/j.evalprogplan.2025.102635","DOIUrl":"10.1016/j.evalprogplan.2025.102635","url":null,"abstract":"<div><div>Transitional Living Programs are popular interventions in Canada and the United States, for youth who are homeless or emerging from the foster care system. Some researchers have emphasized that an increased effectiveness of Transitional Living Programs is possible with an underlying philosophy such as Housing First or harm reduction. However, literature on the impact of these types of programs on homeless youth is limited. Given the lack of knowledge in this area, the aim of our longitudinal qualitative study was to understand the impact of a long-term transitional housing program, operating from a Housing First and harm reduction philosophy, on homeless youth. The 20-unit transitional housing program is in a large metropolitan Canadian city and provides support on-site. Homeless youth between the ages of 18–24, admitted into the transitional housing program were eligible for participation in the study. Fifteen youth participated in in-depth semi-structured interviews and assessments at baseline and seven youth were followed-up with 6 months later. The data was analyzed using the six-step process of thematic analysis. Youth reported that living in the transitional housing program over time contributed to decreased substance use and positively influenced their educational and career outcomes, interpersonal relationships, and health and well-being. Perhaps the most significant impact described by youth was the non-judgmental environment that parallels the Housing First and harm reduction philosophy of the program. Further, close relationships with staff were emphasized as a major driver for positive changes in participants’ outcomes over time. The current study also found substantial need for further research in areas such as aftercare for youth leaving transitional housing and the need for support for youth who must leave these programs prematurely.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102635"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144314037","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Can programme budget preparation mechanisms improve the allocation of public resources? Examples from ministries in Cameroon","authors":"Onana Simon Pierre, Ousmane Diaby","doi":"10.1016/j.evalprogplan.2025.102668","DOIUrl":"10.1016/j.evalprogplan.2025.102668","url":null,"abstract":"<div><div>This article examines the impact of programme budget preparation mechanisms on the allocation of public resources in Cameroon. To achieve this, we first conducted an exploratory study of eight officials involved in preparing the state budget. This exploratory study enabled us to develop the variables that would lead to an analytical model. A survey was carried out with 475 actors in the budget design process in central services of 29 ministries in Cameroon. Findings from simple probit regressions indicate that programme budget preparation mechanisms improve the allocation of budgetary resources in Cameroon. According to estimates, multi-annuality, expenditure reviews, performance measurement indicators and the structuring of appropriations into programmes, actions, activities and tasks have a positive impact on the allocation of budget revenue. However, this positive impact is mitigated by the Parliament's limited role in budgetary authorisation. The study recommends that external budgetary controls should be stepped up.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102668"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144702614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
María Fernanda Gambarini , Jose Manuel García Ramos
{"title":"Leadership for the common good. Design and validation of a measurement tool for university students (COMPLIZ).","authors":"María Fernanda Gambarini , Jose Manuel García Ramos","doi":"10.1016/j.evalprogplan.2025.102650","DOIUrl":"10.1016/j.evalprogplan.2025.102650","url":null,"abstract":"<div><div>It is essential that universities foster the development of leadership competences among students oriented towards social responsibility in their future professions, enabling them to make a positive contribution to the fulfilment of others and the betterment of society. Based on research into the principal competences associated with leadership, the construct <em>leadership for the common good</em> was developed consisting of a series of personal competences revealed in action and exemplifying the best of oneself, influencing and inspiring others to similar actions and behaviours. This article describes the design and validation process of an instrument to measure the acquisition of these competences among university students, with the aim of facilitating the development of effective teaching strategies and programs. The results indicate that the COMPLIZ questionnaire, with a unitary, bidimensional structure, is an effective and valid instrument for the measurement of competences associated with <em>leadership for the common good</em>.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102650"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144702617","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Semra Benzer , Farid Hassanbaki Garabaghi , Recep Benzer , Hicret Çimen Güni
{"title":"Sustainable environmental education: Some machine learning algorithms in the classification of sustainable environmental attitudes","authors":"Semra Benzer , Farid Hassanbaki Garabaghi , Recep Benzer , Hicret Çimen Güni","doi":"10.1016/j.evalprogplan.2025.102652","DOIUrl":"10.1016/j.evalprogplan.2025.102652","url":null,"abstract":"<div><div>Since the industrial revolution, human beings has shown a great unconscientiousness about the sustainable environment by polluting the air, water, and soil and rapidly consuming natural resources. Therefore, in the name of sustainable development, sustainable environmental education has become the center of attention of governments and consequently raising individuals with the necessary attitudes, values, understanding and skills in sustainable environment has become an important mission. This study was designed to firstly evaluate the students’ attitude towards a sustainable environment and secondly classify the target students based on their attitudes towards sustainable environment using machine learning methods based on a weighted score system based on a 5-point Likert type. The SVM-SMO classifier demonstrated superior performance compared to MLPNN, RBF Network, and Logistic Regression, especially when the training data was limited.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102652"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144631859","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Assessing community values of civil society organizations led coastal ecotourism conservation projects on climate change context","authors":"Ravi Sharma , Vishal Pradhan","doi":"10.1016/j.evalprogplan.2025.102624","DOIUrl":"10.1016/j.evalprogplan.2025.102624","url":null,"abstract":"<div><div>The study examines the key community values defining the Civil Society Organizations (CSOs) institutional climate capacity of coastal communities in the context of ecotourism-based conservation projects along the Maharashtra coastal belt, India. The study proposes conceptualized dimensions based on the Situation-Actor-Process-Learning (SAP-L) model. Data was collected through consultative approaches involving CSOs, NGOs, and SHGs, using focused group discussions and key informant interviews in the conservation project areas. The study evaluates the CSOs institutional strengths, weaknesses and determines key factors influence their institutional climate capacities. The findings indicate that CSO expertise and collaborations foster communication and trust among ecotourism beneficiaries, incorporating sociocultural factors and promoting climate action orientation. Planning and budgetary processes assist in need-based scenario planning for CSO management decisions. The outcomes contribute to understanding CSO’s climate capacity in coastal ecotourism, informing policy and practice. The study also emphasizes the need for further quantitative research in this area.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102624"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144262178","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Approaches to incorporating equity into program evaluation: A scoping review","authors":"Oeishi Faruquzzaman , Samson Tse , Ruth Cameron , Kenny Chee , Maritt Kirst , Ciann Wilson","doi":"10.1016/j.evalprogplan.2025.102648","DOIUrl":"10.1016/j.evalprogplan.2025.102648","url":null,"abstract":"<div><div>Recognizing the ways in which traditional program evaluation approaches can perpetuate and reinforce systemic oppression, the field of program evaluation is at a crossroads. There is a newfound focus on promoting and advancing social justice and equity in the field of program evaluation. There are various fields of evaluation that have a focus on equity, with some types of evaluation such as decolonial and culturally responsive evaluation having been well established and new approaches such as equitable evaluation. The present scoping review sought to create a snapshot of existing equitable evaluation and other evaluation approach literature that seek to advance equity in process and/or outcome. A scoping review of English academic and grey literature (<em>N</em> = 42) of equity-focused or promoting evaluation frameworks such as equitable evaluation, culturally responsive, anti-racist, decolonial, and Indigenous evaluation was conducted. After reviewing the literature, we identified seven common themes for advancing equity in evaluation: a consideration of context, engaging with program partners, adapting traditional evaluation instruments and methods, utilizing a strengths-based focus, engaging in self-reflection and self-learning, shifting/addressing power imbalances, and the use of participatory methods. Identified themes can act as guiding principles, with which to advance equity-focused evaluation practices. Implications and future directions in promoting social justice in the field of program evaluation are discussed.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102648"},"PeriodicalIF":1.5,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144611693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}