Evaluation and Program Planning最新文献_第8页

Assessing evaluation capacity in an early stage equity-focused organization 评估早期以股权为中心的组织的评估能力

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2025-06-03 DOI: 10.1016/j.evalprogplan.2025.102618

Rebecca H. Woodland , Vafa Alakbarova , Charlotte F. Elwell

{"title":"Assessing evaluation capacity in an early stage equity-focused organization","authors":"Rebecca H. Woodland , Vafa Alakbarova , Charlotte F. Elwell","doi":"10.1016/j.evalprogplan.2025.102618","DOIUrl":"10.1016/j.evalprogplan.2025.102618","url":null,"abstract":"<div><div>Over an eight-month period, we systematically assessed the evaluation capacity of SJC, a developing agency committed to advancing culturally responsive education through resource provision and professional development. This capacity assessment was undertaken to inform the future design and implementation of a comprehensive program evaluation plan tailored to SJC’s evolving operational and programmatic needs. To carry out this capacity assessment, our team employed a mixed-methods approach that included social network analysis, qualitative interviews, a stakeholder survey, and a review of existing organizational datasets. In this paper, we describe our evaluation methods, findings, and the actions that we recommended that SJC leaders take to strengthen their organization’s capacity for learning, program evaluation, and data-informed decision-making. We reflect on key lessons learned about assessing organizational capacity for learning and evaluation in small, emergent, mission-driven agencies. One important insight was the critical importance of embracing cultural humility when navigating evaluator-stakeholder power dynamics and paradigmatic dissonance—particularly when external evaluators are invited to “diagnose” organizational capacity and prescribe improvement strategies. Prioritizing the values, experiences, and cultural context of SJC, rather than imposing a top-down, expert-driven approach, was essential to ensuring the credibility, utility, and relevance of our findings. Additionally, from a technical perspective, the use of social network analysis proved highly valuable in illuminating SJC’s internal communication patterns and how such structures may enable or constrain organizational learning, evaluation, and project management—core functions essential to advancing SJC’s mission and organizational effectiveness.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102618"},"PeriodicalIF":1.5,"publicationDate":"2025-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144306722","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Retrospective review of a carer-employee workplace intervention 工作场所干预的回顾性评价

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2025-06-03 DOI: 10.1016/j.evalprogplan.2025.102620

Allison Williams , Regina Ding , Joonsoo Sean Lyeo

{"title":"Retrospective review of a carer-employee workplace intervention","authors":"Allison Williams , Regina Ding , Joonsoo Sean Lyeo","doi":"10.1016/j.evalprogplan.2025.102620","DOIUrl":"10.1016/j.evalprogplan.2025.102620","url":null,"abstract":"<div><div>In response to a growing aging population, carer-employees – who balance both unpaid care and paid employment, have become an increasingly normative phenomenon. In order to support the growing population of carer-employees, some employers have implemented carer-friendly workplace policies aimed at keeping carer-employees employed and healthy. This study sought to retrospectively review the effectiveness of one such carer-employee workplace intervention which had been implemented in a post-secondary institution located in Southern Ontario. The study consisted of a thematic analysis of fourteen semi-structured post-intervention interviews from carer-employee participants. A thematic analysis of the interview transcripts revealed the following themes: (i) the pre-existing circumstances of participants; (ii) recommendations made by participants to improve the intervention; (iii) benefits participants received from the intervention; and (iv) factors limiting the benefits participants received from the intervention. Furthermore, the thematic analysis revealed several positive outcomes commonly experienced by intervention participants, namely: improvements in self-reported mental and physical wellbeing, greater self-confidence in caregiving abilities, and access to respite. These findings align with the larger literature on carer-employees and caregiver-friendly workplace policies.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102620"},"PeriodicalIF":1.5,"publicationDate":"2025-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144205794","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A scoping review of program evaluations in non-profit alcohol and other drugs service settings: Considerations for service and research partnerships 非营利性酒精和其他药物服务机构方案评估的范围审查：对服务和研究伙伴关系的考虑

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2025-06-03 DOI: 10.1016/j.evalprogplan.2025.102614

Emily Deans , George Economidis , Peter Gates , Andrea Zocco , Robert Stirling , Sally Nathan , Suzie Hudson , Sara Farnbach

{"title":"A scoping review of program evaluations in non-profit alcohol and other drugs service settings: Considerations for service and research partnerships","authors":"Emily Deans , George Economidis , Peter Gates , Andrea Zocco , Robert Stirling , Sally Nathan , Suzie Hudson , Sara Farnbach","doi":"10.1016/j.evalprogplan.2025.102614","DOIUrl":"10.1016/j.evalprogplan.2025.102614","url":null,"abstract":"<div><h3>Introduction</h3><div>The non-profit sector contributes significantly to preventing and reducing harm from alcohol and other drugs (AOD). However, it can experience challenges when demonstrating impact via feasible and rigorous evaluation.</div></div><div><h3>Methods</h3><div>We conducted a scoping review to identify characteristics of, and barriers/enablers to, evaluations completed in non-profit AOD services, and to ascertain the degree of collaboration between researchers and service providers during three evaluation phases (preparatory, conduct; and dissemination and implementation). We searched EMBASE and Medline from inception to February 2023 for evaluations completed in small to medium non-profit AOD services. Screening and extraction were completed by three reviewers independently, and 80 % were checked by an additional reviewer.</div></div><div><h3>Results</h3><div>Ultimately, 56 records were included in this study. Included evaluations were largely initiated by researchers, with limited input from service providers in setting the agenda for the evaluations (preparatory phase) or translating findings into practice (dissemination and implementation phase). Where collaborations between researchers and service providers were in place, they generated funding and strong engagement with participants, leading to better recruitment, more complete data collection, and enhanced evaluation outcomes.</div></div><div><h3>Conclusion</h3><div>The review raises important implications for researchers and service providers to prioritise meaningful collaboration and innovation to inform appropriate selection of evaluation topics and designs. Specifically, such evaluations should generate knowledge which can be translated into practice, demonstrating the impact of services and programs and an evidence base built in the non-profit sector.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"112 ","pages":"Article 102614"},"PeriodicalIF":1.5,"publicationDate":"2025-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144270663","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Use of outcome harvesting to understand the outcomes of a COVID-19 pandemic leadership and management program in six countries 利用成果收集了解六个国家COVID-19大流行领导和管理项目的成果

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2025-06-01 DOI: 10.1016/j.evalprogplan.2025.102619

Nicole B. Carbone , Nathalie Alberto , Kate Henderson , Nina Pruyn , Wawira Munyi , Paul Waibale , Briana Lucido

{"title":"Use of outcome harvesting to understand the outcomes of a COVID-19 pandemic leadership and management program in six countries","authors":"Nicole B. Carbone , Nathalie Alberto , Kate Henderson , Nina Pruyn , Wawira Munyi , Paul Waibale , Briana Lucido","doi":"10.1016/j.evalprogplan.2025.102619","DOIUrl":"10.1016/j.evalprogplan.2025.102619","url":null,"abstract":"<div><div>The global response to COVID-19 highlighted gaps in pandemic preparedness and response. The Leading and Managing for Results in Pandemics (LMRP) program was developed to strengthen the capacity of public health leaders responding to COVID-19. To assess the influence of the program on applying leadership and management practices and on pandemic readiness, a mixed methods outcome harvesting evaluation approach was adapted. Quantitative programmatic data and supplemental qualitative program participant interview data were analyzed to inform draft outcomes. Program participants validated outcomes, which were then updated, triangulated, and used to inform recommendations. The results illustrated increases in applying leadership and management practices, and improvements in team dynamics and morale. Themes from the qualitative interviews included strengthened teamwork, leadership skills, and ability to manage disease outbreaks and future pandemics. The validated outcomes described improvements in leadership and management skills, pandemic readiness, and interpersonal skills following LMRP participation. The evaluation found evidence that LMRP program participants gained knowledge, skills, and tools, which they applied to perform more effectively as a team and to lead preparation for and management of public health emergencies and disease outbreaks. The program brought about positive changes in the systems and processes through which participants approach their work and apply the leading and managing practices to collaboratively work towards a common goal. Similar evaluation approaches should be utilized to understand and contribute to the limited available evidence on the effect of capacity strengthening programs on developing and applying leadership and management skills.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102619"},"PeriodicalIF":1.5,"publicationDate":"2025-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144205545","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Anti-disciplinary research on how to investigate poverty using the smart city concept 关于如何利用智慧城市概念调查贫困的反学科研究

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2025-05-31 DOI: 10.1016/j.evalprogplan.2025.102616

Milad Pira

{"title":"Anti-disciplinary research on how to investigate poverty using the smart city concept","authors":"Milad Pira","doi":"10.1016/j.evalprogplan.2025.102616","DOIUrl":"10.1016/j.evalprogplan.2025.102616","url":null,"abstract":"<div><div>Investigating a multidimensional phenomenon is always a challenge for researchers and decision-makers. This will be more drastic if the main objective is addressing a multifaceted social issue such as poverty. Smart city is a rich urban concept that offers several technological and non-technological solutions for socio-economic challenges. Smart city is also a multidimensional phenomenon which makes more impediments for a study to address another multidimensional discipline. Anti-disciplinary approaches offer a unique process to connect two unfamiliar multifaceted concepts. The current research aims to investigate poverty by using the smart city concept through an anti-disciplinary approach by reviewing all components of smart city and poverty-reduction projects. The results will be based on Ito’s ten propositions for an anti-disciplinary study which include a variety of practical and conceptual factors. The findings suggest these propositions as guidelines to assist researchers and policymakers to use the smart city concept to explore root causes of poverty, to invite all key stakeholders to share their ideas and recommendations, to empower vulnerable women, youths, and single parents, to adopt innovative solutions, as well as to utilize new tools and devices to assure successful outcomes.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102616"},"PeriodicalIF":1.5,"publicationDate":"2025-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144205793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Exploring the effects of community-based volunteering to support older adults on volunteers: A mixed methods study in Ontario, Canada 探讨以社区为基础的老年人志愿服务对志愿者的影响：加拿大安大略省的一项混合方法研究

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2025-05-31 DOI: 10.1016/j.evalprogplan.2025.102617

Jessica Gaber , Fiona Parascandalo , Stephanie Di Pelino , Julie Datta , Larkin Lamarche , Housne Begum , Rebecca E. Clark , Cherie Gagnon , Doug Oliver , David Price , Dee Mangin

{"title":"Exploring the effects of community-based volunteering to support older adults on volunteers: A mixed methods study in Ontario, Canada","authors":"Jessica Gaber , Fiona Parascandalo , Stephanie Di Pelino , Julie Datta , Larkin Lamarche , Housne Begum , Rebecca E. Clark , Cherie Gagnon , Doug Oliver , David Price , Dee Mangin","doi":"10.1016/j.evalprogplan.2025.102617","DOIUrl":"10.1016/j.evalprogplan.2025.102617","url":null,"abstract":"<div><div>Volunteers support community health worldwide. Volunteers themselves experience positive outcomes. Gaps in the literature include volunteers across the lifespan, and outcomes related to specific program elements. Our objective was to understand how volunteering with a program supporting older adults with health and life goals impacted volunteers. We used a convergent mixed methods design in six sites across Ontario, Canada. Data were collected through focus groups/interviews, volunteer-written narratives, and surveys. Analysis included thematic analysis, descriptive statistics, paired t-tests, and convergence of qualitative and quantitative results. Overall, 23 volunteers participated in focus groups/interviews and 31 completed surveys (11 overlapped). Key qualitative impacts were: opportunity to meet new people, see new places, and learn about the community; planning healthy behaviour change; improved communication and people skills; learning about older adults and their health; feelings of contribution; building or maintaining career skills; and some impacts on emotional or cognitive health. Between baseline and 12-months, vigorous physical activity and quality of life had low-medium increases. These results can help those seeking to build effective volunteer programs in the future. We suggest future evaluations to understand volunteer outcomes should include domains related to volunteerism in general as well as outcomes related to specific program elements.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102617"},"PeriodicalIF":1.5,"publicationDate":"2025-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144205792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Barriers to child nutrition in Bengaluru slums: Caregiver insights from the SCOPE strategy 班加罗尔贫民窟儿童营养障碍：SCOPE战略对看护者的见解

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2025-05-29 DOI: 10.1016/j.evalprogplan.2025.102612

Kristen P. Yang , Tammy M. Bray , Angela Chaudhuri , Syama B. Syam , Sunil K. Khanna

{"title":"Barriers to child nutrition in Bengaluru slums: Caregiver insights from the SCOPE strategy","authors":"Kristen P. Yang , Tammy M. Bray , Angela Chaudhuri , Syama B. Syam , Sunil K. Khanna","doi":"10.1016/j.evalprogplan.2025.102612","DOIUrl":"10.1016/j.evalprogplan.2025.102612","url":null,"abstract":"<div><div>Child undernutrition and protein insecurity remain a critical global issue, particularly in urban slums, driven by multiple socioeconomic and structural barriers. This study applies the Sustainable Community Partnership and Empowerment (SCOPE) strategy to assess challenges and inform the development of a culturally appropriate protein-feeding program for malnourished children in Indian slums. A qualitative approach using focus group discussions was conducted with twenty-one primary caregivers of twenty-four malnourished preschool children aged 3–6 years in Bengaluru, India, to evaluate perceptions of child nutrition, barriers to accessing protein-rich foods, economic constraints, and intervention preferences in slum settings. Data were analyzed using grounded theory and the Social-Ecological model (SEM) to categorize barriers at individual, household, organizational, community, and government levels. Key barriers included limited protein intake, picky eating, preference for junk food at the individual level, economic hardships, and lack of family support at the household level. Caregivers emphasized the need for sustainable solutions from organizational and community help, such as school meal programs and community partnerships, to improve access to affordable, protein-rich foods. Findings highlight the complex interplay of economic, cultural, and systemic factors influencing child nutrition. Results suggest a community-centered, collaborative program for sustainable interventions, prioritizing high-quality protein provision, child-friendly engagement strategies, and caregiver empowerment through education and partnerships with local stakeholders. This study underscores the necessity of integrated, context-specific, community-based programs to effectively address child undernutrition in urban slums and other resource-limited settings worldwide.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102612"},"PeriodicalIF":1.5,"publicationDate":"2025-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144184995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Professionalism in evaluation: Development and validation of a theory-based assessment tool in the U.S. context 评估的专业性：美国背景下基于理论的评估工具的发展和验证

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2025-05-27 DOI: 10.1016/j.evalprogplan.2025.102613

Sandra Nyashaddai Ayoo

{"title":"Professionalism in evaluation: Development and validation of a theory-based assessment tool in the U.S. context","authors":"Sandra Nyashaddai Ayoo","doi":"10.1016/j.evalprogplan.2025.102613","DOIUrl":"10.1016/j.evalprogplan.2025.102613","url":null,"abstract":"<div><div>While professionalization of program evaluation is garnering increasing attention in the literature, a notable gap exists in the absence of a validated, theory-based framework to both comprehend and empirically assess the attributes of a professional evaluator. This study contributes to the debate on the professionalism of evaluators in two ways: by elaborating a multidimensional, theory-based conceptualization of evaluator professionalism, and by developing and testing a professionalism self-assessment tool for novice and practicing evaluators to assess their levels of professionalism. The five dimensions of the tool developed using the sociological model were: expertise, innovation and research, professional autonomy, ethical dispositions, and credentialing. The model was validated using data from online survey administered to a random sample of 2000 members of the American Evaluation Association drawn from the 2018 membership directory. This study provides evidence that the professionalism assessment tool used with both novice and experienced evaluators produced reliable scores and demonstrated validity in measuring key attributes of evaluator professionalism.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102613"},"PeriodicalIF":1.5,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144189509","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Factors for dissemination and implementation of community reinforcement and family training in Japan: A pilot study 日本社区强化和家庭培训的传播和实施因素：一项试点研究

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2025-05-27 DOI: 10.1016/j.evalprogplan.2025.102608

Aya Yamamoto , Hendrik G. Roozen

{"title":"Factors for dissemination and implementation of community reinforcement and family training in Japan: A pilot study","authors":"Aya Yamamoto , Hendrik G. Roozen","doi":"10.1016/j.evalprogplan.2025.102608","DOIUrl":"10.1016/j.evalprogplan.2025.102608","url":null,"abstract":"<div><h3>Background</h3><div>Community Reinforcement and Family Training (CRAFT) is an evidence-based training-program, specifically geared to assist family members of identified patients with problems in the area of substance use, autism, psychosis, “hikikomori”, etc. The purpose of this qualitative research is to examine therapists’ barriers and facilitators to apply CRAFT in general practice, by means of interviews and questionnaire surveys.in Japan.</div></div><div><h3>Method</h3><div>By using snowball sampling techniques, nine Japanese therapists were recruited. Subsequently, these therapists had the ambition to enroll the CRAFT certification process, according an advance therapist-expert feedback system based on audio-tapes. Assessment about therapists’ barriers and facilitators aimed to disseminate and implement CRAFT were completed online during a 30–60 minutes semi-structured interview. Furthermore, implementation outcomes measures were also collected.</div></div><div><h3>Result</h3><div>Data of nine therapists were collected showing multiple aspects that promote or impede the application of CRAFT in daily routine practice. In general, it was shown that private costs for attending expert training and coding, working with a protocol, may impede the dissemination of CRAFT in Japan.</div></div><div><h3>Conclusion</h3><div>CRAFT is well-received by Japanese therapists, although some barriers remain that need to be addressed to promote a more widely dissemination.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102608"},"PeriodicalIF":1.5,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144189510","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

An institutional analysis of performance and impact of farmer producer organizations using PLS path modeling 利用PLS路径模型对农民生产者组织的绩效和影响进行制度分析

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2025-05-23 DOI: 10.1016/j.evalprogplan.2025.102609

Haripriya Veesam , Vinayak Nikam , Mrinmoy Ray

引用次数: 0