Brandon A. Knettel , Ismail Amiri , Elizabeth T. Knippler , Kim Madundo , Elizabeth F. Msoka , Clotilda Tarimo , Victor Katiti , Louise Joel , Jackline Rwakilomba , Blandina T. Mmbaga , Michael V. Relf , David B. Goldston
{"title":"Development of a brief telehealth-delivered counseling intervention to reduce suicide risk and improve HIV care engagement in Kilimanjaro, Tanzania","authors":"Brandon A. Knettel , Ismail Amiri , Elizabeth T. Knippler , Kim Madundo , Elizabeth F. Msoka , Clotilda Tarimo , Victor Katiti , Louise Joel , Jackline Rwakilomba , Blandina T. Mmbaga , Michael V. Relf , David B. Goldston","doi":"10.1016/j.evalprogplan.2025.102583","DOIUrl":"10.1016/j.evalprogplan.2025.102583","url":null,"abstract":"<div><div>Death by suicide is common among people living with HIV (PLWH) in Tanzania, and is strongly influenced by HIV stigma, lack of social support, and HIV-associated stress. Screening and intervention strategies for reducing suicidality, however, are not incorporated into standard HIV care. This study describes the development of a brief, nurse-led telehealth counseling intervention to address suicidal <u>ID</u>eation through HIV <u>E</u>ducation and counseling, advancing treatment <u>A</u>dherence, and reducing <u>S</u>tigma <u>for</u> renewed <u>Hope</u> (IDEAS for Hope) among PLWH in Tanzania. The three intervention sessions are based on Four Pillars, supported by personal values, to motivate change and build hope for the future: 1) Living healthy with HIV; 2) Managing HIV stigma; 3) Seeking social support; and 4) Active problem-solving to address social determinants of health. The IDEAS for Hope intervention integrates universal suicide screening into routine HIV care; PLWH with recent suicidal ideation are connected by video call to the first IDEAS for Hope session, with two additional sessions offered at two-week intervals. The intervention model is informed by Motivational Interviewing-enhanced safety planning (MI-SafeCope), cognitive-behavioral therapy, and problem-solving therapy frameworks, which are combined to facilitate HIV care engagement, address key contributors to suicidality among PLWH, and build hope for the future.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102583"},"PeriodicalIF":1.5,"publicationDate":"2025-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143593708","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yue Chen, Yang Liu, Nan Wang, Xiang Su, Yijuan Lu, Yue Gao
{"title":"Health gap closing function of a green behavioral activity system from the perspective of economic and social capital: A case study of sports governance and operation systems","authors":"Yue Chen, Yang Liu, Nan Wang, Xiang Su, Yijuan Lu, Yue Gao","doi":"10.1016/j.evalprogplan.2025.102580","DOIUrl":"10.1016/j.evalprogplan.2025.102580","url":null,"abstract":"<div><div>Improving sports governance and operation systems can enable groups with low levels of economic and social capital to obtain greater health benefits, thus narrowing the health benefit gap compared to those with high levels of capital and realizing the sustainable development of sports. This study aims to advance the research on the interactive effects of sports governance and its operation system, economic and social capital and individual health. To explore the moderating effect of sports governance and its operation system on the relationship between the level of economic and social capital and individual health, we utilize a multilayer linear model based on analyzing the impact of sports governance and its operation system on individual health at both the macro (data from 28 provinces) and micro levels (data from 10,801 individuals). The model results indicate that regional sports governance and its operation system positively impact individual health. The level of economic and social capital possessed by individuals has a significant effect on individual health (β=0.02–0.07, p < 0.001). The model estimates of interaction effects indicate that an increase in sports space per capita tends to diminish the health-promoting effect of this variable for the public with higher economic income, can effectively improve the health level of low-income groups. (β=0.33, p < 0.001). The results of this study highlight the importance of optimizing the management and utilization of sport resources to enhance health benefits for public groups with low economic and social capital.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102580"},"PeriodicalIF":1.5,"publicationDate":"2025-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143600942","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Refining nascent interventions through emergent design evaluation","authors":"Dylan Boczar , Bianca Montrosse-Moorhead , Ido Davidesco","doi":"10.1016/j.evalprogplan.2025.102564","DOIUrl":"10.1016/j.evalprogplan.2025.102564","url":null,"abstract":"<div><div>Evaluating nascent educational interventions requires a specific kind of evaluation theory. This paper provides a case example of the emergent design evaluation approach, one theory created for use with developing interventions, but that has limited examples within published literature for practitioners to learn from. The emergent design evaluation theory was used to evaluate the design and implementation of a high school biology unit integrating computational thinking and neural engineering, including teacher professional development and a web-based application. A contribution of this paper, beyond the case example it provides, is that the emergent design evaluation was combined with design-based research, a complementary approach. Consistent with the practices uniquely characteristic of emergent design evaluation, this paper describes critical points or key occasions in which aspects of the intervention influence the evaluation process, or vice versa, including the nature and direction of influence. By demonstrating the process of combining emergent design evaluation and design-based research, this paper adds to discussions within the field about how to intentionally weave together different knowledge generation approaches that both meet evaluation demands and align with the evaluation context.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102564"},"PeriodicalIF":1.5,"publicationDate":"2025-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143682281","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yousaf Ali , Minahill Tariq , Mohammad Hamza Amjad
{"title":"Modelling and classification of barriers in the construction of smart villages in developing countries","authors":"Yousaf Ali , Minahill Tariq , Mohammad Hamza Amjad","doi":"10.1016/j.evalprogplan.2025.102565","DOIUrl":"10.1016/j.evalprogplan.2025.102565","url":null,"abstract":"<div><div>Smart Villages are an innovative solution for tackling global sustainability per the sustainable development goals set by the United Nations. This particular study looks into the implementation of a similar Smart Village concept in developing countries such as Pakistan. The main focus is to identify and classify a set of barriers that are to be considered while constructing a smart village. The hierarchal modeling of these barriers is carried out using Interpretive Structural Modelling (ISM) and then classified into clusters or segments using a Matrice d′Impacts Croisés Multiplication Appliquée à un Classement (MICMAC) technique. Fourteen barriers are selected from the literature and their pair-wise relationships are determined using input from experts, gathered via a questionnaire. The structural self-interactive matrix and reachability matrix were constructed using survey results and binary quantification. Conclusively, deforestation was determined to be the strongest driving barrier alongside crime rate, unemployment, and public rejection while market disruption was the most dependent barrier. The MICMAC analysis was then used to cluster the barriers into 4 categories, based on their dependence and driving power parameters. The study can be useful for the Governments of developing countries especially in South Asia, in prioritizing key elements before constructing a smart village to prevent further damage down the line. The ISM technique has proven to be a valuable resource in organizing data for novel problems with little available data. Since there are only a handful of Smart Village examples to go by, no key data is available previously for this topic. Therefore, this research bridges the gap and provides valuable qualitative and quantitative data to the concerned authorities.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102565"},"PeriodicalIF":1.5,"publicationDate":"2025-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143593709","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Achieving a caregiver-friendly workplace standard for Canadian carer-workers: An ex ante evaluation of potential uptake","authors":"Ashleigh Patterson, Allison Williams","doi":"10.1016/j.evalprogplan.2025.102582","DOIUrl":"10.1016/j.evalprogplan.2025.102582","url":null,"abstract":"<div><div>With the assistance of a Committee of experts, McMaster University partnered with the Canadian Standards Association (CSA) to develop the <em>Caregiver Inclusive and Accommodating Organizations Standard (B701–17)</em>. The <em>Standard</em> provides workplace guidelines to better accommodate carer-workers through building carer-friendly workplace programs. A qualitative ex ante evaluation was undertaken to determine stakeholders’ (n = 17) views regarding the significance and potential uptake of the <em>Standard</em>. This involved seeking feedback from stakeholders in various types of organizations across Canada, after they had read the draft <em>Standard</em>. Following transcription, interviews were thematically analyzed, resulting in four themes: (1) necessity; (2) impact of employer size; (3) motivators for implementation, and (4) use as an educational tool. Although initially in its early stages, the Standard now provides a key tool to improve accommodations for carer-workers.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102582"},"PeriodicalIF":1.5,"publicationDate":"2025-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143619706","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The impact of innovation and entrepreneurship training programs on undergraduates' research careers: Evidence from Chinese universities","authors":"Jiawei Gu , Junyao Tang","doi":"10.1016/j.evalprogplan.2025.102581","DOIUrl":"10.1016/j.evalprogplan.2025.102581","url":null,"abstract":"<div><div>Education, science and technology, and talent are the cornerstones of modern national development, with universities serving as the core frontlines for innovation and talent cultivation. In recent years, many universities have encouraged students to engage in research activities during their undergraduate years, and existing research has shown that undergraduate participation in research significantly enhances academic engagement and success. However, most existing studies focus on curriculum-based undergraduate research, with relatively few studies on project-based research. Moreover, many of these studies lack long-term tracking data and quantitative analysis. Based on the project-based research experience in Chinese universities, this study uses a decade-long tracking dataset. It employs multiple linear regression and Logit models to explore the impact of project-based research experience on undergraduates' research careers. The results show that project-based research experience positively influences undergraduates' research careers in three key areas: level of participation, peer effects, and external evaluations. The higher the level of participation, the better the external evaluation, and the stronger the peer effect, the more significant the project's impact on the undergraduates' research careers. Compared to regular members, project leaders perform more prominently in terms of academic paper publications and obtain higher final degrees. The study also reveals that these impacts vary across different disciplines. To maximize the role of these projects in identifying and cultivating research talent, improvements in management models, incentive mechanisms, and evaluation systems are urgently needed.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102581"},"PeriodicalIF":1.5,"publicationDate":"2025-03-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143593710","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Long-term impact evaluation of early childhood conditions When only short-term outcomes are available","authors":"Sharon Picco , Chiara Pronzato","doi":"10.1016/j.evalprogplan.2025.102584","DOIUrl":"10.1016/j.evalprogplan.2025.102584","url":null,"abstract":"<div><div>Over the past two decades, socio-economic research has highlighted and empirically demonstrated the importance of investing in early childhood development for long-term life outcomes. In response, governments and foundations have increasingly allocated resources to preschool initiatives, promoting formal childcare, encouraging access to libraries and playrooms, and facilitating parent-child activities aimed at enhancing parenting skills. While the short-term effects of many of these policies are frequently assessed, evaluating their long-term impact remains challenging due to high costs and logistical complexities. How can meaningful insights into long-term effects be derived when only short-term outcomes are available? Adopting the “surrogacy” framework proposed by Athey et al. (2024) and using data from the Millennium Cohort Study (UK), we predict long-term outcomes assuming only short-term outcomes are available, and compare them with the actual ones. This analysis introduces a valuable tool for policymakers and program evaluators, helping to identify key outcome variables for impact assessment and the prediction of long-term effects.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102584"},"PeriodicalIF":1.5,"publicationDate":"2025-03-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143674693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Aurelie Van Hoye , Colin Regan , Aoife Lane , Catherine Woods
{"title":"Sport federation investment in health promotion: The healthy club project implementation","authors":"Aurelie Van Hoye , Colin Regan , Aoife Lane , Catherine Woods","doi":"10.1016/j.evalprogplan.2025.102579","DOIUrl":"10.1016/j.evalprogplan.2025.102579","url":null,"abstract":"<div><div>Research on health promotion has largely investigated the activities of sports clubs, but less is known about the support provided by sports federations. The present study aims at analysing the success and barriers of the Gaelic Athletic Association (GAA) Healthy Club Project scaling up process. A case study design incorporating document analysis, observation and 8 interviews was used. Data analysis was based on deductive coding using the viable system model. The results indicated a three-level structure (national, county, club). Six employees at the national federation level support the work of 32 volunteer County Health and Well-being Committees and 439 clubs. The strengths are the identification of a single national reference point for clubs and Counties, the learning process and openness to innovation, and the enhanced workforce through a County officer appointment acting as role model. The challenges being faced are resources allocation, the level of engagement of the County and club board, and the training of volunteers. The strengths of the management system include the composition of the steering committee and the proper use of evaluation. Key scaling up levers and barriers of the present program could inform other sport organisations on the scaling up process of their programmes.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102579"},"PeriodicalIF":1.5,"publicationDate":"2025-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579193","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Emily Deans , Wing See Yuen , George Economidis , Anthony Shakeshaft , Sara Farnbach
{"title":"A mixed methods evaluation of an alcohol and other drug psychoeducation program for clients with complex support needs","authors":"Emily Deans , Wing See Yuen , George Economidis , Anthony Shakeshaft , Sara Farnbach","doi":"10.1016/j.evalprogplan.2025.102578","DOIUrl":"10.1016/j.evalprogplan.2025.102578","url":null,"abstract":"<div><h3>Background</h3><div>Clients with co-occurring and complex needs represent an important segment of the alcohol and other drug (AOD) treatment population. Retaining and engaging individuals in AOD treatment is challenging, and this pursuit is further impeded when clients present with complex support needs. This study sought to establish the feasibility and acceptability of a newly developed psychoeducation program for this clientele, attending a non-residential treatment service in New South Wales.</div></div><div><h3>Methods</h3><div>The study employed a mixed methods approach. The team analysed aggregated non identifiable routinely collected data, including alcohol and other drug use, psychological distress and quality of life metrics pre and post intervention. Qualitative semi-structured interviews were also conducted with consenting clients and clinicians to complement quantitative data.</div></div><div><h3>Results</h3><div>Twenty-five eligible clients consented to have their data used for this study and nine consented to participate in an interview. Results show a significant decrease in psychological distress among clients at exit compared to baseline, however no significant change in quality-of-life scores or substance use was quantitatively observed. Some clients self-reported a reduction in substance use and most appreciated the flexibility of the one-on-one service offering.</div></div><div><h3>Conclusions</h3><div>Our findings show that the psychoeducational program delivered to clients with complex support needs at Rendu House is feasible and acceptable to both clients and clinicians, and that the use of routinely collected data to measure treatment outcomes is viable within this setting. Our findings also demonstrate the value of qualitative inquiry in situating narratives of recovery among clients with complex needs where improvements may be incremental.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102578"},"PeriodicalIF":1.5,"publicationDate":"2025-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143593772","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Navigating program evaluation amid health crises: Evaluator's experiences on conducting virtual focus group discussions","authors":"Lesedi Senamele Matlala","doi":"10.1016/j.evalprogplan.2025.102568","DOIUrl":"10.1016/j.evalprogplan.2025.102568","url":null,"abstract":"<div><div>Virtual Focus Group Discussions (FGDs) have become vital tools in program evaluations, especially during the COVID-19 pandemic, where they provide an adaptable alternative to traditional face-to-face methods. These virtual platforms, such as Google Meet, allow evaluators to engage diverse stakeholders and collect valuable insights despite geographical limitations. However, despite their increasing use, there remains a significant gap in understanding how evaluators in South Africa perceive and implement virtual methodologies in the context of program evaluations. This study aims to address this gap by reflecting on evaluators’ experiences with virtual FGDs, focusing particularly on Google Meet as the chosen platform. This research uses a reflective methodology to explore various aspects of virtual FGDs, such as participant engagement, technological proficiency, and data privacy challenges encountered during sessions. The findings reveal that while virtual FGDs provide enhanced accessibility and flexibility, they also present challenges related to participants’ digital literacy, technological infrastructure issues, and data privacy concerns. The study emphasizes the need for strategies to mitigate these challenges, including the provision of pre-session training for participants, enhancing digital infrastructure, and reinforcing data protection measures. Additionally, it recommends the implementation of hybrid models that combine virtual and in-person approaches to bridge the technological divide. This study contributes valuable insights into the experiences of evaluators conducting virtual FGDs in South Africa, offering practical recommendations for improving the effectiveness and inclusivity of virtual evaluations. Ultimately, virtual FGDs hold significant potential to enhance program evaluations in South Africa, but addressing the identified challenges is essential to maximizing their impact on the evaluation process.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"111 ","pages":"Article 102568"},"PeriodicalIF":1.5,"publicationDate":"2025-02-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143534691","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}