Evaluation and Program Planning最新文献

Overview of rural credit environment in China: Measurement logic, evaluation system, and case analysis. 中国农村信用环境概述：衡量逻辑、评价体系和案例分析。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-11-17 DOI: 10.1016/j.evalprogplan.2024.102519

Xihui Chen, Zhouyi Gu, Luca Esposito, Jiayan Lv

{"title":"Overview of rural credit environment in China: Measurement logic, evaluation system, and case analysis.","authors":"Xihui Chen, Zhouyi Gu, Luca Esposito, Jiayan Lv","doi":"10.1016/j.evalprogplan.2024.102519","DOIUrl":"https://doi.org/10.1016/j.evalprogplan.2024.102519","url":null,"abstract":"<p><p>A rational evaluation of the rural credit environment's current state and identification of its critical issues are crucial for enhancing the construction of rural social credit systems. Drawing on the \"Outline for the Construction of the Social Credit System (2014-2020)\" and related literature, this paper clarifies the concepts and measurement principles of the rural credit environment. This study innovatively constructs an evaluation framework for the rural credit environment and conducts quantitative measurements and statistical analyses using a combined weighting method to delineate the environment's current state. Using Banqiao Town as a case study, this paper employs the cloud model to evaluate the rural credit environment's quality levels and to identify key factors influencing its quality effectively. From a macro perspective, statistical measurements and index analyses establish evaluation standards and quantify the state of the rural credit environment. In contrast, from a micro perspective, case analysis focuses on evaluating the quality levels and identifying crucial issues in specific locales. Integrating macro and micro perspectives offers a novel approach to evaluating the rural credit environment, offering theoretical approaches and practical strategies for promoting a favorable credit environment and advancing the construction of rural social credit systems in China.</p>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"108 ","pages":"102519"},"PeriodicalIF":1.5,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142682225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Uses of the viable validity concept: A systematic scoping review 可行有效性概念的用途：系统性范围审查。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-11-13 DOI: 10.1016/j.evalprogplan.2024.102516

Césarine Sambou , Charlotte Decroix , Judith Martin-Fernandez , Linda Cambon , François Alla

{"title":"Uses of the viable validity concept: A systematic scoping review","authors":"Césarine Sambou , Charlotte Decroix , Judith Martin-Fernandez , Linda Cambon , François Alla","doi":"10.1016/j.evalprogplan.2024.102516","DOIUrl":"10.1016/j.evalprogplan.2024.102516","url":null,"abstract":"<div><h3>Objective</h3><div>The concept of viable validity was first defined in 2010 within the framework of the integrative validity model. The concept has continued to evolve in the intervening years, and the purpose of this systematic scoping review is to describe and analyze the ways in which it has been deployed and appropriated by various research traditions.</div></div><div><h3>Methods</h3><div>We began by including all articles which cite Chen’s original article “<em>The bottom-up approach to integrative validity: a new perspective for program evaluation</em> (Eval Program Plann. 2010;33(3):205–14) and/or contain the terms “viable validity” or “viable cogency,” sourced from 5 databases (PubMed, Web of Science, Scopus, Psycinfo and ResearchGate).</div></div><div><h3>Results</h3><div>we selected and included 31 articles published between 2011 and 2022. These studies fall into three major research traditions (evaluation science, population health intervention research and humanities and social sciences), providing a broad overview of the conceptual mobilization of viable validity. Paradoxically, our literature reveals the concept of viable validity to be poorly operationalized and only partially mature, owing to a lack of consensus among the research traditions with regard to its definition, as well as the porous boundaries between this concept and adjacent concepts such as feasibility and acceptability.</div></div><div><h3>Conclusion</h3><div>Viable validity is a complex concept, and its operational application constitutes a major challenge for research into and evaluation of population health interventions.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"108 ","pages":"Article 102516"},"PeriodicalIF":1.5,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142644972","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Analyzing the impact of the new educational policy 2020: A comprehensive review of India's educational reforms 分析 2020 年新教育政策的影响：全面回顾印度的教育改革。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-11-13 DOI: 10.1016/j.evalprogplan.2024.102515

T. Ashokkumar , T. Russel Raj , A. Rajadurai , A.H. Abishini , A.H. Anchani

引用次数: 0

A deep dive into the factors affecting household solar photovoltaic adoption: An extended perspective of the value-based adoption model 深入探究影响家用太阳能光伏发电应用的因素：基于价值的采用模式的扩展视角。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-11-09 DOI: 10.1016/j.evalprogplan.2024.102514

Chien-Wei Ho , Cheng-Chien Kuo , Hong-Chan Chang

{"title":"A deep dive into the factors affecting household solar photovoltaic adoption: An extended perspective of the value-based adoption model","authors":"Chien-Wei Ho , Cheng-Chien Kuo , Hong-Chan Chang","doi":"10.1016/j.evalprogplan.2024.102514","DOIUrl":"10.1016/j.evalprogplan.2024.102514","url":null,"abstract":"<div><div>Solar photovoltaic (PV) products have emerged as a promising solution to address environmental and green energy issues in light of increasing concerns about carbon emissions, environmental awareness, and renewable energy. This research uses the value-based adoption model (VAM) to examine how perceived benefits and sacrifices impact the adoption intention of PV technology. It additionally explores the role of familiarity with the service as a moderator and its impact on perceived harm risk, perceived value, and adoption intention. The results reveal that economic and environmental benefits significantly influence perceived value, while perceived financial and harm risks also play substantial roles in shaping perceived value. Moreover, the study shows a positive relationship between perceived value and the intention to adopt solar PV and also suggests that familiarity with solar services moderates the relationship between perceived harm risk and perceived value. These insights are valuable for policymakers and energy companies seeking to understand consumers’ perspectives better and increase their intentions to adopt PV technology.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"108 ","pages":"Article 102514"},"PeriodicalIF":1.5,"publicationDate":"2024-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142644970","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Meta-analysis of chemistry-based interdisciplinary informal research experience program for high school students 以化学为基础的高中生跨学科非正式研究体验计划的元分析。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-11-06 DOI: 10.1016/j.evalprogplan.2024.102517

Noora J. Al-thani , Nitha Siby , Azza Saad , Jolly Bhadra , Noora Qahtani , Abdellatif Sellami , Zubair Ahmad

{"title":"Meta-analysis of chemistry-based interdisciplinary informal research experience program for high school students","authors":"Noora J. Al-thani , Nitha Siby , Azza Saad , Jolly Bhadra , Noora Qahtani , Abdellatif Sellami , Zubair Ahmad","doi":"10.1016/j.evalprogplan.2024.102517","DOIUrl":"10.1016/j.evalprogplan.2024.102517","url":null,"abstract":"<div><div>Research-based learning models, particularly interdisciplinary programs, are crucial in promoting STEM skills and fostering positive attitudes among students. This study presents a meta-analysis evaluating the impact of a chemistry-based interdisciplinary research experience program on high school students in Qatar. Over ten cohorts from 2010 to 2020, 230 students participated in multidisciplinary, hands-on research experiences. The study used pre-post questionnaires and t-test analyses, with further meta-analysis conducted using Comprehensive Meta-Analysis (CMA) software to evaluate the program’s effectiveness in shaping STEM attitudes. Significant findings emerged, with a notable large effect size (Cohen’s d = 0.885), underscoring the program’s efficacy in bolstering positive STEM attitudes among students. The study observed that research complexity and gender do influence the outcome of the program, aligning with the tenets of Social Cognitive Theory, which posits that both individual and contextual elements are influential in attitude formation and learning processes. Conclusively, the research substantiates that interdisciplinary, experiential learning significantly heightens student interest in STEM fields. It also points to the potential benefits of further explorations into the nuances of gender disparities and the complexity of research in enhancing the scope and impact of such educational programs.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"108 ","pages":"Article 102517"},"PeriodicalIF":1.5,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142606949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Using Intervention Mapping to co-design a psychosocial service with youth experiencing mental illness 利用 "干预图谱 "为患有精神疾病的青少年共同设计社会心理服务

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-10-18 DOI: 10.1016/j.evalprogplan.2024.102513

Melissa Savaglio , Marie B.H. Yap , Grace Mitchell , Mandy O’Connor , Ash Vincent , Helen Skouteris

{"title":"Using Intervention Mapping to co-design a psychosocial service with youth experiencing mental illness","authors":"Melissa Savaglio , Marie B.H. Yap , Grace Mitchell , Mandy O’Connor , Ash Vincent , Helen Skouteris","doi":"10.1016/j.evalprogplan.2024.102513","DOIUrl":"10.1016/j.evalprogplan.2024.102513","url":null,"abstract":"<div><h3>Background</h3><div>Descriptions of service development processes in the youth mental health sector are lacking. Further, youth with lived experience of mental illness are rarely involved in service design. Intervention Mapping (IM) is a well-established framework for program development, implementation and evaluation, yet its applicability in the youth mental health sector is unknown. This paper describes the use of IM methodology to co-design and develop a psychosocial service to support youth aged 10–25 years experiencing mental illness in Tasmania, Australia.</div></div><div><h3>Methods</h3><div>The six steps of IM were followed: 1) needs assessment; 2) define program outcomes and objectives; 3) program design; 4) program production; 5) implementation planning; and 6) evaluation planning.</div></div><div><h3>Results</h3><div>Key outputs of each IM step are described. The service was successfully co-designed with young people at the centre of each step. The service includes wrap-around psychosocial support from lived-experience peer-support workers; outreach; and flexible frequency/intensity/duration to achieve young people’s psychosocial goals.</div></div><div><h3>Conclusions</h3><div>This is the first study to document the use of IM in co-designing a psychosocial service with youth experiencing mental illness. IM may provide a valuable roadmap for the youth mental health sector in supporting collaborative service design, implementation and evaluation planning, and systematic documentation of service development.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"108 ","pages":"Article 102513"},"PeriodicalIF":1.5,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142539501","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Anticipatory evaluation. How to incorporate an anticipatory technique into a theory-driven evaluation process. Results of application in a case study. 预期评估。如何将预测技术纳入理论驱动的评价过程。案例研究中的应用结果。

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-10-16 DOI: 10.1016/j.evalprogplan.2024.102509

Mariangel Pacheco – Troisi , Mónica García-Melón , Fernando Jiménez-Sáez

{"title":"Anticipatory evaluation. How to incorporate an anticipatory technique into a theory-driven evaluation process. Results of application in a case study.","authors":"Mariangel Pacheco – Troisi , Mónica García-Melón , Fernando Jiménez-Sáez","doi":"10.1016/j.evalprogplan.2024.102509","DOIUrl":"10.1016/j.evalprogplan.2024.102509","url":null,"abstract":"<div><div>In recent years, there has been increased focus on strategic learning from impact analysis, including in the field of science, technology, and innovation. In this paper, we propose combining techniques from two fields of study. Firstly, we adopt the approach of addressing impact through productive interactions between science and society, and secondly, we incorporate an anticipatory dimension by integrating game analysis involving key actors. Through a theory-driven evaluation design, we consider expected impacts as promises of the future. Within an anticipatory perspective, the future can be shaped by the interactions among different actors in the present. In this article, we apply this approach step-by-step to a research institute program in Uruguay. We demonstrate how the achieved results offer strategic insights to the program manager for anticipating and attaining the desired impacts. Additionally, we provide summative inputs for accountability using a flexible technique applicable at any stage of the program life cycle. The article concludes with a discussion of the advantages and disadvantages compared to other techniques, along with lessons learned that may benefit other evaluators seeking to replicate this approach. Furthermore, we explore potential extensions and opportunities for further improvement in this research.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"108 ","pages":"Article 102509"},"PeriodicalIF":1.5,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142477833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

What evaluation criteria are used in policy evaluation research: A cross-field literature review 政策评估研究中使用哪些评估标准：跨领域文献综述

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-10-10 DOI: 10.1016/j.evalprogplan.2024.102512

Céline Mavrot , Oto Potluka , Lars Balzer , Véronique Eicher , Sigrid Haunberger , Christine Heuer , François-Xavier Viallon

{"title":"What evaluation criteria are used in policy evaluation research: A cross-field literature review","authors":"Céline Mavrot , Oto Potluka , Lars Balzer , Véronique Eicher , Sigrid Haunberger , Christine Heuer , François-Xavier Viallon","doi":"10.1016/j.evalprogplan.2024.102512","DOIUrl":"10.1016/j.evalprogplan.2024.102512","url":null,"abstract":"<div><div>This literature review offers a comprehensive overview of the use of evaluation criteria across five policy fields: social services, land-use planning, teaching in higher education, vocational education, and the environment. Though it is a key part of the evaluation process, the question of how criteria are defined, chosen, and applied generates surprisingly little debate among the evaluation community. In evaluation practice, criteria are often taken for granted – and occasionally even used in ways that are neither explicit nor transparent. This cross-field literature review shows a strong presence of routinized evaluation criteria (relating to the specifics of each policy field), while some new sets of higher-degree criteria also emerge in the face of social challenges relating to sustainability, public acceptance, or social justice. Criteria development draws on both inductive bottom-up processes (which can include policy stakeholders) and top-down deductive processes (which derive criteria from the literature, as well as from national and international standards). A more profound reflection on evaluation criteria (that is, the dimensions used by societies to assess the success of policy interventions) might be required in the future of evaluation research and planning; a deeper cross-field dialogue could support this endeavor.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"108 ","pages":"Article 102512"},"PeriodicalIF":1.5,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142444898","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A program evaluation of the new choices workforce development program: An appreciative inquiry approach 新选择劳动力发展计划的项目评估：欣赏式探究方法

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-10-09 DOI: 10.1016/j.evalprogplan.2024.102507

Denise Whitacre

{"title":"A program evaluation of the new choices workforce development program: An appreciative inquiry approach","authors":"Denise Whitacre","doi":"10.1016/j.evalprogplan.2024.102507","DOIUrl":"10.1016/j.evalprogplan.2024.102507","url":null,"abstract":"<div><div>A significant amount of money ($1.76B annually in the United States) is spent on workforce development programs, while there is limited research on the effectiveness of workforce development programs in meeting their program objectives and assisting program participants in attaining employment. This study evaluated the New Choices Program, a workforce development program offered by PA Women Work, to help its clients obtain employment and overcome personal and professional barriers. The program has historically been offered in a 30-hour in person format but was forced to be modified to a 10-hour virtual program when the COVID-19 pandemic restrictions began. This program evaluation included a comparative analysis of the perceptions of participants in the 30-hour in person program and the 10-hour virtual program. It was found that participants in both the 30-hour in person program and 10-hour virtual program perceived the program positively, experienced an increase in self-confidence and belonging, which led to either obtaining employment or being better prepared for the job search process. The data will help inform the New Choices program stakeholders on programmatic improvements and how best to structure the program in the post-pandemic employment world.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"108 ","pages":"Article 102507"},"PeriodicalIF":1.5,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142438413","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Problems (and possible solutions) of assessing risk, race and recidivism in long operating drug treatment courts 长期运作的戒毒法庭在评估风险、种族和累犯方面存在的问题（以及可能的解决方案

IF 1.5 4区社会学

Evaluation and Program Planning Pub Date : 2024-10-05 DOI: 10.1016/j.evalprogplan.2024.102510

Kristen E. DeVall , Paul D. Gregory , David J. Hartmann

{"title":"The Problems (and possible solutions) of assessing risk, race and recidivism in long operating drug treatment courts","authors":"Kristen E. DeVall , Paul D. Gregory , David J. Hartmann","doi":"10.1016/j.evalprogplan.2024.102510","DOIUrl":"10.1016/j.evalprogplan.2024.102510","url":null,"abstract":"<div><div>Formal criminogenic risk tools can be an important control in assessing racial inequities in access to treatment courts and in evaluating both proximal and distal outcomes from those programs. To achieve this potential, however, it is important that risk tools themselves operate in a racially neutral fashion and that they operate consistently over the period assessed. Tools that are not properly calibrated by race and changes in the tools used over the life of a program are therefore significant evaluation concerns. Our paper is the first to assess the adequacy of an important risk-needs instrument, the LSI-R, across racial groups in a drug treatment court setting. The main contribution of the current study is not as a test of that instrument, which has been widely studied in other settings. Rather, because two different criminogenic risk tools were used over the study time period, we took this opportunity to explore the use of a readily constructible “proxy” measure of risk to support analysis of risk and race interactions over the life of the program.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"108 ","pages":"Article 102510"},"PeriodicalIF":1.5,"publicationDate":"2024-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142433558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0