Evaluation and Program Planning最新文献

{"title":"Evaluating teacher competencies in Pakistan's public schools: Enhancing the impact of professional development programs","authors":"","doi":"10.1016/j.evalprogplan.2024.102467","DOIUrl":"10.1016/j.evalprogplan.2024.102467","url":null,"abstract":"<div><p>Professional Development (PD) programs in Pakistan typically follow a standardized approach, often overlooking the diverse strengths and weaknesses of various teacher groups, which may not adequately address their specific needs. This study aims to evaluate teacher competencies among different groups from the perspective of school principals in Pakistan's public schools, with the goal of enhancing the effectiveness of PD programs. Initially, the study identifies three key themes of 21st-century teacher competencies through an extensive review of recent literature. An interview guide, based on these competencies, was used to gather data from seven public school principals via structured interviews. The data were analyzed using a deductive content analysis approach, with MAXQDA software employed for theme coding. The findings revealed notable differences in teacher competencies from the principals' perspectives. Female and younger teachers exhibited more competencies compared to their male and senior counterparts. These insights provide crucial information for planning and customizing Teacher Professional Development (TPD) programs, emphasizing an objective evaluation of teachers rather than self-assessment. Tailored PD programs based on these findings can more effectively enhance teachers' professional growth and competence.\"</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141689217","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Comprehensive risk assessment for identifying suitable residential zones in Manavgat, Mediterranean Region","authors":"","doi":"10.1016/j.evalprogplan.2024.102465","DOIUrl":"10.1016/j.evalprogplan.2024.102465","url":null,"abstract":"<div><p>The absence of comprehensive risk analysis in residential development within certain regions often leads to substantial human and material losses during natural disasters. The Mediterranean region, particularly susceptible to the impacts of climate change, is projected to witness an upsurge in the frequency of natural calamities like floods, landslides, and forest fires. Consequently, meticulous risk assessment during the selection of residential areas becomes paramount in this context. This study is dedicated to the evaluation of suitable residential zones in Manavgat, a pivotal location in the Mediterranean region with a progressively growing population. The findings indicate that approximately 4.26 % of the research area is deemed appropriate for residential establishment. The identification of these locations is crucial for ensuring human and material safety, as well as enhancing overall biocomfort. Moreover, this study provides a foundation for long-term planning initiatives within the region and makes a significant contribution to the international evaluation literature by demonstrating the application of integrated risk assessment methodologies in urban planning.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141691740","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Understanding benefits of a college student-homebound adult partnership program to support aging in place: An exploratory study","authors":"","doi":"10.1016/j.evalprogplan.2024.102464","DOIUrl":"10.1016/j.evalprogplan.2024.102464","url":null,"abstract":"<div><p>The need for effective approaches to support aging and homebound adults is recognized internationally and domestically. This exploratory study sought to understand the proximal benefits of an intergenerational program in Delaware, USA that connected homebound individuals with college students. The primary goal was to describe program impacts on home-bound community residents to inform future research, program planning, and implementation. Outcomes of interest included quality of life, well-being, and independence. Semi-structured interviews were conducted with 19 participants recruited from a nonprofit partner. Findings yielded seven unique themes: emotional fulfillment, special feelings of support from a rare “unconditional” relationship, assistance with tasks, close connection with someone not ordinarily met, intergenerational understanding, someone to talk to, and appreciation. Additionally, the research team applied the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, to contextualize the approach and findings. Results inform future evaluation efforts of homebound visiting programs, which may seek to incorporate outcome indicators aligned with these themes and serve as a foundation for future quantitative measures of impact.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141691620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluating social governance innovation policy in China: A study based on fuzzy set qualitative comparative analysis","authors":"Qi Wu ,&nbsp;Javier Cifuentes-Faura ,&nbsp;Xuelan Li ,&nbsp;Yibo Wang","doi":"10.1016/j.evalprogplan.2024.102460","DOIUrl":"10.1016/j.evalprogplan.2024.102460","url":null,"abstract":"<div><p>Social governance is an important aspect of national governance. Strengthening and innovating social governance is an important task to promote social construction, and the necessary policy support is an important means to achieve governance innovation. Based on the policy texts of 31 urban districts (including 22 provincial capitals, 4 municipalities directly under the Central Government and 5 capitals of autonomous regions), the innovation policy of social governance is divided into five dimensions: organizational mobilization policy, public service policy, social regulatory policy, community constructive policy and data informative policy. Using the fs-QCA method, the path of social governance innovation policy on governance performance is discussed. The study finds that the supply mode of two innovative policy combinations have a significant effect on the improvement of social governance performance: One is organizational mobilization policy, public service policy and community constructive policy, and the other is organizational mobilization policy, social regulatory policy and data informative policy.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141604351","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Effectiveness of portfolio assessment in primary education: A multi-complementary research approach","authors":"Yunus Doğan ,&nbsp;Nazife Tuğba Yıldırım ,&nbsp;Veli Batdı","doi":"10.1016/j.evalprogplan.2024.102461","DOIUrl":"10.1016/j.evalprogplan.2024.102461","url":null,"abstract":"<div><p>The current study represents a comprehensive exploration of the efficacy of portfolio assessment within primary school contexts, employing a Multi-Complementary Research (McA) framework comprising three distinct stages. In the pre-complementary knowledge stage, data collection commenced utilizing the document analysis method, concurrently conducting meta-analysis and meta-thematic analysis. From 18 studies, a meta-analysis of 23 datasets revealed a medium-level overall effect size. Simultaneously, meta-thematic analysis was conducted on 6 studies meeting specific inclusion criteria, analyzing themes and codes through content analysis. Transitioning to the post-complementary knowledge stage, an experimental study employing a pretest-posttest control group design was undertaken with third-grade primary school students. Additionally, thematic analysis based on participant perspectives was conducted. Subsequently, an eventual complementary knowledge stage was achieved by synthesizing findings from the initial two stages. Key themes emerged, titled \"the effect of portfolio use in primary education on academic success, 21st century skills, and attitudes.\" The collective findings indicate that portfolio assessment in primary schools yields positive effects across all three identified themes.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141459959","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"An evaluation framework for low performers and human resource management planning: Application to a life insurance company in Korea","authors":"Bong Je Park ,&nbsp;Min Jae Park ,&nbsp;Je Goo Shin","doi":"10.1016/j.evalprogplan.2024.102463","DOIUrl":"10.1016/j.evalprogplan.2024.102463","url":null,"abstract":"<div><p>This study comprehensively explores the factors that lead to low performers in an organization. A thorough literature review was conducted to construct an interview guide and obtain classification criteria for the factors that lead to low performers. Managers and low performers at multiple firms were interviewed individually to understand the various phenomena related to low performers in organizations. Based on the content of these interviews, 12 factors, classified into individual, leader, work, and organizational dimensions, were identified after three rounds of revisions by business administration experts. Next, a case study of Korea’s S Life Insurance Company was conducted to examine the practical implications of the factors that contribute to creating low performers. In this case study, the analytic hierarchy process (AHP), involving eight departmental heads S Life Insurance Company’s HR division, was utilized to identify the main factors that must be considered when evaluating low performers. While previous studies have examined low performers either at the individual, organizational, or institutional levels, this study presents a comprehensive and integrated evaluation framework of the factors that cause low performers. The proposed framework facilitates the identification and evaluation of low performers in various organizations and industries, and thus has practical implications in terms of establishing strategies to manage low performers more efficiently and improve organizational performance.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141392072","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Effectiveness of the KiVa anti-bullying program in the Czech Republic: A cluster randomized control trial","authors":"Adam Klocek ,&nbsp;Lenka Kollerová ,&nbsp;Egle Havrdová ,&nbsp;Monika Kotrbová ,&nbsp;Jan Netík ,&nbsp;Marek Pour","doi":"10.1016/j.evalprogplan.2024.102459","DOIUrl":"10.1016/j.evalprogplan.2024.102459","url":null,"abstract":"<div><h3>Aims</h3><p>One of the most widely used evidence-based anti-bullying programs, KiVa, originates from Finland and aims to change students’ peer context, activate teachers, and inform parents with two main components (universal preventive actions and indicated actions when bullying occurs), complemented by monitoring. Because research documented somewhat varied KiVa outcomes in different countries and because there is a lack of research focusing solely on the effectiveness of the universal and indicated actions, this study aimed to evaluate the effectiveness of KiVa main components when implemented in a new country. This two-arm parallel cluster randomized control trial (RCT) evaluated the effectiveness of the KiVa anti-bullying program in elementary schools in the Czech Republic. It examined the effects of the universal and indicated actions on self-reported bullying and victimization as primary outcomes and well-being as a secondary outcome, while keeping monitoring constant across the intervention and control schools. The study also examined the role of implementation fidelity on the proposed outcomes.</p></div><div><h3>Methods</h3><p>Schools were allocated via stratified randomization into a KiVa intervention group (12 schools, 35 classes, <em>N</em> = 407 students) or a wait-list control group (12 schools, 32 classes, <em>N</em> = 400 students). The study employed data from baseline and post-measurement waves, which were 10 months apart.</p></div><div><h3>Results</h3><p>The data were analyzed using linear mixed effects models, which showed no significant intervention or fidelity effects for bullying, victimization, and well-being. However, promising trends (at α &lt; .10) were revealed, such as lower levels of bullying observed in the intervention group and in schools with high implementation fidelity. Additional analysis using Bayes factors supported these promising trends and provided moderate support for lower levels of victimization in the intervention group compared to the control schools.</p></div><div><h3>Conclusions</h3><p>Evaluation of effectiveness of anti-bullying programs could benefit from a more targeted fidelity assessment at the classroom or individual level and from distinguishing between the effects of the main components of the programs and the effects of monitoring. The promising yet non-significant intervention and fidelity effects suggest that schools may require enhanced support and longer implementation time frames than a single school year, especially when implementation faces structural obstacles, such as the Covid-19 pandemic.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141401629","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A pilot study of the outcomes of human trafficking survivors assessment with girls who have experienced commercial sexual exploitation","authors":"Claire Helpingstine ,&nbsp;Maureen C. Kenny ,&nbsp;Ricardo Rubiales","doi":"10.1016/j.evalprogplan.2024.102462","DOIUrl":"10.1016/j.evalprogplan.2024.102462","url":null,"abstract":"<div><h3>Purpose</h3><p>This study utilized the Outcome of Human Trafficking Survivors (OHTS) to monitor the progress of female victims of CSE over a year while they were enrolled in a comprehensive treatment program<strong>.</strong></p></div><div><h3>Methods</h3><p>Sixty-seven girls (<em>M</em> age 17.70 years) who were identified as confirmed victims of CSE (46 %) or at risk for CSE (54 %) and presented for treatment were administered the OHTS upon intake into the program and again at 90 day intervals resulting in four data points. Ratings were provided by staff members who interact with the member in each area assessed. A repeated-measures ANOVA was conducted comparing mean outcome differences across all four timepoints.</p></div><div><h3>Results</h3><p>Results indicate that significant changes were found in the area of Housing and Education, with gains in Education over time. For this sample, Parenting and Immigration were domains of less relevance and data was not consistently obtained in these areas. Other categories assessed by the OHTS did not demonstrate significant changes over time.</p></div><div><h3>Conclusion</h3><p>The OHTS can be used to track progress of clients enrolled in treatment programming, but the goals of the program should align with the categories that are assessed in the OHTS. Repeated administration may be difficult due to high dropout rates in treatment and there may be rater bias.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141404641","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Engaging evaluation champions: strategies to build evaluation capacity and promote data-informed decision making in youth development","authors":"Theresa N. Melton ,&nbsp;Ashlee L. Sjogren ,&nbsp;Jennifer P. Agans","doi":"10.1016/j.evalprogplan.2024.102458","DOIUrl":"10.1016/j.evalprogplan.2024.102458","url":null,"abstract":"<div><p>Youth development researchers and practitioners share an interest in ensuring that youth development programs contribute positively to youth outcomes. Engaging in evaluation and data-informed decision making (DIDM) has the potential to empower practitioners to improve and adapt programs, improving youth outcomes. Yet, not all practitioners are comfortable engaging in evaluation and/or DIDM. Engaging in partnerships and utilizing internal supporters of evaluations (or “champions”) have been identified as potential strategies to build evaluation capacity and strengthen DIDM within an organization. However, little research explores how to do so. This study engaged evaluation champions in four states to examine their experience as they partnered with practitioners within their organization. Results suggest that peer groups can be utilized to promote evaluation capacity, especially by utilizing peers that already have an interest in evaluation. Practitioner engagement can also be developed by using less academic jargon in communication, highlighting the practical value of evaluation, and building capacity slowly.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141327931","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Reimagining the university’s role in the health and well-being of the people it serves","authors":"Kathleen J. Quinn ,&nbsp;Julie M. Kapp ,&nbsp;Sawiyyah Chanay ,&nbsp;Thom Pancella ,&nbsp;Kimberly G. Hoffman","doi":"10.1016/j.evalprogplan.2024.102450","DOIUrl":"10.1016/j.evalprogplan.2024.102450","url":null,"abstract":"<div><p>Academic medical centers and university extension programs remain underdeveloped collaborators, despite the complementary objectives between translational science and extension. This case study details the creation of a nationally unique interprofessional organizational structure between the University of Missouri (MU) Office of Extension and Engagement (MU Extension) and the MU School of Medicine to accelerate statewide reach of research and education discoveries using high-touch community health approaches. This article describes specific strategies used to systematically plan for: 1) creation and operation of the new structure, 2) routinization and institutionalizing the work, and 3) sustainability. We further outline challenges and next steps. The development of the backbone organization office of Health Outreach Policy and Education (HOPE) brings together the interprofessional expertise of five units with a common agenda to advance mutually reinforcing activities. HOPE is poised to make significant contributions to amplify MU’s land grant mission, garner additional grant funding, and advance the health of Missourians.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.5,"publicationDate":"2024-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0149718924000521/pdfft?md5=de9d110f343effce59cdd94a35136c02&pid=1-s2.0-S0149718924000521-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141411293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}