Evaluation and Program Planning最新文献_第5页

The Icelandic Prevention Model Evaluation Framework and Implementation Integrity and Consistency Assessment 冰岛预防模式评估框架及实施完整性和一致性评估

IF 1.6 4区社会学

Evaluation and Program Planning Pub Date : 2024-06-10 DOI: 10.1016/j.evalprogplan.2024.102451

Michael J. Mann , John P. Allegrante , Megan L. Smith , Inga Dora Sigfusdottir , Alfgeir L. Kristjansson

{"title":"The Icelandic Prevention Model Evaluation Framework and Implementation Integrity and Consistency Assessment","authors":"Michael J. Mann , John P. Allegrante , Megan L. Smith , Inga Dora Sigfusdottir , Alfgeir L. Kristjansson","doi":"10.1016/j.evalprogplan.2024.102451","DOIUrl":"https://doi.org/10.1016/j.evalprogplan.2024.102451","url":null,"abstract":"<div><p>The Icelandic Prevention Model (IPM) follows a systematic but flexible process of community capacity building, data collection, analysis, dissemination, and community-engaged decision-making to guide the data-informed selection, prioritization, and implementation of intervention strategies in preventing adolescent substance use. This paper describes two new evaluation tools intended to assess the: 1) integrity of IPM implementation, and 2) unique aspects of IPM implementation in different community contexts. These evaluation tools include a: 1) five-phase <em>IPM Evaluation Framework for Assessing Value Across Communities, Cultures, and Outcomes (IPM-EF)</em>; and 2) 10-Step <em>IPM Implementation Integrity and Consistency Assessment</em> (<em>IPM-IICA</em>) that utilizes both quantitative (scored) and qualitative (narrative) data elements to characterize implementation integrity and consistency at both community coalition and school community levels. The IPM-EF includes five phases. Phase 1: Describe the Intervention Context; Phase 2a: Document the Extent to Which the 10 Steps of the IPM were Implemented (using the IPM-IICA scored); Phase 2b: Document the Unique Community-Specific Methods Used within the 10 Steps of the IPM to Tailor Local Intervention Delivery (using the IPM-IICA narrative); Phase 3: Measure Changes in Community Risk and Protective Factors; Phase 4: Measure the Outcomes Associated with the IPM; and Phase 5: Investigate Multiple Full Cycles Over Time.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0149718924000533/pdfft?md5=f4d4fedfa094d47cc0a82ca125168367&pid=1-s2.0-S0149718924000533-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141329054","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Digital competence among pre-service teachers: A global perspective on curriculum change as viewed by experts from 33 countries 职前教师的数字化能力：来自 33 个国家的专家对课程改革的全球视角。

IF 1.6 4区社会学

Evaluation and Program Planning Pub Date : 2024-05-31 DOI: 10.1016/j.evalprogplan.2024.102449

Łukasz Tomczyk

{"title":"Digital competence among pre-service teachers: A global perspective on curriculum change as viewed by experts from 33 countries","authors":"Łukasz Tomczyk","doi":"10.1016/j.evalprogplan.2024.102449","DOIUrl":"10.1016/j.evalprogplan.2024.102449","url":null,"abstract":"<div><p>In the intensely developing information society, the education of pre-service teachers presents an organisational, methodological, and conceptual challenge. Recent years have necessitated reflection on the content and modalities of the formation of digital competence in pre-service teachers. This article – considers which components the digital competences of the new generations of teachers should contain and how this area can be effectively developed within academic education. The article is the result of interviews conducted with 35 experts (recognized scholars in the field of media pedagogy) from North and South America, Africa, Australia and Oceania, Asia, and Europe. Qualitative interviews using the Delphi methodology were conducted between June and September 2022. Using grounded theory principles, it was noted that there is a need to modify pre-service teachers' curricula in the following areas: creating, retrieving and managing digital content; integrating ICT into subject content; developing soft skills; enhancing interactivity in the classroom; social aspects of ICT; distance learning; new socio-technical processes; advanced digital competencies; predictive learning; analysing the impact of ICT on human life; data protection; e-risks; low digital competencies; understanding media messaging; and supporting people with disabilities.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S014971892400051X/pdfft?md5=9a75901808c2142c7901b1e6908a1742&pid=1-s2.0-S014971892400051X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141238797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Empowering underprivileged students beyond financial aid: Insights from a scholarship program's monitoring and evaluation 赋予贫困学生经济援助之外的权力：从奖学金计划的监督和评估中获得的启示。

IF 1.6 4区社会学

Evaluation and Program Planning Pub Date : 2024-05-28 DOI: 10.1016/j.evalprogplan.2024.102448

Miriam Mutevere , Thulani Runyararo Dzinamarira , Lorcadia Muzenda , Stephen Nyoka , Valentine Chokudinga , Tawanda Mugoniwa , Enos Moyo , Fortunate Kakumura , Tafadzwa Dzinamarira

{"title":"Empowering underprivileged students beyond financial aid: Insights from a scholarship program's monitoring and evaluation","authors":"Miriam Mutevere , Thulani Runyararo Dzinamarira , Lorcadia Muzenda , Stephen Nyoka , Valentine Chokudinga , Tawanda Mugoniwa , Enos Moyo , Fortunate Kakumura , Tafadzwa Dzinamarira","doi":"10.1016/j.evalprogplan.2024.102448","DOIUrl":"10.1016/j.evalprogplan.2024.102448","url":null,"abstract":"<div><h3>Purpose</h3><p>This paper examines the impact of a scholarship program on underprivileged students, drawing on data from a two-year monitoring and evaluation (M&E) process. The report identifies both enablers and barriers to academic success among scholarship beneficiaries.</p></div><div><h3>Methods</h3><p>Data on program impact was collected through interviews with parents, teachers, and school records over two academic years.</p></div><div><h3>Results</h3><p>Financial aid emerged as a crucial enabler, with scholarships allowing students to focus on their studies by alleviating pressure around basic necessities. However, the research also revealed the importance of a holistic support system. Beyond tuition, the high cost of essential learning materials, including stationery, and subject-specific resources, can create a significant barrier. The study also highlighted the importance of student well-being. Health concerns, limited access to nutritious food, and even unaddressed mental health issues can all negatively impact attendance and focus. Furthermore, a gender gap emerged, with girls facing additional challenges related to social pressures to prioritize chores and the cost of menstrual hygiene products.</p></div><div><h3>Conclusion</h3><p>This study highlights the importance of holistic scholarship programs that extend beyond tuition coverage. To maximize impact, policymakers and funders should prioritize initiatives that address the multifaceted needs of underprivileged students.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141181180","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Case study in using value stream mapping in online graduate education 在在线研究生教育中使用价值流图的案例研究

IF 1.6 4区社会学

Evaluation and Program Planning Pub Date : 2024-05-20 DOI: 10.1016/j.evalprogplan.2024.102447

Candace D. Bloomquist , Lydia Holtz , Angela M. Lampe , Christine T. Carmichael

{"title":"Case study in using value stream mapping in online graduate education","authors":"Candace D. Bloomquist , Lydia Holtz , Angela M. Lampe , Christine T. Carmichael","doi":"10.1016/j.evalprogplan.2024.102447","DOIUrl":"10.1016/j.evalprogplan.2024.102447","url":null,"abstract":"<div><p>Given the rise in demand for online, graduate degree programs there is a need to guide program planning and evaluation professionals within institutions of higher education to utilize continuous quality improvement (CQI) strategies. Using principles of design thinking and CQI, the purpose of this case study was to describe a CQI project that sought to develop a better understanding of adult students’ experience progressing through their plan of study in an online doctoral program. As part of the CQI project, value stream mapping (VSM) was used to gain visibility and perspective on the actions required by faculty and staff to guide students through their plan of study. The VSM process provided information that led to conversations that furthered the CQI efforts and led to changes in the adult education program that would benefit all students. Improvement processes that lead to better quality and more positive experiences for users are valuable. This case study demonstrates the processes, challenges, lessons, and future directions in the use of VSM to better understand online graduate programs designed for adult learners.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141135661","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Examining the causes and effects of time overruns in construction projects promoted by rural municipalities in Nepal 研究尼泊尔农村市政当局推动的建筑项目超时的原因和影响

IF 1.6 4区社会学

Evaluation and Program Planning Pub Date : 2024-05-17 DOI: 10.1016/j.evalprogplan.2024.102436

Madhav Prasad Koirala , Roshan Samrat Shahi

{"title":"Examining the causes and effects of time overruns in construction projects promoted by rural municipalities in Nepal","authors":"Madhav Prasad Koirala , Roshan Samrat Shahi","doi":"10.1016/j.evalprogplan.2024.102436","DOIUrl":"10.1016/j.evalprogplan.2024.102436","url":null,"abstract":"<div><p>Time overruns are the most common issue in construction projects, which have a significant negative impact on the project and the parties involved. This also applies to National Competitive Bidding (NCB) construction projects in municipalities, jeopardizing project timelines, costs, and quality standards. Poor performance by professionals in rural municipalities has resulted in inadequate infrastructure development in these areas. The goal of this study is to understand the causes and effects of time overruns by employing an exploratory and descriptive research methodology. The data from clients, consultants, and contractors consistently highlights key factors contributing to project delays, including adverse weather conditions, limited involvement from contractor head offices, insufficient consultant experience, inadequate site management, and delays in site mobilization. These delays incur substantial costs related to materials, land acquisition, labor, and market risks. The results included that 52.17% the projects experienced time overruns ranging from 24.4% to 514.71%. Furthermore, 21.73% of projects experienced cost overruns, with the highest at 19.92%. These findings provide critical insights for improving project management and addressing construction time overruns. It recommends conducting national-scale analyses to gain a comprehensive understanding of construction delays and to implement effective mitigation strategies.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141055134","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Developing evaluation measures for health departments sharing and linking HIV and STI surveillance data 为卫生部门共享和连接 HIV 和 STI 监测数据制定评估措施

IF 1.6 4区社会学

Evaluation and Program Planning Pub Date : 2024-05-16 DOI: 10.1016/j.evalprogplan.2024.102435

Shannon Hitchcock, Leigh Evans, Jane Fox

{"title":"Developing evaluation measures for health departments sharing and linking HIV and STI surveillance data","authors":"Shannon Hitchcock, Leigh Evans, Jane Fox","doi":"10.1016/j.evalprogplan.2024.102435","DOIUrl":"10.1016/j.evalprogplan.2024.102435","url":null,"abstract":"<div><p>Enhancing data sharing, quality, and use across siloed HIV and STI programs is critical for national and global initiatives to reduce new HIV infections and improve the health of people with HIV. As part of the <em>Enhancing Linkage of STI and HIV Surveillance Data in the Ryan White HIV/AIDS Program</em> initiative, four health departments (HDs) in the U.S. received technical assistance to better share and link their HIV and STI surveillance data. The process used to develop evaluation measures assessing implementation and outcomes of linking HIV and STI data systems involved six steps: 1) measure selection and development, 2) review and refinement, 3) testing, 4) implementation and data collection, 5) data quality review and feedback, and 6) dissemination. Findings from pilot testing warranted slight adaptations, including starting with a core set of measures and progressively scaling up. Early findings showed improvements in data quality over time. Lessons learned included identifying and engaging key stakeholders early; developing resources to assist HDs; and considering measure development as iterative processes requiring periodic review and reassessment to ensure continued utility. These findings can guide programs and evaluations, especially those linking data across multiple systems, in developing measures to track implementation and outcomes over time.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141030267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Human resources development: Evaluating perceptions against policy 人力资源开发：根据政策评估看法

IF 1.6 4区社会学

Evaluation and Program Planning Pub Date : 2024-05-11 DOI: 10.1016/j.evalprogplan.2024.102437

Julita Majczyk , Przemysław Dubel

{"title":"Human resources development: Evaluating perceptions against policy","authors":"Julita Majczyk , Przemysław Dubel","doi":"10.1016/j.evalprogplan.2024.102437","DOIUrl":"10.1016/j.evalprogplan.2024.102437","url":null,"abstract":"<div><p>The objective of sustaining smart, sustainable and cohesive inclusive growth, framed by the European strategy, is in line with the global commitments of the Sustainable Development Goals. Thus, an analysis of people’s attitudes towards social policy and perceptions of professional development in Poland against European development policy is crucial. The nationwide representative sample included 1000 respondents aged 18–64. The study used principal component analysis (PCA), an approach for the multi-response optimisation. The results indicate that respondents’ evaluations are in line with the direction of EU labour policy, where their decisions correspond to the planned priorities oriented towards inclusion and cohesion. The PCA analysis showed that employee competencies and priorities for individual standing can be considered strongly correlated. Competencies were also found to be important for the platform to support systemic development. However, the items included in the analysis that are beyond the scope of the ESF+ , although even correlated, are of lesser importance. The research results allow to expand knowledge on the perception of the development policy facets promoted by the EU, supplemented by themes of leadership or immigrants. The study may become a starting point for inclusive and cohesive working climate research.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141049465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Gender biases in the evaluation of knowledge transfer: A meta-evaluative analysis of the Spanish “Knowledge Transfer and Innovation Sexennium” 知识转让评估中的性别偏见：对西班牙 "知识转让与创新 Sexennium "的元评价分析

IF 1.6 4区社会学

Evaluation and Program Planning Pub Date : 2024-04-12 DOI: 10.1016/j.evalprogplan.2024.102432

María Bustelo , Olga Salido

{"title":"Gender biases in the evaluation of knowledge transfer: A meta-evaluative analysis of the Spanish “Knowledge Transfer and Innovation Sexennium”","authors":"María Bustelo , Olga Salido","doi":"10.1016/j.evalprogplan.2024.102432","DOIUrl":"https://doi.org/10.1016/j.evalprogplan.2024.102432","url":null,"abstract":"<div><p>This paper analyses from a gender perspective a pilot call for evaluating academics and researcher transfer and innovation activities, launched by the Spanish Government in 2018, known as the “Knowledge Transfer & Innovation Sexennium” (KT&IS). Not only women’s participation was much lower than that of men (1 woman applicant for every 3 men applicants), but also, they showed lower success rates than men in all scientific fields, with an average gap of more than 13 points. The methodology combined an exploratory quantitative analysis of the almost 17,000 applications, with a meta-evaluative qualitative analysis through interviews to key actors of the evaluation program and focus groups with evaluators. Hidden biases operating throughout and in each of the different phases of the KT&IS evaluation process were identified. This article aims at contributing to how economic and social impact of research can be fairly and fully evaluated, as well as at facilitating the design of future evaluation calls that promote the effective advancement of gender equality in all science-related activities and transfer to society.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-04-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S014971892400034X/pdfft?md5=193177d244e2c1203feb330b51c820bd&pid=1-s2.0-S014971892400034X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140632729","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Beyond the average effect of the innovation subsidies: Using case selection via matching to break impasse in delivering useful advice to policy makers 超越创新补贴的平均效应：通过匹配选择案例，打破向政策制定者提供有用建议的僵局

IF 1.6 4区社会学

Evaluation and Program Planning Pub Date : 2024-04-04 DOI: 10.1016/j.evalprogplan.2024.102429

Maciej Koniewski, Seweryn Krupnik , Paulina Skórska

引用次数: 0

Evaluation of primary-level credit environment, indicator system and empirical analysis: A case study of credit construction in China county and district 基层信用环境评价、指标体系及实证分析：中国县区信用建设案例研究

IF 1.6 4区社会学

Evaluation and Program Planning Pub Date : 2024-04-04 DOI: 10.1016/j.evalprogplan.2024.102433

Zhouyi Gu , Xihui Chen , Anna Parziale , Zhuoyuan Tang

{"title":"Evaluation of primary-level credit environment, indicator system and empirical analysis: A case study of credit construction in China county and district","authors":"Zhouyi Gu , Xihui Chen , Anna Parziale , Zhuoyuan Tang","doi":"10.1016/j.evalprogplan.2024.102433","DOIUrl":"https://doi.org/10.1016/j.evalprogplan.2024.102433","url":null,"abstract":"<div><p>Townships (towns, streets) represent the foundational layer of China's administrative structure, and the quality of their credit environment is crucial for underpinning the development of a primary-level social credit system. This initiative aims to accelerate the establishment of the social credit system and cultivate a trustworthy economic and social environment. Starting from the three major fields of government, business and society, and focusing on integrity culture and credit innovation, the article proposes an innovative evaluation framework for primary-level credit environment and it can become a point of reference as a policy tool in international evaluation programs. Using clustering and the coefficient of variation methods, we quantitatively refine our indicator system, establishing a set of criteria to assess the primary-level credit environment. We incorporate hierarchical analysis, the entropy weight method, and machine learning models to conduct a comprehensive evaluation of the credit environments within 24 townships (towns, streets) of Fuyang District in Hangzhou City for the year 2023. The findings underscore the need for a realistic appraisal of the current state and deficiencies of the primary-level credit environment. We advocate for the bolstering of credit development within governmental, business, and societal realms. It's imperative to leverage the normative influence of honesty and integrity culture, enhance the breadth and application of credit innovations, and thereby foster the high-quality growth of the primary-level social credit system.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2024-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140351108","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0