Evaluation Review最新文献_第10页

Some Lessons From 50 Years of Multiarm Public Policy Experiments. 50年多部门公共政策实验的一些教训。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-02-01 DOI: 10.1177/0193841X20977332

Larry L Orr, Daniel Gubits

引用次数: 2

Insights From the Health Profession Opportunity Grant Program's Three-Armed, Multi-Site Experiment for Policy Learning and Evaluation Practice. 从卫生专业机会资助计划的三臂，多地点的政策学习和评估实践实验的见解。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-02-01 DOI: 10.1177/0193841X221133420

Laura R Peck, Hilary Bruck, Nicole Constance

引用次数: 1

Introduction to the Special Issue. 特刊简介。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-02-01 DOI: 10.1177/0193841X221144802

Andrew P Jaciw

{"title":"Introduction to the Special Issue.","authors":"Andrew P Jaciw","doi":"10.1177/0193841X221144802","DOIUrl":"https://doi.org/10.1177/0193841X221144802","url":null,"abstract":"Multi-armed trials are randomized experiments in which subjects are randomly assigned to more than two conditions. In contrast to standard twoarmed experiments that usually involve randomization to two conditions (usually treatment and control), multi-armed trials involve three or more arms (usually control and two or more active treatment conditions). This special issue of Evaluation Review includes five articles on multiarmed trials. The first three are retrospective works by pioneers of the method and its use in their respective fields. The last two articles describe contemporary applications. In this introduction, I describe an important recurrent theme, and then briefly comment on each article. Multi-armed experiments have benefits but also pose challenges. Consider first the benefits. Multiple treatment arms allow an evaluation of more causal contrasts compared to a standard two-armed study. One treatment may be compared to another, and each treatment may be compared to a control. Multiarmed trials expand the opportunity to test multiple hypotheses concerning which treatment works best under specific conditions, and for certain subgroups of interest. The additional information yielded through multi-armed experiments is valuable: in complex decision-making situations, it offers flexibility of solutions and helps to establish the external validity of causal inferences. However, we must temper our enthusiasm over these benefits with the reality that multi-armed trials engender complexities that are either irrelevant to, or more-simplified with, two-armed trials. They include the logistics of","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 1","pages":"3-10"},"PeriodicalIF":0.9,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10473599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Design of the RAND Health Insurance Experiment: A Retrospective. RAND健康保险实验的设计:回顾。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-02-01 DOI: 10.1177/0193841X20976520

Joseph P Newhouse

引用次数: 3

A Study of Evaluation Influence in Two Child Protection Programs. 两个儿童保护项目的评价影响研究。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2022-12-01 DOI: 10.1177/0193841X221104911

James Leslie Herbert

{"title":"A Study of Evaluation Influence in Two Child Protection Programs.","authors":"James Leslie Herbert","doi":"10.1177/0193841X221104911","DOIUrl":"https://doi.org/10.1177/0193841X221104911","url":null,"abstract":"Evaluation influence is a reconceptualization of evaluation use that reflects the broad and diffuse impacts an evaluation can have on social programs and policies. This way of thinking about impact provides an opportunity to investigate how and why evaluations influence social programs and policy. Twenty participants (practitioners and managers) from two child protection programs evaluated in the previous 24 months were interviewed about the influence of these evaluations, which was complemented with the collection of internal documents about changes to the programs. A qualitative case study analysis of evaluation influence was conducted using the interviews and documents to investigate the influence of two evaluations at different stages in the dissemination process. The participants identified that the evaluations appeared to have significant high-level policy level influence; however, limited examples of influence on practices in the programs were identified. There was some suggestion that the evaluations had increased practitioner interest in working with and participating in program evaluations. The findings suggest the importance of developmental evaluation approaches and practitioner engagement in evaluation to improve the influence and adoption of new knowledge from the evaluation of social programs.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"46 6","pages":"683-708"},"PeriodicalIF":0.9,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10431356","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The race Against Time to Save Human Lives During the COVID-19 With Vaccines: Global Evidence. 与时间赛跑，在COVID-19期间用疫苗拯救人类生命:全球证据。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2022-12-01 DOI: 10.1177/0193841X221085352

Phuc Van Nguyen, Toan L D Huynh, Vu Minh Ngo, Huan Huu Nguyen

{"title":"The race Against Time to Save Human Lives During the COVID-19 With Vaccines: Global Evidence.","authors":"Phuc Van Nguyen, Toan L D Huynh, Vu Minh Ngo, Huan Huu Nguyen","doi":"10.1177/0193841X221085352","DOIUrl":"https://doi.org/10.1177/0193841X221085352","url":null,"abstract":"Voluminous vaccine campaigns have been used globally, since the COVID-19 pandemic has brought devastating mortality and destructively unprecedented consequences to different aspects of economies. This study aimed to identify how the numbers of new deaths and new cases per million changed after half of the population had been vaccinated. This paper used actual pandemic consequence variables (death and infected rates) together with vaccination uptake rates from 127 countries to shed new light on the efficacy of COVID-19 vaccines. The 50% uptake rate was chosen as the threshold to estimate the real benefits of vaccination campaigns for reducing COVID-19 infection and death cases using the difference-in-differences (DiD) imputation estimator. In addition, a number of control variables, such as government interventions and people's mobility patterns during the pandemic, were also included in the study. The number of new deaths per million significantly decreased after half of the population was vaccinated, but the number of new cases did not change significantly. We found that the effects were more pronounced in Europe and North America than in other continents. Our results remain robust after using other proxies and testing the sensitivity of the vaccinated proportion. We show the causal evidence of significantly lower death rates in countries where half of the population is vaccinated globally. This paper expresses the importance of vaccine campaigns in saving human lives during the COVID-19 pandemic, and its results can be used to communicate the benefits of vaccines and to fight vaccine hesitancy.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"46 6","pages":"709-724"},"PeriodicalIF":0.9,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9152627/pdf/10.1177_0193841X221085352.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10806678","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

Toward the Fourth Industrial Revolution among E7 Economies: Assessment of the Combined Impact of Institutional Quality, Bank Funding, and Foreign Direct Investment. 迈向E7经济体的第四次工业革命:制度质量、银行融资和外国直接投资综合影响的评估。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2022-12-01 DOI: 10.1177/0193841X221112547

Muhammad Shahbaz, Bright A Gyamfi, Festus Victor Bekun, Divine Q Agozie

{"title":"Toward the Fourth Industrial Revolution among E7 Economies: Assessment of the Combined Impact of Institutional Quality, Bank Funding, and Foreign Direct Investment.","authors":"Muhammad Shahbaz, Bright A Gyamfi, Festus Victor Bekun, Divine Q Agozie","doi":"10.1177/0193841X221112547","DOIUrl":"https://doi.org/10.1177/0193841X221112547","url":null,"abstract":"Technological innovation and its paradigm, that is, the Fourth Industrial Revolution-4IR, have shown strong impact on income levels of adopters across the globe. To this end, this analysis examines the impact of bank funding and institutional quality on technological advancement. This study adds additional variables such as high-technology exports and foreign direct investment (FDI) as control variable. Our study period spans from 2000 to 2018 on an annual frequency for E7 economies (Brazil, Indonesia, Mexico, India, Turkey, Russia, and China). This study leverages on cross-sectional ARDL, Augmented Mean Group (AMG), and Common Correlated Effects Mean Group Estimates (CCEMG) estimation techniques to examine long-run relationship between the outlined variables. Empirical findings show that institution quality, bank finance, income, high-technology exports, and foreign direct investments exert a positive effect on advancements in technology. Furthermore, the interaction between bank finance and institution quality on technological advancement is also positive and statistically significant. Based on the findings, it is concluded that large-scale funding is crucial for businesses to leverage revolutionary technology. Likewise, access to large capital sources if made easier encourages technology affordance as well as innovation and operational excellence. Thus, economies with established legal and financial systems stand to offer businesses such security, which encourages business innovation. Consequently, E7 economies ought to improve their financial and legal systems to boost financial security, creativity, and competitiveness of businesses.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"46 6","pages":"779-803"},"PeriodicalIF":0.9,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10442101","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

BEPS Project and International Tax Reform: The 2021 Agreements on Taxing Multinational Companies. BEPS项目与国际税制改革:2021年对跨国公司征税协议。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2022-12-01 DOI: 10.1177/0193841X221103338

José M Cantos

{"title":"BEPS Project and International Tax Reform: The 2021 Agreements on Taxing Multinational Companies.","authors":"José M Cantos","doi":"10.1177/0193841X221103338","DOIUrl":"https://doi.org/10.1177/0193841X221103338","url":null,"abstract":"The globalization of commercial exchanges and capital movements reveal new ways of obtaining value in economic activities, and the differences in the tax burden of companies, depending on where they reside, have become threats for countries to exercise the right to tax business profits generated in its jurisdiction. This problem, together with tax competition between countries, causes a transfer of tax bases towards countries with lower tax rates and tax havens. The lack of agreement in the international community on how to find a solution to the problems has caused several countries to choose to establish special taxes for certain activities of multinational companies in their jurisdictions, resulting in inefficient taxes. This paper analyzes the agreement reached in October 2021 in the G20 and in the OECD in which measures are adopted within the BEPS project to prevent the erosion of tax bases in market jurisdictions promoted by multinational companies. After studying different aspects, we found fundamental reasons for not having an optimistic view on the effective solution to the problems above: unrealistic forecasts on the amount of the new estimated tax bases for Pillar 1 and the high administration and compliance costs. In conclusion, it is not foreseeable that the tax bases derived from the provision of digital services will suffer a territorial redistribution. We do not expect that a minimum tax rate of 15% in corporate tax will be carried out effectively or that the benefits that are transferred to tax havens will be significantly reduced.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"46 6","pages":"725-749"},"PeriodicalIF":0.9,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10441806","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Using Simulation to Analyze Interrupted Time Series Designs. 用仿真分析中断时间序列设计。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2022-12-01 DOI: 10.1177/0193841X221101286

Luke W Miratrix

{"title":"Using Simulation to Analyze Interrupted Time Series Designs.","authors":"Luke W Miratrix","doi":"10.1177/0193841X221101286","DOIUrl":"https://doi.org/10.1177/0193841X221101286","url":null,"abstract":"We are sometimes forced to use the Interrupted Time Series (ITS) design as an identification strategy for potential policy change, such as when we only have a single treated unit and cannot obtain comparable controls. For example, with recent county- and state-wide criminal justice reform efforts, where judicial bodies have changed bail setting practices for everyone in their jurisdiction in order to reduce rates of pre-trial detention while maintaining court order and public safety, we have no natural and available comparison group other than the past. In these contexts, it is imperative to model pre-policy trends with a light touch, allowing for structures such as autoregressive departures from any pre-existing trend, in order to accurately and realistically assess the uncertainty of our projections. We aim to provide a methodological approach rooted in commonly understood and used modeling tools to achieve this. We quantify uncertainty with simulation, generating a distribution of plausible counterfactual trajectories to compare to the observed; this approach naturally allows for incorporating seasonality and other time-varying covariates, and provides confidence intervals along with point estimates for the potential impacts of policy change. We find simulation provides a natural framework to capture and show uncertainty in the ITS designs. It also allows for easy extensions such as nonparametric smoothing in order to handle multiple post-policy time points.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"46 6","pages":"750-778"},"PeriodicalIF":0.9,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10806677","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Repetita Iuvant? A Repeated Randomized Controlled Trial on the Effectiveness of an At-Scale Teacher Professional Development Program. Repetita Iuvant吗?一项关于教师专业发展计划有效性的重复随机对照试验。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2022-10-01 Epub Date: 2021-11-26 DOI: 10.1177/0193841X211055354

Giovanni Abbiati, Gianluca Argentin, Andrea Caputo, Aline Pennisi

{"title":"Repetita Iuvant? A Repeated Randomized Controlled Trial on the Effectiveness of an At-Scale Teacher Professional Development Program.","authors":"Giovanni Abbiati, Gianluca Argentin, Andrea Caputo, Aline Pennisi","doi":"10.1177/0193841X211055354","DOIUrl":"https://doi.org/10.1177/0193841X211055354","url":null,"abstract":"A recent stream of literature recognizes the impact of good/poor implementation on the effectiveness of programs. However, implementation is often disregarded in randomized controlled trials (RCTs) because they are run on a small scale. Replicated RCTs, although rare, provide a unique opportunity to study the relevance of implementation for program effectiveness. Evaluating the effectiveness of an at-scale professional development program for lower secondary school math teachers through two repeated RCTs. The program lasts a full school year and provides innovative methods for teaching math. The evaluation was conducted on two cohorts of teachers in the 2009/10 and 2010/11 school years. The program and RCTs were held at scale. Participating teachers and their classes were followed for 3 years. Impact is estimated by comparing the math scores of treatment and control students. The evaluation involved 195 teachers and their 3940 students (first cohort) and 146 teachers and their 2858 students (second cohort). The key outcome is students' math achievement, measured through standardized assessment. In the first wave, the program did not impact on students' achievement, while in the second wave, a positive, persistent, and not insignificant effect was found. After excluding other sources of change, different findings across waves are interpreted in the light of improvements in the program implementation, such as enrollment procedure, teacher collaboration, and integration of innovation in daily teaching. Repeated assessment of interventions already at-scale provides the opportunity to better identify and correct sources of weak implementation, potentially improving effectiveness.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"46 5","pages":"578-597"},"PeriodicalIF":0.9,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"39670582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1