Evaluation Review最新文献_第9页

Evaluating Research Efficiency in Indonesian Higher Education Institution. 评价印尼高等教育机构的研究效率。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-04-01 DOI: 10.1177/0193841X221118181

Muhammad Dimyati, Adhi Indra Hermanu

{"title":"Evaluating Research Efficiency in Indonesian Higher Education Institution.","authors":"Muhammad Dimyati, Adhi Indra Hermanu","doi":"10.1177/0193841X221118181","DOIUrl":"https://doi.org/10.1177/0193841X221118181","url":null,"abstract":"The Indonesian government has evaluated the research performance of universities, whose measurement process is projected into resources, management, outputs, and revenues to determine the provision of incentives, grants, and program funding to universities. However, efficiency calculations have shown that the outputs and competition-based incentives that drive scientific productivity are more complex. The most competitive systems must also be the most productive when considering resources. This study aimed to analyze the research efficiency in the Indonesian higher education system. The efficiency was analyzed by maximizing the 13 product outputs from the research budget and university staff. The result was then compared with the existing performance measurement analysis. Data Envelopment Analysis (DEA) was used to evaluate the efficiency based on the data of 47 universities in the Mandiri cluster and 144 in the Utama cluster for the 2014-2018 period. These findings showed that about 68% of universities have an efficiency value of 1 for the Mandiri group, almost 40% in the Utama group, and 41% for the two groups combined. Additionally, this study compared the efficiency analysis and the impact of the performance evaluation. The comparison showed that adding efficiency or productivity factors in the performance evaluation assessment produced a more accurate result.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 2","pages":"155-181"},"PeriodicalIF":0.9,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9075550","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

2020 Rossi Award Lecture: The Evolving Art of Program Evaluation. 2020 年罗西奖讲座：不断发展的计划评估艺术。

IF 3 4区社会学

Evaluation Review Pub Date : 2023-04-01 Epub Date: 2022-08-29 DOI: 10.1177/0193841X221121241

Randall S Brown

{"title":"2020 Rossi Award Lecture: The Evolving Art of Program Evaluation.","authors":"Randall S Brown","doi":"10.1177/0193841X221121241","DOIUrl":"10.1177/0193841X221121241","url":null,"abstract":"Evaluation of public programs has undergone many changes over the past four decades since Peter Rossi coined his \"Iron Law\" of program evaluation: \"The expected value of any net impact assessment of any large-scale social program is zero.\" While that assessment may be somewhat overstated, the essence still holds. The failures far outnumber the successes, and the estimated favorable effects are rarely sizeable. Despite this grim assessment, much can be learned from \"failed\" experiments, and from ones that are successful in only some sites or subgroups. Advances in study design, statistical models, data, and how inferences are drawn from estimates have substantially improved our analyses and will continue to do so. However, the most actual learning about \"what works\" (and why, when, and where) is likely to come from gathering more detailed and comprehensive data on how the intervention was implemented and attempting to link that data to estimated impacts. Researchers need detailed data on the target population served, the content of the intervention, and the process by which it is delivered to participating service providers and individuals. Two examples presented here illustrate how researchers drew useful broader lessons from impact estimates for a set of related programs. Rossi posited three reasons most interventions fail-wrong question, wrong intervention, poor implementation. Speeding the accumulation of wisdom about how social programs can best help vulnerable populations will require that researchers work closely with program funders, developers, operators, and participants to gather and interpret these detailed data about program implementation.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 2","pages":"209-230"},"PeriodicalIF":3.0,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9095736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Regression Discontinuity for Binary Response and Local Maximum Likelihood Estimator to Extrapolate Treatment. 二元响应的回归不连续及外推处理的局部极大似然估计。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-04-01 DOI: 10.1177/0193841X221105968

Goeun Lee, Myoung-Jae Lee

引用次数: 1

Renewable Energy Consumption-Growth Nexus in European Countries: A Sectoral Approach. 欧洲国家的可再生能源消费-增长关系:一个部门方法。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-04-01 DOI: 10.1177/0193841X221125982

Mihaela Simionescu, Magdalena Rădulescu, Javier Cifuentes-Faura

{"title":"Renewable Energy Consumption-Growth Nexus in European Countries: A Sectoral Approach.","authors":"Mihaela Simionescu, Magdalena Rădulescu, Javier Cifuentes-Faura","doi":"10.1177/0193841X221125982","DOIUrl":"https://doi.org/10.1177/0193841X221125982","url":null,"abstract":"The renewable energy consumption plays a significant role in achieving sustainable development, but a sectoral approach is necessary to design the better recommendations for each sector. In this context, the main objective of this paper is to assess the impact of the use of this type of energy on economic growth in 23 European Union (EU) member states in the period 1990-2020. Besides overall renewable energy consumption, different utilisations of this energy are considered: in industry, transport, in commercial and public services, and for residential purposes. The methodological background is built around panel data models that start from a Cobb-Douglas function. The renewable energy consumption is considered an important factor that should generate economic growth. The panel data approach based on causality analysis and Augmented Mean Group and Common Correlated Effects Mean Group estimators suggests that renewable energy use in industry does not determine economic growth, but economic development is a cause for more utilisation of this energy in industry. In addition, more renewable energy consumption in transport enhances economic growth. A high level of economic development can promote the consumption of renewable energies in industrial sectors. In this way, industrial companies can allocate more financial funds to research in the field of renewable energies and can afford to adopt renewable energy sources. Investment in biofuels can contribute to achieving sustainable transport in the EU.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 2","pages":"287-319"},"PeriodicalIF":0.9,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10821866","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 10

Evaluating the Importance of Monetary Policy Uncertainty: The Long- and Short-Term Effects and Responses. 评估货币政策不确定性的重要性:长期和短期影响及对策。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-04-01 DOI: 10.1177/0193841X221124434

Yang Hu, Yanran Hong, Kai Feng, Jikai Wang

{"title":"Evaluating the Importance of Monetary Policy Uncertainty: The Long- and Short-Term Effects and Responses.","authors":"Yang Hu, Yanran Hong, Kai Feng, Jikai Wang","doi":"10.1177/0193841X221124434","DOIUrl":"https://doi.org/10.1177/0193841X221124434","url":null,"abstract":"Monetary policy changes have an irreplaceable impact on economic activity. Considering the close linkage among economic policies, we employ a bi-directional Granger causality test to investigate the potential linkages between monetary policy uncertainty (MPU) and other categorical economic policy uncertainty (CEPU) in the time and frequency domains. We consider all news-based U.S. categorical economic policy uncertainty indices (CEPU). All monthly CEPU indicators, covering January 1986 to January 2022, can be obtained from the website of Economic Policy Uncertainty. On an average, causality running from each CEPU to MPU is not apparent, while MPU can significantly affect six policy-related uncertainties: taxes, government spending, health care, national security, entitlement programs and regulation. A further frequency-domain study showed the dynamic changes in the relationship between them. For instance, we capture mid- and long-run causality running from tax uncertainty to MPU, while MPU has an impact on taxes in the medium run. Our findings provide policymakers with a better understanding of the nexus between MPU and other CEPU for formulating appropriate economic policies. Particularly, if a sectional government considers the long- and short-term effects of different policies when formulating strategies, risk transmission may be curbed to some extent.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 2","pages":"264-286"},"PeriodicalIF":0.9,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10821867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 6

Estimating the Impact of Emergency Assistance on Educational Progress for Low-Income Adults: Experimental and Nonexperimental Evidence. 估计紧急援助对低收入成人教育进步的影响:实验和非实验证据。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-04-01 DOI: 10.1177/0193841X221118454

Daniel Litwok

{"title":"Estimating the Impact of Emergency Assistance on Educational Progress for Low-Income Adults: Experimental and Nonexperimental Evidence.","authors":"Daniel Litwok","doi":"10.1177/0193841X221118454","DOIUrl":"https://doi.org/10.1177/0193841X221118454","url":null,"abstract":"Methods for estimating causal impact aim to either remove or reduce bias. This study estimates the degree of bias reduction obtained from regression adjustment and propensity score methods when only a weak set of predictors are available. The study uses an experimental test of providing emergency financial assistance to participants in a job training program to estimate an experimental benchmark and compares it to nonexperimental estimates of the impact of receiving assistance. When estimating the impact of receiving assistance, those who received it constitute the treatment group. The study explores two different comparison groups: those who could have (because they were assigned to the experimental treatment group) but did not receive emergency assistance; and those who could not receive emergency assistance because they were randomly assigned to the experimental control group. It uses these groups to estimate impacts by applying three estimation strategies: unadjusted mean comparison, regression adjustment, and inverse propensity weighting. It then compares these estimates to the experimental benchmark using statistical tests recommended by the within-study comparison literature. The nonexperimental approaches to addressing selection bias suggest large positive impacts. These are statistically different from the experimental benchmark, which shows that receipt of emergency assistance does not improve educational progress. Further, over 90% of the bias from a simple comparison of means remains. Unless a stronger set of predictors are available, future evaluations of such interventions should be wary of relying on these methods for either unbiased estimation of impacts or bias reduction.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 2","pages":"231-263"},"PeriodicalIF":0.9,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9075559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Understanding the Evolution of Environment, Social and Governance Research: Novel Implications From Bibliometric and Network Analysis. 理解环境、社会和治理研究的演变:来自文献计量学和网络分析的新启示。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-04-01 DOI: 10.1177/0193841X221121244

Amit Kumar Singh, Yifang Zhang, Anu

{"title":"Understanding the Evolution of Environment, Social and Governance Research: Novel Implications From Bibliometric and Network Analysis.","authors":"Amit Kumar Singh, Yifang Zhang, Anu","doi":"10.1177/0193841X221121244","DOIUrl":"https://doi.org/10.1177/0193841X221121244","url":null,"abstract":"Given the scarcity of comprehensive review studies in the literature, this bibliometric analysis thrives on taking a scientific approach to delivering quantitative and qualitative information on the ever-evolving field of ESG. Utilizing the performance analysis and science mapping techniques which includes citation analysis, co-word analysis, the study reports a holistic overview of 693 (ESG) papers from 1991 to 2020. The paper aims to provide a unified perspective on the evolution and further identify future research directions in this field. The findings point to the most important countries, authors, studies, and top journals in this field. Results show that published articles on ESG gained momentum after 2006; however, an exponential rise is being observed in the past 5 years, with research focusing on sustainable finance, sustainable development, ESG, and CSR with themes extending to risk management, stakeholder engagement, and portfolio construction, among others. Furthermore, the research identifies how the practice of ESG reporting affects many variables such as financial performance, social performance, environmental performance, and sustainability score. The findings also indicate that the field of ESG is still evolving, with numerous unexplored themes. The work is novel and relevant on the pretext that it uses the Scopus and Web of Science databases for bibliometric mapping, whereas previous studies have used the Scopus database but have lacked a robust methodology, so the findings of this study provided strong support for identifying emerging paradigms in the ESG literature.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 2","pages":"350-386"},"PeriodicalIF":0.9,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9370100","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

Impact of Economic Policy Uncertainty and Pandemic Uncertainty on International Tourism: What do We Learn From COVID-19? 经济政策不确定性和大流行不确定性对国际旅游业的影响:我们从COVID-19中学到了什么?

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-04-01 DOI: 10.1177/0193841X221132125

Xin Zhao, Muhammad Saeed Meo, Tella Oluwatoba Ibrahim, Noshaba Aziz, Solomon Prince Nathaniel

{"title":"Impact of Economic Policy Uncertainty and Pandemic Uncertainty on International Tourism: What do We Learn From COVID-19?","authors":"Xin Zhao, Muhammad Saeed Meo, Tella Oluwatoba Ibrahim, Noshaba Aziz, Solomon Prince Nathaniel","doi":"10.1177/0193841X221132125","DOIUrl":"https://doi.org/10.1177/0193841X221132125","url":null,"abstract":"Uncertainty is an overarching aspect of life that is particularly pertinent to the present COVID-19 pandemic crisis; as seen by the pandemic's rapid worldwide spread, the nature and level of uncertainty have possibly increased due to the possible disconnects across national borders. The entire economy, especially the tourism industry, has been dramatically impacted by COVID-19. In the current study, we explore the impact of economic policy uncertainty (EPU) and pandemic uncertainty (PU) on inbound international tourism by using data gathered from Italy, Spain, and the United States for the years 1995-2021. Using the Quantile on Quantile (QQ) approach, the study confirms that EPU and PU negatively affected inbound tourism in all states. Wavelet-based Granger causality further reveals bi-directional causality running from EPU to inbound tourism and unidirectional causality from PU to inbound tourism in the long run. The overall findings show that COVID-19 has had a strong negative effect on tourism. So resilient skills are required to restore a sustainable tourism industry.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 2","pages":"320-349"},"PeriodicalIF":0.9,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9579821/pdf/10.1177_0193841X221132125.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10822309","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Using Behavioral Insights to Market a Workplace Safety Program: Evidence From a Multi-Armed Experiment. 使用行为学见解来推销工作场所安全计划:来自多武装实验的证据。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-02-01 DOI: 10.1177/0193841X221136954

Randall Juras, Amy Gorman, Jacob Alex Klerman

{"title":"Using Behavioral Insights to Market a Workplace Safety Program: Evidence From a Multi-Armed Experiment.","authors":"Randall Juras, Amy Gorman, Jacob Alex Klerman","doi":"10.1177/0193841X221136954","DOIUrl":"https://doi.org/10.1177/0193841X221136954","url":null,"abstract":"This paper describes how a multi-armed randomized experiment was used to test multiple variants of a behaviorally informed marketing strategy. In particular, we tested whether specific behavioral messages could be used to increase demand for a safety consultation service offered by the U.S. Occupational Safety and Health Administration. Our experiment used a partial factorial design with 19 study arms and a very large research sample-97,182 establishments-to test the impact of various message, formats, and delivery modes compared with an existing (not behaviorally informed) informational brochure and a no-marketing counterfactual. A secondary research goal was to predict the impact of the most successful marketing strategy (i.e., combination of message, format, and mode) so that OSHA would know what to anticipate if that strategy were implemented at scale. We used two related (but distinct) methods to address these two goals. Both begin with a common mixed (i.e., fixed and random effects) ANOVA model. We addressed the first research goal primarily from the fixed effects; we addressed the second research goal by calculating best linear unbiased predictions (BLUPs) from the full mixed model, where the BLUP involves \"shrinkage\" as in empirical Bayes (EB) approaches. Marketing via brochures was effective overall, nearly doubling the rate of requests for services. However, the behaviorally informed materials performed no better than OSHA's existing informational brochure. This study also highlights the conditions under which a factorial design can be used to efficiently address questions about which of several program variants are most effective.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 1","pages":"123-151"},"PeriodicalIF":0.9,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10735900","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Using Multi-Arm Designs to Test Operating Welfare-to-Work Programs. 使用多臂设计测试运行的福利工作计划。

IF 0.9 4区社会学

Evaluation Review Pub Date : 2023-02-01 DOI: 10.1177/0193841X20984577

Judith M Gueron, Gayle Hamilton

{"title":"Using Multi-Arm Designs to Test Operating Welfare-to-Work Programs.","authors":"Judith M Gueron, Gayle Hamilton","doi":"10.1177/0193841X20984577","DOIUrl":"https://doi.org/10.1177/0193841X20984577","url":null,"abstract":"Background: In the early 1970s, most researchers thought that randomized controlled trials (RCTs) could not be used to measure the effectiveness of large-scale operating welfare reform and employment programs. By the mid-1970s, the Supported Work Demonstration showed that, under certain conditions, this was both feasible and valuable. However, the experimental design was simple; a multi-arm test had been rejected as unrealistic. Within 10 years, a three-arm design was implemented in San Diego to assess both a welfare-to-work program's overall impact and the contribution of a specific component. Less than 10 years later, the Job Opportunities and Basic Skills Training (JOBS)/National Evaluation of Welfare-to-Work Strategies (NEWWS) study used a more complex design to determine the relative effectiveness of two strategies operated in the same locations: one emphasizing getting a job quickly and the other requiring basic education. In San Diego and JOBS/NEWWS, the tested reforms emerged from political processes and were funded through regular program budgets. In both cases, researchers inserted multi-arm RCTs into operating welfare offices, trading control over the treatment for scale (thousands of people) and real-world conditions. Both RCTs were successfully implemented.Objectives and results: This article examines why multi-arm designs were attempted, how they were structured, why public administrators cooperated, what various actors sought to learn, and how the researchers determined what strategies the different experimental arms ended up to truly represent. The article concludes that these designs provide convincing evidence and can be inserted into operating programs if the studies address questions that are of keen and immediate interest to state or local program administrators and researchers.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 1","pages":"71-103"},"PeriodicalIF":0.9,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/0193841X20984577","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10721100","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0