Evaluation Review最新文献

{"title":"The Impact of School Infrastructure and Teachers' Human Capital on Academic Performance in Brazil.","authors":"Peter Wanke, Adriano Lauro, Otávio H Dos Santos Figueiredo, João Ricardo Faria, Franklin G Mixon","doi":"10.1177/0193841X231197741","DOIUrl":"10.1177/0193841X231197741","url":null,"abstract":"<p><p>To improve one of the lowest rates of literacy and numeracy in the world, the government of Brazil has targeted public education reform, given the strong link between an educated population and economic growth. This study examines the academic performance of the Brazilian public primary school system. It addresses the empirical shortcomings of prior research to examine the dynamics of the relationship between academic performance scores and several demographic and institutional variables, such as socioeconomic characteristics, variations in school infrastructure and school complexity, and teachers' human capital. We employed quantile regression to explore the determinants of academic performance across 35,490 schools in rural and urban environments in Brazil. The dependent variable in our analysis captures the academic performance score, as measured by Brazil's education authorities, of each school in our dataset. The model includes several education-related indices used in prior research and, as explanatory factors, measures of teachers' human capital and the students' socioeconomic level, which synthesizes information on parents' education and household income. The results suggest that several institutional variables, including access to school libraries, computer facilities, projectors, and televisions, are positively and significantly related to the academic performance of primary students in Brazil's system of public education. Furthermore, students' socioeconomic level is positively associated with their academic performance.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"636-662"},"PeriodicalIF":3.0,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10052749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Building a Logic Model to Foster Engagement and Learning Using the Case of a Province-Wide Multispecies Antimicrobial Use Monitoring System.","authors":"Antoine Boudreau LeBlanc, Aude Motulsky, Marie-Pierre Moreault, Man Qing Liang, Ida Ngueng Feze, Luc Des Côteaux","doi":"10.1177/0193841X231198706","DOIUrl":"10.1177/0193841X231198706","url":null,"abstract":"<p><p>Successfully designing and implementing a program is complex; it requires a reflexive balance between the available resources and the priorities of various stakeholders, both of which change over time. Logic models are theory-based evaluation approaches used to identify and address key challenges of a program. This article describes the process of building a logic model on advanced theories in complexity studies. The models aim to support a province-wide multispecies monitoring system of antimicrobial use (AMU), designed in collaboration with the animal health sector in Quebec (Canada). Based on a rigorous theoretical foundation, the logic model is built in three steps: (1) <i>mapping</i>, a narrative review of literature on similar programs in other jurisdictions; (2) <i>framing,</i> iterative consultations with project members to elaborate the logic model; (3) <i>shaping</i>, hypotheses based on the logic model. The model emerges from the reflexive balancing of current scientific knowledge and empirical insights to gather relevant information about stakeholders from interdisciplinary experts that led a 3-year consensus-building process within the community. Recognizing the challenge of unpacking theories for practical use, we illustrate how the process of an \"open\" logic model building could enable governance coordination in complex processes. Logic models are useful for evaluating public, private, and academic partnerships in One Health programs that characterize an adaptive governance process.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"736-765"},"PeriodicalIF":3.0,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11193913/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10187065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Factors That Influence the Intention of Smallholder Rice Farmers to Adopt Cleaner Production Practices: An Empirical Study of Precision Agriculture Adoption.","authors":"Long Le Hoang Nguyen, Duong Thuy Khuu, Alrence Halibas, Trung Quang Nguyen","doi":"10.1177/0193841X231200775","DOIUrl":"10.1177/0193841X231200775","url":null,"abstract":"<p><p>Sustainable agriculture is crucial for achieving SDG2 and building a resilient climate-food system. This study provides a nuanced understanding of factors that influence the adoption of precision agriculture technology by Vietnamese smallholder rice farmers as a sustainable agricultural solution. The study's objectives are: (1) to provide a nuanced understanding of factors that influence adoption of precision agriculture technology by Vietnamese smallholder rice farmers; and (2) to identify factors associated with agricultural practice in Vietnam that may impact the adoption of precision agriculture technology. The study conducted 35 semi-structured interviews with smallholder rice farmers and agriculture experts. Data were analyzed using iterative thematic analysis. The Unified Theory of Acceptance and Use of Technology (UTAUT) model was used for empirical analysis. The UTAUT constructs of Performance expectancy, Effort expectancy, Government support, and Social influence were found to be determinants of adoption. Trialability and Observability impact Effort expectancy and Performance expectancy. We also discovered that the performance of agricultural cooperatives and support of lead firms play a crucial role in facilitating agricultural technology adoption by Vietnamese smallholder rice farmers. The results confirm the applicability of UTAUT in defining smallholders' behavioural intention and predicting agricultural technology adoption. The study also provides constructive feedback on the UTAUT model by highlighting the effect of agricultural cooperatives' performance as innovation intermediaries and of the support of lead firms.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"692-735"},"PeriodicalIF":3.0,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11193914/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10181098","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Public Debt in the Spanish Municipalities: Drivers and Policy Proposals.","authors":"Mihaela Simionescu, Javier Cifuentes-Faura","doi":"10.1177/0193841X231193465","DOIUrl":"10.1177/0193841X231193465","url":null,"abstract":"<p><p>The COVID-19 pandemic has exacerbated the local debt in Spanish municipalities with negative consequences on the macroeconomic financial stability at national and eurozone level. The main objective is to identify the causes of public debt per capita in four groups of Spanish municipalities according to size. It is based on a quantitative analysis based on correlational and causal-comparative approaches. It consists in the construction of panel quantile regressions (MMQ) and mean group (ME) estimators to explain public debt per capita in Spanish municipalities. Moreover, the Juodis test for causality analysis in panel data is applied. The research is constructed around various types of potential determinants related to economic factors (GDP per capita and unemployment rate), demographic factors (population under 15 and population over 65), and political factors (political party, ideology, and political strength). The results based on MMQR for the period 2011-2020 indicate common factors that reduce local debt (short-run economic growth), but also differences between clusters in what concerns factors that increase or decrease the debt. The Juodis et al. (2021) test shows that growth and unemployment are factors that influence the level of public debt in all groups of municipalities except one (5001-20,000 inhabitants) where political party affects debt. These empirical findings support policy proposals to reduce the local debt in Spanish municipalities. The main initiatives to reduce debt should be based on the promotion of economic growth and creation of new jobs, especially for young people.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"547-578"},"PeriodicalIF":3.0,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9925492","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Process Evaluation of an Acute-Care Nurse-Centred Hand Hygiene Intervention in US Hospitals.","authors":"Madeline Sands, Robert Aunger","doi":"10.1177/0193841X231197253","DOIUrl":"10.1177/0193841X231197253","url":null,"abstract":"<p><p>This paper describes a process evaluation of a 'wise' intervention that took place in six acute care units in two medical-surgical teaching hospitals in the United States during 2016-2017. 'Wise' interventions are short, inexpensive interventions that depend on triggering specific psychological mechanisms to achieve behaviour change. This study sought to increase the hand hygiene compliance (HHC) rates before entering a patient's room among nurses. The intervention centred on the use of threat to professional identity to prompt improved HHC. Through questionnaires administered to intervention participants and the implementation facilitator, together with independent observation of intervention delivery, we examined whether the steps in the Theory of Change occurred as expected. We found that aspects of the implementation-including mode of delivery, use of incentives, and how nurses were recruited and complied with the intervention-affected reach and likely effectiveness. While components of the intervention's mechanisms of impact-such as the element of surprise-were successful, they ultimately did not translate into performance of the target behaviour. Performance was also not affected by use of an implementation intention as repeated performance of HHC over years of being a nurse has likely already established well-ingrained practices. Context did have an effect; the safety culture of the units, the involvement of the Nurse Managers, the level of accountability for HHC in each unit, and the hospitals themselves all influenced levels of engagement. These conclusions should have implications for those interested in the applicability of 'wise' interventions and those seeking to improve HHC in hospitals.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"663-691"},"PeriodicalIF":3.0,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11193912/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10433979","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Randomized Controlled Trial Aversion among Public Sector Leadership: A Survey Experiment.","authors":"Emily Cardon, Leonard Lopoo","doi":"10.1177/0193841X231193483","DOIUrl":"10.1177/0193841X231193483","url":null,"abstract":"<p><p><i>Background:</i> While randomized controlled trials (RCTs) are typically considered the gold standard of program evaluation, they are infrequently chosen by public sector leaders, defined as government and nonprofit decision-makers, when an impact evaluation is required. <i>Objectives</i>: This study provides descriptive evidence on RCT aversion among public sector leaders and attempts to understand what factors affect their likelihood of choosing RCTs for impact evaluations. <i>Research Design</i>: The authors ask if public sector leaders follow similar preference patterns found among non-public sector leaders when choosing either an RCT or a quasi-experimental design and use a survey experiment to determine which factors affect the RCT choice. <i>Subjects</i>: The study sample includes 2050 public sector leaders and a comparison group of 2060 respondents who do not lead public sector organizations. <i>Measures:</i> The primary outcome measure is selecting an RCT as the preferred evaluation option. <i>Results</i>: When asked to make a decision about an impact evaluation, the majority of people do not choose an RCT. While also averse to RCTs, public sector leaders are about 13% more likely to prefer a RCT to a quasi-experimental evaluation compared to the general population. Public sector leaders are less likely to use RCTs for evaluations of more intense interventions, potentially because they are perceived to be superior to the options available for the control group. <i>Conclusion</i>: Funders should be aware that when given a choice, public sector leaders prefer other options to RCTs. Greater awareness of the benefits of RCTs could increase their use in the public sector.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"579-609"},"PeriodicalIF":3.0,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9953612","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Do Trade and Financial Cooperation Improve Environmentally Sustainable Development: A Distinction Between <i>de facto</i> and <i>de jure</i> Globalization.","authors":"Mehmet Akif Destek, İbrahim Halil Oğuz, Nuh Okumuş","doi":"10.1177/0193841X231181747","DOIUrl":"10.1177/0193841X231181747","url":null,"abstract":"<p><p>The adoption of growth strategies based on foreign trade, especially in the previous century when liberal policies began to dominate, is one of the main reasons for the increase in output and indirectly for environmental concerns. On the other hand, there are complex claims about the environmental effects of liberal policies and thus of globalization. This study intends to analyze the effects of global collaborations involving 11 transition economies that have completed the transition process on the environmentally sustainable development of these nations. In this direction, the effects of financial and commercial globalization indices on carbon emissions are investigated. The distinctions of globalization are used to distinguish the consequences of the two types of globalization. In doing so, the de facto and de jure indicator distinctions of globalization are used to differentiate the consequences of two types of globalization. In addition, the effects of real GDP, energy efficiency, and use of renewable energy on environmental pollution are dissected. For the main purpose of the study, the CS-ARDL estimation technique that allows cross-sectional dependency among observed countries is used to separate the short and long-run influences of explanatory variables. In addition, CCE-MG estimator is used for robustness check. According to the empirical findings, the economic growth and increasing energy intensity increases carbon emissions, but the increase in renewable energy consumption improves environmental quality. Furthermore, trade globalization does not have a significant impact on the environment in the context of globalization. On the other hand, the increase in de facto and de jure financial globalization indices results in an increase in carbon emissions, but de jure financial globalization causes more environmental damage. The harmful impact of de jure financial globalization on environmental quality suggests that the decreasing investment restrictions and international investment agreements of transition countries have been implemented in a manner that facilitates the relocation of investments from pollution-intensive industries to these countries.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"251-273"},"PeriodicalIF":0.9,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9957122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Promoting Pro-Environmental Behavior in Policymaking: A Text-Mining Approach for Literature Review.","authors":"Md Abul Kalam Azad, Mehedi Hasan Ifti, Chowdhury Noushin Novera, Anh Ngoc Quang Huynh, Esra Sipahi Döngül","doi":"10.1177/0193841X231176869","DOIUrl":"10.1177/0193841X231176869","url":null,"abstract":"<p><p>The impact of pro-environmental behavior on policymaking has been an exciting area of research. While the relationship between pro-environmental behavior and policymaking has been explored in numerous studies, there needs to be more synthesis on this topic. This is the first text-mining study of pro-environmental effects in which policymaking is a significant factor. In response, this study, for the first time, takes a novel approach by using text mining in R programming to analyze 30 publications from the Scopus database on pro-environmental behavior in policymaking, highlighting major research themes and prospective research areas for future investigation. Results from text mining yielded 10 topic models, which are presented with a synopsis of the published research and a list of the primary authors, as well as a posterior probability via latent Dirichlet allocation (LDA). Additionally, the study conducts a trend analysis of the top 10 journals with the highest impact factor, considering the influence of each journal's mean citation. The study offers an overview of the impacts of pro-environmental behavior in policymaking, showing the most relevant and frequently discussed themes, introduces the scientific visualization of papers published in the Scopus database, and proposes future study directions. These findings can help researchers and environmental specialists better understand how pro-environmental behavior can be fostered more effectively through policymaking.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"370-398"},"PeriodicalIF":0.9,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9543356","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluating the Stroke Risk of Patients using Machine Learning: A New Perspective from Sichuan and Chongqing.","authors":"Jin Zheng, Yao Xiong, Yimei Zheng, Haitao Zhang, Rui Wu","doi":"10.1177/0193841X231193468","DOIUrl":"10.1177/0193841X231193468","url":null,"abstract":"<p><p>Stroke is the leading cause of death and disability among people in China, and it leads to heavy burdens for patients, their families and society. An accurate prediction of the risk of stroke has important implications for early intervention and treatment. In light of recent advances in machine learning, the application of this technique in stroke prediction has achieved plentiful promising results. To detect the relationship between potential factors and the risk of stroke and examine which machine learning method significantly can enhance the prediction accuracy of stroke. We employed six machine learning methods including logistic regression, naive Bayes, decision tree, random forest, K-nearest neighbor and support vector machine, to model and predict the risk of stroke. Participants were 233 patients from Sichuan and Chongqing. Four indicators (accuracy, precision, recall and F1 metric) were examined to evaluate the predictive performance of the different models. The empirical results indicate that random forest yields the best accuracy, recall and F1 in predicting the risk of stroke, with an accuracy of .7548, precision of .7805, recall of .7619 and F1 of .7711. Additionally, the findings show that age, cerebral infarction, PM 8 (an anti-atrial fibrillation drug), and drinking are independent risk factors for stroke. Further studies should adopt a broader assortment of machine learning methods to analyze the risk of stroke, by which better accuracy can be expected. In particular, RF can successfully enhance the forecasting accuracy for stroke.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"346-369"},"PeriodicalIF":0.9,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10302426","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Using Ecometric Data to Explore Sources of Cross-Site Impact Variance in Multi-Site Trials.","authors":"David R Judkins, Gabriel Durham","doi":"10.1177/0193841X231175549","DOIUrl":"10.1177/0193841X231175549","url":null,"abstract":"<p><p>In 2003, Bloom, Hill, and Riccio (BHR) published an influential paper introducing novel methods for explaining the variation in local impacts observed in multi-site randomized control trials of socio-economic interventions in terms of site-level mediators. This paper seeks to improve upon this previous work by using student-level data to measure site-level mediators and confounders. Development of asymptotic behavior backed up with simulations and an empirical example. Students and training providers. Two simulations and an empirical application to data from an evaluation of the Health Professions Opportunity Grants (HPOG) Program. This empirical analysis involved roughly 6600 participants across 37 local sites. We examine bias and mean square error of estimates of mediation coefficients as well as the true coverage of nominal 95-percent confidence intervals on the mediation coefficients. Simulations suggest that the new methods generally improve the quality of inferences even when there is no confounding. Applying this methodology to the HPOG study shows that program-average FTE months of study by month six was a significant mediator of both career progress and long-term degree/credential receipt. Evaluators can robustify their BHR-style analyses by the use of the methods proposed here.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"274-311"},"PeriodicalIF":0.9,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9969498","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}