Evaluation Review最新文献

筛选
英文 中文
Public Policy by Syllogism? Does Logic Hold the Answer to Better Policy Outcomes? 三段论式的公共政策?逻辑能带来更好的政策结果吗?
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-05-17 DOI: 10.1177/0193841X251344054
Joseph Drew, Rene Villano, Dana McQuestin, Masato Miyazaki
{"title":"Public Policy by Syllogism? Does Logic Hold the Answer to Better Policy Outcomes?","authors":"Joseph Drew, Rene Villano, Dana McQuestin, Masato Miyazaki","doi":"10.1177/0193841X251344054","DOIUrl":"10.1177/0193841X251344054","url":null,"abstract":"<p><p>Sometimes, public policy outcomes disappoint when unintended consequences arise. In many such cases, the problems might be traced back to poor reasoning. For most of antiquity, logic was considered the core element for successful human endeavour. In this work, we argue that Aristotelian logic - specifically, the syllogism - remains highly relevant and could offer significant benefits for the development of sound public policy. To demonstrate the value of logic for contemporary public policymaking, we first provide an accessible explanation of the practical syllogism. Following this we set out our method for testing the value of syllogistic reasoning against an example of real-world public policymaking. Thereafter, we test both the validity and truth of the apparent syllogism. We conclude that the use of a practical syllogism would have prevented unintended harm from arising in the instance under consideration and also offer our thoughts around generalisability and future research directions.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1021-1039"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12476479/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144086812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating Bibliometrics Reviews: A Practical Guide for Peer Review and Critical Reading. 评价文献计量学评论:同行评议和批判性阅读的实用指南。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-04-18 DOI: 10.1177/0193841X251336839
Anh-Duc Hoang
{"title":"Evaluating Bibliometrics Reviews: A Practical Guide for Peer Review and Critical Reading.","authors":"Anh-Duc Hoang","doi":"10.1177/0193841X251336839","DOIUrl":"10.1177/0193841X251336839","url":null,"abstract":"<p><p>Along with discussing bibliometric analyses' limitations and potential biases, this paper addresses the growing need for comprehensive guidelines in evaluating bibliometric research by providing systematic frameworks for both peer reviewers and readers. While numerous publications provide guidance on implementing bibliometric methods, there is a notable lack of frameworks for assessing such research, particularly regarding performance analysis and science mapping. Drawing from an extensive review of bibliometric practices and methodological literature, this paper develops structured evaluation frameworks that address the complexity of modern bibliometric analysis, introducing the VALOR framework (Verification, Alignment, Logging, Overview, Reproducibility) for assessing multi-source bibliometric studies. The paper's key contributions include comprehensive guidelines for evaluating data selection, cleaning, and analysis processes; specific criteria for assessing conceptual, intellectual, and social structure analyses; and practical guidance for integrating performance analysis with science mapping results. By providing structured frameworks for reviewers and practical guidelines for readers to interpret and apply bibliometric insights, this work enhances the rigor of bibliometric research evaluation while supporting more effective peer review processes and research planning. The paper also discusses potential areas for further development, including the integration of qualitative analysis with bibliometric data and the advancement of field-normalized metrics, ultimately aiming to support authors, reviewers, and readers in navigating the complexities of bibliometrics and enhancing the meaningfulness of bibliometric research.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1074-1102"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12476466/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144054338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing the Impact of a University Transition Online Course on Student Continuation Using Statistical Matching Methods. 利用统计匹配方法评估大学转型在线课程对学生继续学习的影响。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-05-02 DOI: 10.1177/0193841X251339686
Billy Wong, Lydia Fletcher
{"title":"Assessing the Impact of a University Transition Online Course on Student Continuation Using Statistical Matching Methods.","authors":"Billy Wong, Lydia Fletcher","doi":"10.1177/0193841X251339686","DOIUrl":"10.1177/0193841X251339686","url":null,"abstract":"<p><p>This study demonstrates how to evaluate a university-wide online course designed to support student transition into university by using Propensity Score Matching (PSM) and Doubly Robust Estimation (DRE). Using data from seven academic years, from 2016/17 to 2022/23, with more than 28,000 students, we examine whether enrolment in this optional pre-arrival course affects first-year pass rates. We also conducted additional analyses to compare outcomes from the year before and after the course's implementation, as well as to examine these patterns across recent cohorts to potentially account for contextual changes over time. Results indicate that enrolled students show a 6.2 percentage point increase in the likelihood of passing Year 1, controlling for factors including sex, domicile, age, ethnicity, disability and socioeconomic status. We demonstrate how utilising existing institutional data can potentially strengthen evidence of impact for centralised initiatives and conclude with reflections on the use of such institutional data and matching techniques and their viability for future evaluations.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"969-999"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12476486/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144039550","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Systematic Review of the Methods Used in Rapid Approaches to Research and Evaluation. 快速研究和评估方法的系统综述。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-04-26 DOI: 10.1177/0193841X251338536
Sigrún Eyrúnardóttir Clark, Norha Vera San Juan, Thomas Moniz, Rebecca Appleton, Phoebe Barnett, Cecilia Vindrola-Padros
{"title":"A Systematic Review of the Methods Used in Rapid Approaches to Research and Evaluation.","authors":"Sigrún Eyrúnardóttir Clark, Norha Vera San Juan, Thomas Moniz, Rebecca Appleton, Phoebe Barnett, Cecilia Vindrola-Padros","doi":"10.1177/0193841X251338536","DOIUrl":"10.1177/0193841X251338536","url":null,"abstract":"<p><p>Rapid approaches are essential when resources are limited and when findings are required in real-time to inform decisions. Limitations exist in their design and implementation, which can lead to a reduced level of trust in findings. This review sought to map the methods used across rapid evaluations and research to facilitate timeliness and support the rigour of studies. Four scientific databases and one search engine were searched between 11-16th August 2022. Screening led to the inclusion of 169 articles that provided a much-needed repository of methods that can be used during the design and implementation of rapid studies to improve their trustworthiness. No reporting guidelines specific to rapid research or evaluation were identified in the literature, we therefore suggest that this repository of methods informs the development of transparent reporting standards for future rapid research and evaluation.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"951-968"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12476460/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144040982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Currency Shocks in Newly Industrialized Asian Countries and Global Financial Stability. 亚洲新兴工业化国家的货币冲击与全球金融稳定。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-05-30 DOI: 10.1177/0193841X251347681
Zhonglu Chen, Gang Zhao, Yanran Hong, Houpu Chen
{"title":"Currency Shocks in Newly Industrialized Asian Countries and Global Financial Stability.","authors":"Zhonglu Chen, Gang Zhao, Yanran Hong, Houpu Chen","doi":"10.1177/0193841X251347681","DOIUrl":"10.1177/0193841X251347681","url":null,"abstract":"<p><p>Currency shocks and the stability of the global financial system play crucial roles in international trade and investment. However, there is a lack of literature that analyses these relationships, particularly in newly industrialized Asian countries. This study fills this gap by focusing on Thailand, India, and China. Employing the exchange rate (ER) and the OFR financial stress index (FSI), we conduct a comprehensive analysis. Our results show distinct relationships among these variables. In Thailand, the ER has a long-term impact on the FSI, accompanied by positive feedback between shocks. In India, the ER is highly sensitive to the FSI, with the FSI consistently triggering negative ER shocks. In China, the ER affects the FSI only in the short run, and this impact may be negatively correlated. Additionally, increased financial stress may also increase the Chinese ER on average. These findings not only reveal the diverse economic development patterns in newly industrialized countries but also offer valuable insights for policy-makers to formulate more targeted economic policies.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1040-1062"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144188280","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
External Validity in an Instrumental Variable Setting. 工具变量设置中的外部效度。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-05-15 DOI: 10.1177/0193841X251342619
Alexander Kwon, Kyungtae Lee
{"title":"External Validity in an Instrumental Variable Setting.","authors":"Alexander Kwon, Kyungtae Lee","doi":"10.1177/0193841X251342619","DOIUrl":"10.1177/0193841X251342619","url":null,"abstract":"<p><p>We study the external validity of instrumental variable estimation. The key assumption we impose for external validity is conditional external unconfoundedness among compliers, which means that the treatment effect and target selection are independent among compliers conditional on covariates. We study this assumption with a case study about the impact of solid-fuel usage on women's average cooking time. Among the six countries examined, we find no statistical evidence that the assumptions required for external validity are violated for four countries (Ethiopia, Honduras, Kenya, and Zambia), but in Cambodia and Nepal, we find low external validity. These results provide suggestive evidence that the assumptions required for external validity are violated for these two countries.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1000-1020"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144081409","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Echoes of the Past: The Vietnam War's Economic Impact on Worship Practices. 过去的回声:越南战争对宗教活动的经济影响。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-06-15 DOI: 10.1177/0193841X251350219
Thong Trung Nguyen
{"title":"Echoes of the Past: The Vietnam War's Economic Impact on Worship Practices.","authors":"Thong Trung Nguyen","doi":"10.1177/0193841X251350219","DOIUrl":"10.1177/0193841X251350219","url":null,"abstract":"<p><p>By exploiting variations in Vietnamese districts affected by intense bombings, I establish a causal relationship: residents in heavily bombed areas are more willing to spend on worship practices. This relationship varies among regions, with the primary channel for this effect being the density of graveyards commemorating war martyrs.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1063-1073"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144303303","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dubious Evidence, Valuable Information. 可疑的证据,有价值的信息。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-10-01 Epub Date: 2025-03-14 DOI: 10.1177/0193841X251324594
Eugene Bardach
{"title":"Dubious Evidence, Valuable Information.","authors":"Eugene Bardach","doi":"10.1177/0193841X251324594","DOIUrl":"10.1177/0193841X251324594","url":null,"abstract":"<p><p>I explore how \"low-quality evidence\" from program performance might still be useful in decision-making. Conceptually, a local government named \"Here\" is motivated to consider a program from \"Elsewhere\" that seems to show year-over-year exemplary performance. Here must manage five sources of uncertainty about whether and how to extrapolate from Elsewhere: chance in assessing Elsewhere's performance; illusion due to confounding variables; estimating the several powers of the program's components; substitutions in the design process made by Elsewhere and contemplated by Here; and estimating whether in the final analysis Here can meet its own breakeven criterion for going ahead. Here can begin with Elsewhere's experience, but it still must do much thinking and information-collecting on its own.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"799-813"},"PeriodicalIF":3.7,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143630936","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Systematic Review of Theoretical Foundations and Learning Effects in Gamified Flipped Classroom Research. 游戏化翻转课堂研究的理论基础与学习效果综述。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-10-01 Epub Date: 2025-02-28 DOI: 10.1177/0193841X251320438
Hatice Sancar-Tokmak, Zerrin Dagli
{"title":"A Systematic Review of Theoretical Foundations and Learning Effects in Gamified Flipped Classroom Research.","authors":"Hatice Sancar-Tokmak, Zerrin Dagli","doi":"10.1177/0193841X251320438","DOIUrl":"10.1177/0193841X251320438","url":null,"abstract":"<p><p>Gamified Flipped Classrooms (GFC) are increasingly implemented in teaching and have become a trending research subject. Gamification and Flipped Classroom (FC) literature expresses a clear need for a theoretical foundation that positively affects motivation, behavioral change, and learning. However, this requires an overview of the current theoretical foundations of GFC research. Therefore, this study conducted a systematic mixed studies review (SMSR) of the current theoretical foundations of GFC research and learning effects. Sixty-nine studies were identified after applying rigorously defined inclusion and exclusion criteria. The review revealed that a significant number of studies (25 of 69) lacked a theoretical foundation. In studies supported by theory, Self-Determination Theory (SDT) was most frequently employed. Moreover, only three studies used theories to design both gamification and FC components. While GFC research generally shows positive effects on learning, studies with a theoretical background reported a higher rate of positive GFC outcomes (56%), compared to only 29% for studies lacking a theoretical foundation. Future research should explore and attempt to link SDT and other theories to learning impacts.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"880-913"},"PeriodicalIF":3.7,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143531920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predicting New Energy Prices: Are Technical Indicators and Regime-Switching Models Helpful? 预测新能源价格:技术指标和制度转换模型有用吗?
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-10-01 DOI: 10.1177/0193841X251380903
Zhufeng Wang, Lu Wang, Zitao Zhang
{"title":"Predicting New Energy Prices: Are Technical Indicators and Regime-Switching Models Helpful?","authors":"Zhufeng Wang, Lu Wang, Zitao Zhang","doi":"10.1177/0193841X251380903","DOIUrl":"https://doi.org/10.1177/0193841X251380903","url":null,"abstract":"<p><p>This study introduces a novel aligned technical index, derived from multiple technical indicators, that encompasses a broader spectrum of technical measurement strategies than those obtained from previous 3PRF (Three-Pass Regression Filter) research. Our empirical results demonstrate that this index exhibits significant predictive power for new energy price returns in both in-sample and out-of-sample tests. This index is extracted using the 3PRF method and yields significantly better results than those obtained with traditional methods. Considering that the market typically operates in two states, we incorporate a regime-switching model with time-varying transition probabilities into our forecasting framework. The findings indicate that the technical index influences the probability of regime transitions between states and that the inclusion of a regime-switching model further enhances predictive performance. The incorporation of the regime-switching mechanism further improves the predictive performance of the model. Moreover, from an asset allocation perspective, both the technical index and regime-switching models deliver considerable economic value to mean-variance investors.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X251380903"},"PeriodicalIF":3.7,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145201553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信