发布求助
文献互助 智能选刊 最新文献

Evaluation Review最新文献

筛选
英文 中文
Taking Stock of Qualitative Methods of Evaluation: A Study of Practices and Quality Criteria. 评估的定性方法：实践和质量标准的研究。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-02-01 Epub Date: 2025-08-28 DOI: 10.1177/0193841X251370426
Thilo Bodenstein, Achim Kemmerling
{"title":"Taking Stock of Qualitative Methods of Evaluation: A Study of Practices and Quality Criteria.","authors":"Thilo Bodenstein, Achim Kemmerling","doi":"10.1177/0193841X251370426","DOIUrl":"10.1177/0193841X251370426","url":null,"abstract":"<p><p>Research on evaluation has mapped the landscape of quantitative evaluation methods. There are far fewer overviews for qualitative methods of evaluation. We present a review of scholarly articles from five widely read evaluation research journals, examining the types of methods used and the transparency of their quality criteria. We briefly look at a large sample of 1070 articles and then randomly select 50 for in-depth study. We document a remarkable variety of qualitative methods, but some stand out: Case studies and stakeholder analysis, often combined with interview techniques. Articles rarely define and conceptualize their methods explicitly. This is understandable from a practical point of view, but it can make it difficult to critically interrogate findings and build systematic knowledge. Finally, we find that the transparency of qualitative criteria required in the literature is not always sufficient, which can hinder the synthesis of results.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"89-115"},"PeriodicalIF":3.7,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12715029/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144974155","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Powering Innovation: How High-Performance Computing Platform Revolutionizes University Research. 推动创新：高性能计算平台如何彻底改变大学研究。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-02-01 Epub Date: 2025-08-20 DOI: 10.1177/0193841X251369313
Dan Wang, Anh Ngoc Quang Huynh, Handong Tang
{"title":"Powering Innovation: How High-Performance Computing Platform Revolutionizes University Research.","authors":"Dan Wang, Anh Ngoc Quang Huynh, Handong Tang","doi":"10.1177/0193841X251369313","DOIUrl":"10.1177/0193841X251369313","url":null,"abstract":"<p><p>High-performance computing platforms (HPCP) serve as a critical component of institutional research infrastructure at universities, enhancing innovation efficiency. However, there is an absence of empirical research quantifying their impacts. Acknowledging this void, a difference-in-differences (DID) approach is employed in this study to systematically evaluate the influence of HPCP on university innovation efficiency. The findings reveal that: (1) universities with access to HPCP experience a significant improvement in innovation efficiency, with heterogeneities observed across regions, institutional rankings and university types; (2) HPCP drives innovation efficiency by attracting and cultivating top-tier researchers, expanding the scope of research activities and enabling the production of high-quality research outputs; and (3) the relationship between HPCP and innovation efficiency exhibits non-linearity, influenced by the quality and volume of research outputs as well as the presence of elite researchers. The contributions of this study are threefold viz: (1) providing empirical evidence quantifying HPCP's role in university innovation efficiency; (2) elucidating the mechanisms through which HPCP enhances innovation; and (3) identifying the non-linear relationship between HPCP and innovation efficiency, offering nuanced insights for policymakers to engender targeted strategies.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"55-88"},"PeriodicalIF":3.7,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144884105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effects of Caseworker Screening on Employment and Health: Quasi-Experimental Evidence From the Swedish Sickness Insurance Program. 社会工作者筛选对就业和健康的影响：来自瑞典疾病保险计划的准实验证据。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-02-01 Epub Date: 2025-07-09 DOI: 10.1177/0193841X251358288
Pathric Hägglund, Per Johansson, Kristian Persson
{"title":"Effects of Caseworker Screening on Employment and Health: Quasi-Experimental Evidence From the Swedish Sickness Insurance Program.","authors":"Pathric Hägglund, Per Johansson, Kristian Persson","doi":"10.1177/0193841X251358288","DOIUrl":"10.1177/0193841X251358288","url":null,"abstract":"<p><p>This paper analyzes the effects of caseworker screening of doctors' medical sick-leave certificates. The analysis uses data from people appealing caseworkers' denial of their benefit claims. Caseworkers at four units made decisions on the appeals. The distribution of the cases to the four units was based on the appealing person's birth date. One of the units was much stricter than the others (7.8% approved in contrast to 16.1% for the others). This allows us to use birth date as an instrument to estimate the effects of being denied sickness benefits. We find that the denial of sickness benefits, on average, has (i) positive effects on the labor-market outcomes and (ii) no negative effects on health outcomes. As the more liberal units deny sickness benefits for most screened medical certificates, we conclude that caseworker screening is very important in separating meritorious from non-meritorious claims. Doctors' conflicting roles make it difficult for them to act in the best of interest of both their patients and society.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"30-54"},"PeriodicalIF":3.7,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12715019/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144592665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Computing Statistical Power for the Difference in Differences Design. 计算差异设计中差异的统计能力。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-02-01 Epub Date: 2025-09-22 DOI: 10.1177/0193841X251380898
E C Hedberg, Larry V Hedges
{"title":"Computing Statistical Power for the Difference in Differences Design.","authors":"E C Hedberg, Larry V Hedges","doi":"10.1177/0193841X251380898","DOIUrl":"10.1177/0193841X251380898","url":null,"abstract":"<p><p>The difference in differences design is widely used to assess treatment effects in natural experiments or other situations where random assignment cannot, or is not, used (see, e.g., Angrist & Pischke, 2009). The researcher must make important decisions about which comparisons to make, the measurements to make, and perhaps the number of individuals whose data is included in each timepoint. Also, interpretation of any statistical results, particularly null results, is improved by understanding the sensitivity of the design. This paper describes methods for computing the statistical power for tests of treatment effects in the difference in differences design. We describe alternative approaches to the analysis of the design, show which are equivalent, and provide expressions for computing statistical power and determining minimum detectable effect sizes. We then discuss how these methods could be generalized to unbalanced designs, designs with covariates, and designs more than two timepoints including difference in difference in differences designs.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"149-180"},"PeriodicalIF":3.7,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145126111","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Strategic Insights From Voluntary and Mandatory ESG Evaluations in a Competitive Market. 竞争市场中自愿和强制性ESG评估的战略见解。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-02-01 Epub Date: 2025-09-03 DOI: 10.1177/0193841X251375503
Xiang Gao, Xiaolan Qiu, Beibei Shang
{"title":"Strategic Insights From Voluntary and Mandatory ESG Evaluations in a Competitive Market.","authors":"Xiang Gao, Xiaolan Qiu, Beibei Shang","doi":"10.1177/0193841X251375503","DOIUrl":"10.1177/0193841X251375503","url":null,"abstract":"<p><p>Environmental, social, and governance (ESG) considerations are garnering increasing interest from various stakeholders. Nevertheless, the impact of ESG evaluation policies-whether voluntary or mandatory-are complex, particularly in competitive markets. Consequently, this study develops a game-theoretic model to investigate the propensity of competing manufacturers to invest in ESG initiatives. This study demonstrates that ESG evaluations reduce information asymmetry regarding ESG levels in competitive dynamics. However, this phenomenon may lower manufacturers' incentives to invest in ESG. Interestingly, this study finds that although mandatory ESG evaluations boost the overall profitability of competing manufacturers, they do not invariably lead to enhanced ESG outcomes.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"116-148"},"PeriodicalIF":3.7,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144993896","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From Tool to Co-Learner: Exploring Student Engagement With GenAI Through the Lens of Social Constructivism. 从工具到共同学习者：通过社会建构主义的视角探索学生对GenAI的参与。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-30 DOI: 10.1177/0193841X251411618
Lei Fang, Xue Zhou
{"title":"From Tool to Co-Learner: Exploring Student Engagement With GenAI Through the Lens of Social Constructivism.","authors":"Lei Fang, Xue Zhou","doi":"10.1177/0193841X251411618","DOIUrl":"https://doi.org/10.1177/0193841X251411618","url":null,"abstract":"<p><p>This study investigates how students engage with GenAI during a business data analysis assessment, drawing on Social Constructivist Theory and the human-AI co-agency model. Within the assessment, students used GenAI tools to support their data analysis and reflected on their experiences by comparing AI-generated and manually derived results. Thematic analysis of 258 students' reflection, triangulated with academic performance data, revealed four key themes: epistemic beliefs, functional cognitive engagement, reflective metacognitive learning, and Human-GenAI co-agency for strategic foresight. Students demonstrated distinct patterns of engagement across performance groups. Higher-performing students approached GenAI as a collaborative partner, engaging in iterative prompt refinement, demonstrating critical evaluation of outputs, and exhibiting strong ethical awareness. In contrast, lower-performing students often showed polarised epistemic beliefs, limited critical reflection, and minimal iteration - accepting or rejecting GenAI outputs prematurely. These findings highlight the role of scaffolded reflection and prompt engineering in enabling students to develop deeper analytical and evaluative capacities. By reconceptualising GenAI as an active co-learner rather than a passive tool, this study extends Social Constructivism perspectives to accommodate emerging forms of human-GenAI interaction. Drawing on rich, in-situ qualitative evidence embedded within an authentic learning context, it offers new insight into how students' beliefs and strategies shape their engagement with GenAI. The study also emphasises the need for differentiated pedagogical designs that cultivate AI literacy, narrow digital divide, and support ethical, adaptive use of GenAI in higher education.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X251411618"},"PeriodicalIF":3.7,"publicationDate":"2025-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145858244","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Public Policy by Syllogism? Does Logic Hold the Answer to Better Policy Outcomes? 三段论式的公共政策？逻辑能带来更好的政策结果吗？
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-05-17 DOI: 10.1177/0193841X251344054
Joseph Drew, Rene Villano, Dana McQuestin, Masato Miyazaki
{"title":"Public Policy by Syllogism? Does Logic Hold the Answer to Better Policy Outcomes?","authors":"Joseph Drew, Rene Villano, Dana McQuestin, Masato Miyazaki","doi":"10.1177/0193841X251344054","DOIUrl":"10.1177/0193841X251344054","url":null,"abstract":"<p><p>Sometimes, public policy outcomes disappoint when unintended consequences arise. In many such cases, the problems might be traced back to poor reasoning. For most of antiquity, logic was considered the core element for successful human endeavour. In this work, we argue that Aristotelian logic - specifically, the syllogism - remains highly relevant and could offer significant benefits for the development of sound public policy. To demonstrate the value of logic for contemporary public policymaking, we first provide an accessible explanation of the practical syllogism. Following this we set out our method for testing the value of syllogistic reasoning against an example of real-world public policymaking. Thereafter, we test both the validity and truth of the apparent syllogism. We conclude that the use of a practical syllogism would have prevented unintended harm from arising in the instance under consideration and also offer our thoughts around generalisability and future research directions.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1021-1039"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12476479/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144086812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating Bibliometrics Reviews: A Practical Guide for Peer Review and Critical Reading. 评价文献计量学评论：同行评议和批判性阅读的实用指南。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-04-18 DOI: 10.1177/0193841X251336839
Anh-Duc Hoang
{"title":"Evaluating Bibliometrics Reviews: A Practical Guide for Peer Review and Critical Reading.","authors":"Anh-Duc Hoang","doi":"10.1177/0193841X251336839","DOIUrl":"10.1177/0193841X251336839","url":null,"abstract":"<p><p>Along with discussing bibliometric analyses' limitations and potential biases, this paper addresses the growing need for comprehensive guidelines in evaluating bibliometric research by providing systematic frameworks for both peer reviewers and readers. While numerous publications provide guidance on implementing bibliometric methods, there is a notable lack of frameworks for assessing such research, particularly regarding performance analysis and science mapping. Drawing from an extensive review of bibliometric practices and methodological literature, this paper develops structured evaluation frameworks that address the complexity of modern bibliometric analysis, introducing the VALOR framework (Verification, Alignment, Logging, Overview, Reproducibility) for assessing multi-source bibliometric studies. The paper's key contributions include comprehensive guidelines for evaluating data selection, cleaning, and analysis processes; specific criteria for assessing conceptual, intellectual, and social structure analyses; and practical guidance for integrating performance analysis with science mapping results. By providing structured frameworks for reviewers and practical guidelines for readers to interpret and apply bibliometric insights, this work enhances the rigor of bibliometric research evaluation while supporting more effective peer review processes and research planning. The paper also discusses potential areas for further development, including the integration of qualitative analysis with bibliometric data and the advancement of field-normalized metrics, ultimately aiming to support authors, reviewers, and readers in navigating the complexities of bibliometrics and enhancing the meaningfulness of bibliometric research.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1074-1102"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12476466/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144054338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing the Impact of a University Transition Online Course on Student Continuation Using Statistical Matching Methods. 利用统计匹配方法评估大学转型在线课程对学生继续学习的影响。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-05-02 DOI: 10.1177/0193841X251339686
Billy Wong, Lydia Fletcher
{"title":"Assessing the Impact of a University Transition Online Course on Student Continuation Using Statistical Matching Methods.","authors":"Billy Wong, Lydia Fletcher","doi":"10.1177/0193841X251339686","DOIUrl":"10.1177/0193841X251339686","url":null,"abstract":"<p><p>This study demonstrates how to evaluate a university-wide online course designed to support student transition into university by using Propensity Score Matching (PSM) and Doubly Robust Estimation (DRE). Using data from seven academic years, from 2016/17 to 2022/23, with more than 28,000 students, we examine whether enrolment in this optional pre-arrival course affects first-year pass rates. We also conducted additional analyses to compare outcomes from the year before and after the course's implementation, as well as to examine these patterns across recent cohorts to potentially account for contextual changes over time. Results indicate that enrolled students show a 6.2 percentage point increase in the likelihood of passing Year 1, controlling for factors including sex, domicile, age, ethnicity, disability and socioeconomic status. We demonstrate how utilising existing institutional data can potentially strengthen evidence of impact for centralised initiatives and conclude with reflections on the use of such institutional data and matching techniques and their viability for future evaluations.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"969-999"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12476486/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144039550","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Currency Shocks in Newly Industrialized Asian Countries and Global Financial Stability. 亚洲新兴工业化国家的货币冲击与全球金融稳定。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-05-30 DOI: 10.1177/0193841X251347681
Zhonglu Chen, Gang Zhao, Yanran Hong, Houpu Chen
{"title":"Currency Shocks in Newly Industrialized Asian Countries and Global Financial Stability.","authors":"Zhonglu Chen, Gang Zhao, Yanran Hong, Houpu Chen","doi":"10.1177/0193841X251347681","DOIUrl":"10.1177/0193841X251347681","url":null,"abstract":"<p><p>Currency shocks and the stability of the global financial system play crucial roles in international trade and investment. However, there is a lack of literature that analyses these relationships, particularly in newly industrialized Asian countries. This study fills this gap by focusing on Thailand, India, and China. Employing the exchange rate (ER) and the OFR financial stress index (FSI), we conduct a comprehensive analysis. Our results show distinct relationships among these variables. In Thailand, the ER has a long-term impact on the FSI, accompanied by positive feedback between shocks. In India, the ER is highly sensitive to the FSI, with the FSI consistently triggering negative ER shocks. In China, the ER affects the FSI only in the short run, and this impact may be negatively correlated. Additionally, increased financial stress may also increase the Chinese ER on average. These findings not only reveal the diverse economic development patterns in newly industrialized countries but also offer valuable insights for policy-makers to formulate more targeted economic policies.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1040-1062"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144188280","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
首页 上一页 下一页 尾页
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整，为了账户安全，请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们：info@booksci.cn Book学术提供免费学术资源搜索服务，方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号：604180095
Book学术官方微信
小红书