Evaluation Review最新文献

筛选
英文 中文
External Validity in an Instrumental Variable Setting. 工具变量设置中的外部效度。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-05-15 DOI: 10.1177/0193841X251342619
Alexander Kwon, Kyungtae Lee
{"title":"External Validity in an Instrumental Variable Setting.","authors":"Alexander Kwon, Kyungtae Lee","doi":"10.1177/0193841X251342619","DOIUrl":"10.1177/0193841X251342619","url":null,"abstract":"<p><p>We study the external validity of instrumental variable estimation. The key assumption we impose for external validity is conditional external unconfoundedness among compliers, which means that the treatment effect and target selection are independent among compliers conditional on covariates. We study this assumption with a case study about the impact of solid-fuel usage on women's average cooking time. Among the six countries examined, we find no statistical evidence that the assumptions required for external validity are violated for four countries (Ethiopia, Honduras, Kenya, and Zambia), but in Cambodia and Nepal, we find low external validity. These results provide suggestive evidence that the assumptions required for external validity are violated for these two countries.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1000-1020"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144081409","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Systematic Review of the Methods Used in Rapid Approaches to Research and Evaluation. 快速研究和评估方法的系统综述。
IF 3 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-04-26 DOI: 10.1177/0193841X251338536
Sigrún Eyrúnardóttir Clark, Norha Vera San Juan, Thomas Moniz, Rebecca Appleton, Phoebe Barnett, Cecilia Vindrola-Padros
{"title":"A Systematic Review of the Methods Used in Rapid Approaches to Research and Evaluation.","authors":"Sigrún Eyrúnardóttir Clark, Norha Vera San Juan, Thomas Moniz, Rebecca Appleton, Phoebe Barnett, Cecilia Vindrola-Padros","doi":"10.1177/0193841X251338536","DOIUrl":"10.1177/0193841X251338536","url":null,"abstract":"<p><p>Rapid approaches are essential when resources are limited and when findings are required in real-time to inform decisions. Limitations exist in their design and implementation, which can lead to a reduced level of trust in findings. This review sought to map the methods used across rapid evaluations and research to facilitate timeliness and support the rigour of studies. Four scientific databases and one search engine were searched between 11-16th August 2022. Screening led to the inclusion of 169 articles that provided a much-needed repository of methods that can be used during the design and implementation of rapid studies to improve their trustworthiness. No reporting guidelines specific to rapid research or evaluation were identified in the literature, we therefore suggest that this repository of methods informs the development of transparent reporting standards for future rapid research and evaluation.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"951-968"},"PeriodicalIF":3.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12476460/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144040982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Echoes of the Past: The Vietnam War's Economic Impact on Worship Practices. 过去的回声:越南战争对宗教活动的经济影响。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-12-01 Epub Date: 2025-06-15 DOI: 10.1177/0193841X251350219
Thong Trung Nguyen
{"title":"Echoes of the Past: The Vietnam War's Economic Impact on Worship Practices.","authors":"Thong Trung Nguyen","doi":"10.1177/0193841X251350219","DOIUrl":"10.1177/0193841X251350219","url":null,"abstract":"<p><p>By exploiting variations in Vietnamese districts affected by intense bombings, I establish a causal relationship: residents in heavily bombed areas are more willing to spend on worship practices. This relationship varies among regions, with the primary channel for this effect being the density of graveyards commemorating war martyrs.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1063-1073"},"PeriodicalIF":3.7,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144303303","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Ethical Uses of Generative AI in Assessment: Student Perceptions in UK Contexts. 生成式人工智能在评估中的伦理应用:英国背景下的学生感知。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-11-17 DOI: 10.1177/0193841X251399712
Xianghan O'Dea, Richard Bale, Yuan-Li Tiffany Chiu, Kamilya Suleymenova, Amanda Tinker, Ruth Stoker
{"title":"Ethical Uses of Generative AI in Assessment: Student Perceptions in UK Contexts.","authors":"Xianghan O'Dea, Richard Bale, Yuan-Li Tiffany Chiu, Kamilya Suleymenova, Amanda Tinker, Ruth Stoker","doi":"10.1177/0193841X251399712","DOIUrl":"https://doi.org/10.1177/0193841X251399712","url":null,"abstract":"<p><p>University students are increasingly turning to Generative Artificial Intelligence (GenAI) tools for help with their academic assessments, which has prompted major concerns relating to academic integrity. While Universities globally are building guidance on good practice in the use of GenAI, there is a lack of empirical understanding of student perceptions of what ethical and equitable use means to them. Developing insight into student understanding of GenAI is important in enabling institutions to offer more appropriate training and support to encourage good practice in assessment, not just from the perspective of avoiding malpractice, but in identifying ethical opportunities for integrating the technology as a useful tool. Using the GenAI literacy framework as the theoretical foundation, this paper analysed students' GenAI usage in academic assessments within the UK context. Data were collected from 80 participants through focus groups conducted by four UK institutions. Our findings show that students are exploring the potential of GenAI as a tool and are beginning to understand where the ethical boundaries might sit. They are keen to use the technology to support their learning but have significant concerns about locating that boundary between good practice and that which exposes them to accusations of cheating, or which limits their own learning. The paper reinforces the importance of providing GenAI literacy training to university students, so they may develop a better understanding of how GenAI can support learning processes in an ethical way.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X251399712"},"PeriodicalIF":3.7,"publicationDate":"2025-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145543275","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dubious Evidence, Valuable Information. 可疑的证据,有价值的信息。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-10-01 Epub Date: 2025-03-14 DOI: 10.1177/0193841X251324594
Eugene Bardach
{"title":"Dubious Evidence, Valuable Information.","authors":"Eugene Bardach","doi":"10.1177/0193841X251324594","DOIUrl":"10.1177/0193841X251324594","url":null,"abstract":"<p><p>I explore how \"low-quality evidence\" from program performance might still be useful in decision-making. Conceptually, a local government named \"Here\" is motivated to consider a program from \"Elsewhere\" that seems to show year-over-year exemplary performance. Here must manage five sources of uncertainty about whether and how to extrapolate from Elsewhere: chance in assessing Elsewhere's performance; illusion due to confounding variables; estimating the several powers of the program's components; substitutions in the design process made by Elsewhere and contemplated by Here; and estimating whether in the final analysis Here can meet its own breakeven criterion for going ahead. Here can begin with Elsewhere's experience, but it still must do much thinking and information-collecting on its own.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"799-813"},"PeriodicalIF":3.7,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143630936","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Systematic Review of Theoretical Foundations and Learning Effects in Gamified Flipped Classroom Research. 游戏化翻转课堂研究的理论基础与学习效果综述。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-10-01 Epub Date: 2025-02-28 DOI: 10.1177/0193841X251320438
Hatice Sancar-Tokmak, Zerrin Dagli
{"title":"A Systematic Review of Theoretical Foundations and Learning Effects in Gamified Flipped Classroom Research.","authors":"Hatice Sancar-Tokmak, Zerrin Dagli","doi":"10.1177/0193841X251320438","DOIUrl":"10.1177/0193841X251320438","url":null,"abstract":"<p><p>Gamified Flipped Classrooms (GFC) are increasingly implemented in teaching and have become a trending research subject. Gamification and Flipped Classroom (FC) literature expresses a clear need for a theoretical foundation that positively affects motivation, behavioral change, and learning. However, this requires an overview of the current theoretical foundations of GFC research. Therefore, this study conducted a systematic mixed studies review (SMSR) of the current theoretical foundations of GFC research and learning effects. Sixty-nine studies were identified after applying rigorously defined inclusion and exclusion criteria. The review revealed that a significant number of studies (25 of 69) lacked a theoretical foundation. In studies supported by theory, Self-Determination Theory (SDT) was most frequently employed. Moreover, only three studies used theories to design both gamification and FC components. While GFC research generally shows positive effects on learning, studies with a theoretical background reported a higher rate of positive GFC outcomes (56%), compared to only 29% for studies lacking a theoretical foundation. Future research should explore and attempt to link SDT and other theories to learning impacts.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"880-913"},"PeriodicalIF":3.7,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143531920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Preliminary Evaluation of a Targeted, School-Based Social and Emotional Learning Intervention for at Risk Youth: Football Beyond Borders. 有针对性的初步评估,以学校为基础的社会和情感学习干预的风险青少年:足球超越国界。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-10-01 Epub Date: 2025-03-24 DOI: 10.1177/0193841X251329459
Qiqi Cheng, Neil Humphrey
{"title":"Preliminary Evaluation of a Targeted, School-Based Social and Emotional Learning Intervention for at Risk Youth: Football Beyond Borders.","authors":"Qiqi Cheng, Neil Humphrey","doi":"10.1177/0193841X251329459","DOIUrl":"10.1177/0193841X251329459","url":null,"abstract":"<p><p>This brief report provides preliminary independent evidence of the efficacy of Football Beyond Borders (FBB), a targeted, school-based social and emotional learning (SEL) intervention for at-risk youth. FBB includes weekly SEL classroom sessions, activities on the football pitch, 1:1 therapy sessions, holiday support, and rewards trips. Propensity score matching and difference-in-differences estimation were used in a pre-test/post-test control group design to assess the impact of FBB on the mental wellbeing (assessed via the Short Warwick-Edinburgh Mental Wellbeing Scale, SWEMWBS) of participants designated at-risk (<i>N</i> = 46 aged 12-14, 78.3% male), passive learners (<i>N</i> = 72, aged 12-14, 84.7% male), and role models (<i>N</i> = 35, aged 12-14, 85.7% male), with matched control samples derived from a subset of the #BeeWell cohort study (<i>N</i> = 8015). A significant intervention effect was observed for at-risk youth, with FBB leading to an increase of approximately 2.4 SWEMWBS points (<i>d</i> = 0.44). No significant intervention effects were observed for passive learners or role models. These results indicate that FBB can improve the mental wellbeing of at-risk youth. Accordingly, an explanatory trial is warranted.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"914-930"},"PeriodicalIF":3.7,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12379023/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143694098","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optimizing an Omnichannel Retail Strategy Considering Customer Segmentation. 考虑顾客细分的全渠道零售策略优化。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-10-01 Epub Date: 2025-04-11 DOI: 10.1177/0193841X251328710
Shuangpeng Yang, Li Zhang
{"title":"Optimizing an Omnichannel Retail Strategy Considering Customer Segmentation.","authors":"Shuangpeng Yang, Li Zhang","doi":"10.1177/0193841X251328710","DOIUrl":"10.1177/0193841X251328710","url":null,"abstract":"<p><p>Unlike previous studies on fixed logistics nodes, this research explored how consumer distribution impacts store selection and inventory balance, integrating the <i>ship-from-store</i> strategy to increase fulfillment within multiperiod sales plans. Specifically, omnichannel retailers (O-tailer) must sequentially decide on inventory replenishment from suppliers to the distribution center (DC), allocation from the DC to stores, and which department will fulfill online orders. We introduce a multiperiod stochastic optimization model and solve it with a robust two-stage approach (RTA). In Stage 1, we use the K-means algorithm and silhouette coefficients to determine the optimal number of stores. In Stage 2, linear decision rule (LDR) are employed to decide on replenishment, allocation, and order fulfillment quantities. Numerical experiments show that RTA outperforms existing methods, achieving solutions with efficiency gaps of less than 10%, even when assumptions are not fully met. Additionally, the sensitivity analysis shows that variations in product prices, fulfillment costs, market share, and customer distribution consistently lead to greater profits with the <i>ship-from-store</i> strategy.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"814-850"},"PeriodicalIF":3.7,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143991817","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
What Can We Learn From Qualitative Impact Evaluations About the Effectiveness of Lobby and Advocacy? A Meta-Evaluation of Dutch aid Programmes and Assessment Tool. 从游说和倡导有效性的定性影响评估中我们可以学到什么?荷兰援助方案和评估工具的元评价。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-10-01 Epub Date: 2025-01-11 DOI: 10.1177/0193841X251314731
Hugh Sharma Waddington, Hikari Umezawa, Howard White
{"title":"What Can We Learn From Qualitative Impact Evaluations About the Effectiveness of Lobby and Advocacy? A Meta-Evaluation of Dutch aid Programmes and Assessment Tool.","authors":"Hugh Sharma Waddington, Hikari Umezawa, Howard White","doi":"10.1177/0193841X251314731","DOIUrl":"10.1177/0193841X251314731","url":null,"abstract":"<p><p>Official development agencies are increasingly supporting civil society lobby and advocacy (L&A) to address poverty and human rights. However, there are challenges in evaluating L&A. As programme objectives are often to change policies or practices in a single institution like a Government Ministry, L&A programmes are often not amenable to large-n impact evaluation methods. They often work in strategic partnerships to foster change; hence, contribution may be a more relevant evaluation question than attribution. Small-n qualitative approaches are available to measure the effectiveness of L&A which use the theory of change as their analytical framework. We conducted a meta-evaluation of 36 evaluations of multi-component international programmes to support civil society L&A across Asia, Africa and Latin America, comprising the majority of programmatic support from one international donor. We assessed the confidence in causal claims in the evaluations using a new tool that we developed. Assessments of the contribution of the programmes to the changes in outcomes were not provided in many of the evaluations, nor were predictable sources of bias addressed. Given that L&A programmes are likely to adopt an influencing approach where many different inside-track and outside-track engagement objectives, opportunities and strategies are attempted, many of which might be expected to fail, there appeared to be a clear bias in the evaluations towards reporting outcomes that were achieved, ignoring those that were not. We provide guidance on how to improve the design, conduct and reporting of small-n qualitative evaluations of aid effectiveness.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"851-879"},"PeriodicalIF":3.7,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12379041/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142966781","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Case for Preregistering Quasi-Experimental Program and Policy Evaluations. 准实验项目预登记与政策评估案例。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2025-10-01 Epub Date: 2025-03-12 DOI: 10.1177/0193841X251326738
Thomas S Dee
{"title":"The Case for Preregistering Quasi-Experimental Program and Policy Evaluations.","authors":"Thomas S Dee","doi":"10.1177/0193841X251326738","DOIUrl":"10.1177/0193841X251326738","url":null,"abstract":"<p><p>The recognition that researcher discretion coupled with unconscious biases and motivated reasoning sometimes leads to false findings (\"p-hacking\") led to the broad embrace of study preregistration and other open-science practices in experimental research. Paradoxically, the preregistration of quasi-experimental studies remains uncommon although such studies involve far more discretionary decisions and are the most prevalent approach to making causal claims in the social sciences. I discuss several forms of recent empirical evidence indicating that questionable research practices contribute to the comparative unreliability of quasi-experimental research and advocate for adopting the preregistration of such studies. The implementation of this recommendation would benefit from further consideration of key design details (e.g., how to balance data cleaning with credible preregistration) and a shift in research norms to allow for appropriately nuanced sensemaking across prespecified, confirmatory results and other exploratory findings.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"931-945"},"PeriodicalIF":3.7,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143605535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书