Evaluation Review最新文献

筛选
英文 中文
Finding Effects of Sequential Housing Price Control Policies Using Various Forms of Difference in Differences. 利用不同形式的差异寻找顺序房价调控政策的效果。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-06-01 Epub Date: 2025-12-08 DOI: 10.1177/0193841X251400391
Jihee Ann, Myoung-Jae Lee, Hyung Joon Chung
{"title":"Finding Effects of Sequential Housing Price Control Policies Using Various Forms of Difference in Differences.","authors":"Jihee Ann, Myoung-Jae Lee, Hyung Joon Chung","doi":"10.1177/0193841X251400391","DOIUrl":"10.1177/0193841X251400391","url":null,"abstract":"<p><p>Various forms of housing price and rent control policies are implemented in many countries, and finding their impacts is an important issue. Over 2019-2023, the South Korean government announced a policy to put a ceiling on housing prices in some regions of Seoul, and then subsequently implemented, strengthened, weakened, and finally abolished the policy. This is a rather complicated scenario for a policy, and the goal of this paper is to assess the effects of the policy and its changes with difference in differences (DD). We establish a detailed DD-analysis protocol, employing diverse forms of DD. Applying the protocol where a systematic difference in the untreated outcome trajectories of the treated and control groups is allowed, we assess the policy impacts. We find that, despite the active involvement of the government in the housing market, the overall effect is about a 4-5% decline in housing prices in Seoul.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"482-515"},"PeriodicalIF":3.7,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145702443","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Social Integration Among Rural-to-Urban Migrants: A Dynamic Analysis Using a Hybrid Approach Integrating Structural Equation Modeling and Machine Learning. 城乡流动人口的社会整合:基于结构方程模型和机器学习混合方法的动态分析。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-06-01 Epub Date: 2025-11-25 DOI: 10.1177/0193841X251400533
Xintao Li, Qi Qin, Tianxu Zheng, Xin Wang
{"title":"Social Integration Among Rural-to-Urban Migrants: A Dynamic Analysis Using a Hybrid Approach Integrating Structural Equation Modeling and Machine Learning.","authors":"Xintao Li, Qi Qin, Tianxu Zheng, Xin Wang","doi":"10.1177/0193841X251400533","DOIUrl":"10.1177/0193841X251400533","url":null,"abstract":"<p><p>Against the backdrop of China's new urbanization and regional coordination strategies, the social integration of rural-to-urban migrants has become an increasingly critical indicator of state governance modernization and institutional performance. Considering rural migrants in Jilin Province as the research subject, particularly in the context of its agricultural revitalization and urbanization policies, this study constructs an \"embedding-activation\" theoretical framework grounded in institutional theory and social capital theory. It proposes a mechanism in which formal institutions are embedded within informal institutions and generate effective governance outcomes through cognitive transformation facilitated by social capital. Empirically, the study applies structural equation modeling to identify the direct and indirect pathways through which policy cognition, social trust, identity, and economic integration influence social integration. Additionally, machine learning methods are employed to reveal the marginal contributions and nonlinear transition characteristics of individual variables, bridging the gap between causal explanation and predictive accuracy. The results demonstrate that social capital functions as a cognitive trigger for activating institutional efficacy and plays a key mediating role in promoting migrants' social integration. The success of institutional incentives depends on the accumulation of individual cognition and the threshold effects of trust and identity mechanisms, resulting in a behavioral shift from passive acceptance to active engagement. This dynamic promotes the expansion of scope and deepening of structure in social integration. By adopting an institution-cognition-behavior analytical lens, this study enriches the micro-foundations of institutional theory and provides support for enhancing the evaluation, responsiveness, and effectiveness of migration.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"423-461"},"PeriodicalIF":3.7,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145597895","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Transparency, Ethical Framing, and User Agency as Determinants of Trust in AI-Mediated Assessment: Informing the Design of Trustworthy Systems. 透明度、道德框架和用户代理作为人工智能中介评估中信任的决定因素:为可信赖系统的设计提供信息。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-05-09 DOI: 10.1177/0193841X261451124
Manuel B Garcia
{"title":"Transparency, Ethical Framing, and User Agency as Determinants of Trust in AI-Mediated Assessment: Informing the Design of Trustworthy Systems.","authors":"Manuel B Garcia","doi":"10.1177/0193841X261451124","DOIUrl":"https://doi.org/10.1177/0193841X261451124","url":null,"abstract":"<p><p>As artificial intelligence (AI) systems assume greater responsibility in educational assessment, questions surrounding fairness, transparency, and trust have become central to their ethical and pedagogical legitimacy. Yet, little empirical work has examined how specific design features shape students' trust in AI-driven assessment, particularly in contexts where algorithmic decisions carry meaningful academic consequences. This study examines how transparency, ethical framing, and user agency influence students' trust in an AI-based assessment platform. Using a 2 × 2 × 2 between-subjects experimental design with 240 undergraduate participants, the study isolates the main and interaction effects of these variables on trust, perceived fairness, perceived control, and adoption intention. Findings indicate that transparency is the most influential predictor of trust, while user agency functions as a compensatory mechanism in low-transparency conditions. Ethical framing, although theoretically salient, showed limited impact once users interacted with the system directly and shifted their attention toward the more concrete procedural cues embedded in the interface. A significant interaction between transparency and agency underscores the importance of aligning epistemic clarity with procedural control to foster behavioral commitment. These results support a multidimensional model of trust that incorporates emotional security, procedural justice, and behavioral intent. Overall, the study underscores that trust in AI assessment is not a byproduct of system accuracy alone but a reflection of students' perceived legitimacy of the evaluative process.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261451124"},"PeriodicalIF":3.7,"publicationDate":"2026-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147857424","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
No Evidence that Banning the Purchase of Sex Increases Rape: A Replication Study of Ciacci (2024, 2025). 没有证据表明禁止性交易增加了强奸:Ciacci的复制研究(2024,2025)。
IF 3 4区 社会学
Evaluation Review Pub Date : 2026-05-04 DOI: 10.1177/0193841X261449106
Joop Adema, Olle Folke, Johanna Rickne
{"title":"No Evidence that Banning the Purchase of Sex Increases Rape: A Replication Study of Ciacci (2024, 2025).","authors":"Joop Adema, Olle Folke, Johanna Rickne","doi":"10.1177/0193841X261449106","DOIUrl":"10.1177/0193841X261449106","url":null,"abstract":"<p><p>We re-analyze two research articles with results showing that Sweden's criminalization of purchasing sex triggered a large increase in rape. Our analysis documents discrepancies that produce unreliable results in five identification strategies in the first paper (Ciacci, 2024), and in all specifications indicating a large reform effect in the other (Ciacci, 2025). These discrepancies include estimating different statistical relationships, using different methods, or employing different variables than the paper describes. Correcting them by implementing the analysis described in the text yields no evidence that the Swedish reform increased rape.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261449106"},"PeriodicalIF":3.0,"publicationDate":"2026-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147844260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
External Validity and Generalizability in Program Evaluation: Embracing Complexity. 项目评估的外部有效性与可泛化性:拥抱复杂性。
IF 3 4区 社会学
Evaluation Review Pub Date : 2026-04-01 Epub Date: 2025-09-23 DOI: 10.1177/0193841X251380908
Anne Revillard
{"title":"External Validity and Generalizability in Program Evaluation: Embracing Complexity.","authors":"Anne Revillard","doi":"10.1177/0193841X251380908","DOIUrl":"10.1177/0193841X251380908","url":null,"abstract":"<p><p>This introduction to the second special issue of <i>Evaluation review</i> on external validity and generalizability opens a dialogue between different ways to think about generalizability in program evaluation. It argues that generalizability in impact evaluation fundamentally is about inferring some form of <i>causality</i> at a level broader than the specific circumstances of the initial study or studies from which these inferences are drawn. The question, then, is about how one apprehends causality: in other words, <i>what</i> is being generalized and <i>how</i>? The first special issue mainly relied on a <i>counterfactual</i> conception of causality, embodied by experimental and quasi-experimental methods, that aimed at impact <i>measurement</i>. The articles in this volume, drawing on mixed methods, also mobilize <i>generative</i> and <i>configurational</i> causal inferences to provide further levers of generalizability, focusing on <i>how</i> the impact is produced. The introduction insists on the specific input of qualitative methods in this respect, as theorized by grounded theory.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"183-199"},"PeriodicalIF":3.0,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145132150","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
External Validity for Complex Interventions: Towards Pragmatic Strategies for Evaluators. 复杂干预的外部效度:面向评估者的实用策略。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-04-01 Epub Date: 2025-05-15 DOI: 10.1177/0193841X251343130
Thomas Delahais
{"title":"External Validity for Complex Interventions: Towards Pragmatic Strategies for Evaluators.","authors":"Thomas Delahais","doi":"10.1177/0193841X251343130","DOIUrl":"10.1177/0193841X251343130","url":null,"abstract":"<p><p>Strategies for ensuring the generalizability of evaluation results often focus on building methodologically sound research designs. However, these strategies may fall short when the challenge lies as much in uncovering causal patterns than in applying them to uncertain contexts. This article proposes a set of pragmatic strategies to address generalizability issues in complex evaluations. These strategies address important questions such as: What needs to be generalized, for whom and for what purpose? What assumptions underlying the intervention could be generalized? How can approaches and methods be selected to support a generalization objective? How can potential users be involved to support the process of generalization? We illustrate these strategies using the example of a series of evaluations of bottom-up socio-ecological transition initiatives in France between 2013 and 2020. We suggest that these strategies can enhance policy learning and better equip policy stakeholders to navigate complex situations.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"256-278"},"PeriodicalIF":3.7,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144081408","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Increasing Internal and External Validity Through a Multimethod Evaluation With Qualitative Comparative Analysis (QCA) and Process Tracing: The Case of Training Transfer Effectiveness in Flemish SMEs. 通过定性比较分析和过程追溯的多方法评价提高内部效度和外部效度:以佛兰德中小企业培训转移效果为例。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-04-01 Epub Date: 2025-06-25 DOI: 10.1177/0193841X251352020
Priscilla Alamos-Concha, Valèrie Pattyn, Bart Cambré, Benoît Rihoux
{"title":"Increasing Internal and External Validity Through a Multimethod Evaluation With Qualitative Comparative Analysis (QCA) and Process Tracing: The Case of Training Transfer Effectiveness in Flemish SMEs.","authors":"Priscilla Alamos-Concha, Valèrie Pattyn, Bart Cambré, Benoît Rihoux","doi":"10.1177/0193841X251352020","DOIUrl":"10.1177/0193841X251352020","url":null,"abstract":"<p><p>This paper presents a methodological advancement by integrating Qualitative Comparative Analysis (QCA) and Process Tracing (PT) in the evaluation of training transfer effectiveness in Flemish SMEs. This multimethod approach leverages the strengths of both QCA and PT to enhance internal and external validity, offering a robust framework for capturing the conditions and causal mechanisms underlying policy interventions. By sequentially applying QCA to identify necessary and sufficient conditions and PT to unpack the causal processes, the study provides a comprehensive analysis that addresses both \"what works\" and \"how it works.\" Our findings demonstrate that combining these methods allows for more nuanced insights into the effectiveness of training programs, ultimately contributing to the empirical validation of policy theories and the development of evidence-based interventions. This research underscores the potential of multimethod evaluations to produce more reliable and generalizable results, thereby offering valuable guidance for evaluators and policymakers seeking to enhance the impact of their programs.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"231-255"},"PeriodicalIF":3.7,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12916868/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144498384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Informing Big Decisions: Analytical Generalizability for Large-Scale Evaluations. 告知重大决策:大规模评估的分析概括性。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-04-01 Epub Date: 2025-10-31 DOI: 10.1177/0193841X251380336
Estelle Raimondo, Diana Stanescu, Santiago Tellez Cañas
{"title":"Informing Big Decisions: Analytical Generalizability for Large-Scale Evaluations.","authors":"Estelle Raimondo, Diana Stanescu, Santiago Tellez Cañas","doi":"10.1177/0193841X251380336","DOIUrl":"10.1177/0193841X251380336","url":null,"abstract":"<p><p>This article reflects on how the Independent Evaluation Group (IEG) of the World Bank Group grapples with the issue of generalizability in conducting large-scale and complex development evaluations. It discusses a practical framework IEG uses to meet three needs: methodological, institutional, and didactic. IEG evaluations are aimed at informing significant organizational or strategic decisions encompassing broad scopes, assessing extensive portfolios of interventions by the organization across diverse contexts and spanning multiple years. These evaluations are inherently multimethod and need to bridge various logics of generalization. They seek to influence decision-makers, such as boards of directors or senior managerial teams, with the objective of guiding pivotal moments in the organization's trajectory; ensuring accountability for learning, results, or budget expenditures; and synthesizing substantial evidence to distill key success or failure factors for future strategic planning. The defensibility of the methodological scaffolding is paramount to the credibility of the evaluations. The article discusses the challenges inherent in such evaluations, including the need to generate findings that are valid at multiple levels of analysis and the reliance on multitiered mixed-methods approaches. It examines the use of a practical framework to bridge methodological principles and real-world challenges involved in evaluation to inform the design and implementation of large-scale evaluations. The framework is illustrated with examples from IEG's evaluations, and the article explores how practitioners and researchers can apply the framework in other settings to enhance the generalizability of their findings.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"279-311"},"PeriodicalIF":3.7,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145423215","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Critical Reflection of Generalization in Mixed Methods Research. 混合方法研究中泛化问题的批判性反思。
IF 3 4区 社会学
Evaluation Review Pub Date : 2026-04-01 Epub Date: 2025-04-04 DOI: 10.1177/0193841X251331723
Quan Nha Hong, Sergi Fàbregues
{"title":"A Critical Reflection of Generalization in Mixed Methods Research.","authors":"Quan Nha Hong, Sergi Fàbregues","doi":"10.1177/0193841X251331723","DOIUrl":"10.1177/0193841X251331723","url":null,"abstract":"<p><p>Mixed methods research, that is, research that integrates qualitative and quantitative methods, has become increasingly popular in program evaluation because of its potential for understanding complex interventions. Despite recent constructive and fruitful developments that have led to the consolidation of mixed methods as a distinctive methodology, fundamental methodological issues such as generalization have received little attention. The purpose of this paper is to provide a critical reflection on how the concept of generalization has been used in mixed methods research. The paper is structured into four main parts. First, we discuss the relevance of external validity and mixed methods research in impact evaluation. Second, we summarize how generalization is conceptualized in mixed methods research. Third, we present the results of a literature review on generalization practices in mixed methods research. Finally, we conclude with a discussion of threats to and strategies for enhancing generalization in mixed methods research.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"200-230"},"PeriodicalIF":3.0,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12916878/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143784589","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluation of Digital Transformation Strategies Through Dynamic Business Modeling and Scenario Analysis. 基于动态业务建模和情景分析的数字化转型战略评估。
IF 3.7 4区 社会学
Evaluation Review Pub Date : 2026-02-01 Epub Date: 2025-06-16 DOI: 10.1177/0193841X251350016
Min-Ren Yan, Haiyan Yan, Fu-Mei Han, Yongkang Zhang, Xinyue Yan
{"title":"Evaluation of Digital Transformation Strategies Through Dynamic Business Modeling and Scenario Analysis.","authors":"Min-Ren Yan, Haiyan Yan, Fu-Mei Han, Yongkang Zhang, Xinyue Yan","doi":"10.1177/0193841X251350016","DOIUrl":"10.1177/0193841X251350016","url":null,"abstract":"<p><p>With the continuous advancement of digital technology, traditional manufacturing and service industries are facing dynamic changes with diversified demand and business models. Digital transformation (DT) and dynamic business modeling have become increasingly necessary for companies to evaluate and prioritize better opportunities to improve strategic planning and productivity. This study demonstrates that the system dynamics modeling process, based on the principles of sustainable system development, can fully reflect the comprehensiveness of systems thinking and avoid the drawbacks of linear thinking failing to integrate various departments. The proposed model enables the comprehensive integration of technology, production, marketing, management, and capital, thereby identifying and testing opportunities for successful DT with minimal costs and budgetary constraints. A real-world case study demonstrates the value of simulation-based dynamic business modeling with scientific data analysis for evaluating DT strategies.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"3-29"},"PeriodicalIF":3.7,"publicationDate":"2026-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144310536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书