Evaluation Review最新文献

{"title":"Causal Identification in Crime Research: Lessons From Structural Causal Models.","authors":"Fırat Bilgel","doi":"10.1177/0193841X261469611","DOIUrl":"https://doi.org/10.1177/0193841X261469611","url":null,"abstract":"<p><p>This paper addresses identification challenges in social sciences using observational data through tailored examples from crime and criminal justice research. The paper highlights how structural causal models and directed acyclic graphs make the assumed causal structure explicit and help diagnose potential pitfalls such as collider bias and the use of inadmissible instruments or covariate sets. By distinguishing identification from estimation, the paper emphasizes the importance of specifying a causal model that makes identifying assumptions explicit and supports valid inference under those assumptions. The case studies demonstrate how structural causal models can sharpen identification strategies and improve the credibility of causal claims in applied crime research.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261469611"},"PeriodicalIF":3.0,"publicationDate":"2026-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148714267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A Guide to Transformations for Standardized Mean Difference Effect Sizes: Presenting Meta-Analytic Findings With Non-Researchers in Mind.","authors":"Elizabeth Day, Shaina D Trevino, Lisa K Chinn, Maria Schweer-Collins, Sean Grant, Emily E Tanner-Smith","doi":"10.1177/0193841X261475375","DOIUrl":"https://doi.org/10.1177/0193841X261475375","url":null,"abstract":"<p><p>Evidence synthesis research has great potential for informing decision-making, as it provides a holistic understanding of an entire body of literature. Meta-analyses are particularly important because they estimate intervention effects that can be used to inform both policy and practice. However, outside the field of healthcare, there has been little evidence that policymakers and practitioners use findings from meta-analyses in their work. A key barrier to the use of meta-analyses is that researchers often report advanced statistical estimates that non-research audiences struggle to comprehend. A critical first step to closing this gap is for researchers to translate meta-analytic average effect sizes in ways that may be more accessible to non-research audiences. This guide provides evidence synthesis researchers with easily accessible effect size transformations that can be performed on meta-analytic estimates of average standardized mean difference (SMD) effect sizes from random-effects models. The guide includes calculations, <i>R</i> code, statistical interpretations, and interpretations for non-research audiences for the average SMD (and its corresponding confidence interval and prediction interval), along with four transformations: Cohen's <i>U</i>_<i>3</i>, overlapping coefficient, common language effect size, and probability of study effect superiority. Importantly, we summarize literature exploring how well non-research audiences comprehend these transformations so that researchers can be informed when choosing which transformation(s) to report (if any). We also note where more research is needed to better understand how non-researchers interpret these different transformations. Overall, this guide provides practical tools for researchers to present effect sizes in ways that may enhance the accessibility of evidence synthesis findings.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261475375"},"PeriodicalIF":3.0,"publicationDate":"2026-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148708049","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A Novel Dynamic Hierarchical Evaluation Framework for Strategic Overfunding Allocation Across Crowdfunding Typologies.","authors":"Chun-Yueh Lin","doi":"10.1177/0193841X261475106","DOIUrl":"https://doi.org/10.1177/0193841X261475106","url":null,"abstract":"<p><p>The rapid growth of crowdfunding markets has created an important managerial challenge for entrepreneurs: when raised capital substantially exceeds funding targets, how should excess funds be allocated to maximize efficiency, meet stakeholder expectations, and mitigate financial risk? Past research focuses on achieving funding goals, lacking systematic guidance for preferred strategy selection amid overfunding. Furthermore, differing crowdfunding typologies (reward-based, equity-based, debt-based) involve distinct stakeholder relationships and capital obligations, while varying overfunding degrees lead to qualitatively different challenges. Nevertheless, past research has not established decision frameworks that integrate typology and the degree of overfunding, leaving entrepreneurs without contextualized strategic guidance. The present study develops a hierarchical compromise decision-support framework to evaluate excess capital allocation strategies while determining the preferred option across nine contexts (three typologies × three gradients). The study identifies critical factors affecting strategy evaluation and determines five strategic options (scaling project, enhancing quality, accelerating development, designating reserves, returning funds) across contexts. The findings reveal three insights: (1) typologies exhibit fundamental strategic divergences: reward-based crowdfunding transitions from capital preservation to quality enhancement as overfunding decreases; equity-based consistently prioritizes capital retention to meet long-term investor expectations; while debt-based adopts a conservative orientation, returning funds under high overfunding to reduce leverage risks; (2) critical factors vary with overfunding: high overfunding highlights stakeholder relationship management, moderate emphasizes operational execution, and mild focuses on foundational capabilities; (3) the interaction effect between typology and degree is significant, requiring entirely different responses across typologies. The present study contributes to crowdfunding research and practice as follows. Its primary contribution is a structured, expert-based decision-support framework that, to our knowledge, is among the first to compare preferred post-success allocations across typologies and gradients, which indicates that preferred strategies depend on contextual combinations rather than on single factors. The study identifies nonlinear overfunding effects, verifying that moderate overfunding facilitates capability building, while extreme overfunding leads to stakeholder management burdens. Practically, the study provides a foundation for platforms to design differentiated advisory services and offers contextualized frameworks for entrepreneurs and consultants, with essentials implications for strengthening resource allocation efficiency in crowdfunding ecosystems.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261475106"},"PeriodicalIF":3.0,"publicationDate":"2026-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148708008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Developing a Comprehensive Framework for Quantitative Research Methods in Economics, Business, and Management.","authors":"Thien-Vu Tran, Anh Tram Luong, Dinh-Hai Luong, Thanh-Tung Trinh, Hiep-Hung Pham","doi":"10.1177/0193841X261476152","DOIUrl":"https://doi.org/10.1177/0193841X261476152","url":null,"abstract":"<p><p>Scholarly publications in social sciences have increased sharply and continue to expand in the era of big data and artificial intelligence. However, comprehensive syntheses of quantitative research methods remain scarce, presenting significant challenges for early-career researchers and graduate students in selecting appropriate research methods for their studies. To address this gap, we propose a conceptual framework that provides a structured guide to quantitative techniques, thereby enhancing methodological literacy and supporting informed decision-making in academic publishing. By integrating applied statistics and operations research-spanning basic to advanced analytics along a static-dynamic continuum, this framework empowers novice scholars to navigate technique selection effectively and mitigates the dominance of a few methodological choices in economics, business, and management research.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261476152"},"PeriodicalIF":3.0,"publicationDate":"2026-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148702486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluations of Literacy-Based Programs: Empirical Values for Designing Studies Probing Mediation.","authors":"Amota Ataneka, Benjamin Kelcey, Yanli Xie, Fangxing Bai, Leigh McLean, Jean Baptiste Habarurema","doi":"10.1177/0193841X261426107","DOIUrl":"10.1177/0193841X261426107","url":null,"abstract":"<p><p>Multilevel mediation analyses are vital for testing and refining theories of action in program evaluations. Prior literature and established guidelines have repeatedly underscored the need to prospectively incorporate mediation considerations when designing a study even when mediation is considered a secondary or exploratory aim. Despite the critical role mediation analyses play across disciplines, the available empirical resources to facilitate effective and efficient design of such studies are limited. This study contributes to this gap by developing empirical estimates of design parameter values for literacy programs implemented within classrooms by teachers. Using data from two large studies with thousands of students and hundreds of teachers and schools, we develop empirical guidelines for studies using a three-level structure (students, teachers, and schools) for a diverse set of school contexts (e.g., urban and geographic regions) and mediators (e.g., teacher knowledge, instruction, affect, attitudes, and classroom climate). The results suggested considerable variation in the clustering of teacher mediators and student outcomes within schools and that such clustering is dependent on the variable type (e.g., instruction, knowledge, climate, and literacy achievement) and study context. The findings underscore the importance of context-, mediator-, and outcome-specific design parameter values in planning studies.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"674-718"},"PeriodicalIF":3.0,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146195913","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The Pursuit of Social Betterment Through Evaluation Practice: A Review of the Literature on Social Justice-Oriented Evaluation and a Taxonomy of Practices.","authors":"Sarah Zlatkovic","doi":"10.1177/0193841X261428513","DOIUrl":"10.1177/0193841X261428513","url":null,"abstract":"<p><p>There has been an increasing call for social justice, not just in American society but also within the evaluation profession. Scholars and practitioners like Donna Mertens, Stafford Hood, Karen Kirkhart, Veronica Thomas, and many others have led the movement within the evaluation profession to view evaluation practice as a vehicle for social justice. However, descriptions of social justice-oriented evaluation in the literature tend to lack sufficient detail, leaving many evaluators to wonder exactly what social justice-oriented evaluation is. This article presents a summary of the literature on social justice-oriented evaluation, providing a much-needed description of the approach. This paper also introduces a taxonomy of social justice-oriented evaluation (T-SJOE) practices, developed from the results of the literature review, and presents a framework of social justice-oriented evaluation practices as they are currently discussed in the evaluation literature. T-SJOE is not prescriptive or presumed complete but is presented as a tool for self-reflection and as a resource when planning evaluations. Further development of the T-SJOE is expected and encouraged.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"719-753"},"PeriodicalIF":3.0,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13180023/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147285837","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Policy as soft deterrence: Impact of recent policy changes on international students in Australia.","authors":"Ly Thi Tran, Trang Le, Jill Blackmore, Baogang He, Huy Quan Vu","doi":"10.1177/0193841X251405523","DOIUrl":"10.1177/0193841X251405523","url":null,"abstract":"<p><p>Since 2021, Australia's international education and migration policies have undergone significant changes. However, a critical gap remains in understanding how these policy shifts are experienced, interpreted, and evaluated by international students themselves. Drawing on in-depth interviews with Chinese, Indian and Vietnamese international students, this article examines how these cohorts make sense of and navigate the evolving landscape of Australia's international education policies. It unpacks their experiences of administrative delays, visa insecurity and escalating visa fees, constrained employment opportunities, and emotional uncertainty, and shows how these vary across national backgrounds. By centring student voices, the analysis moves beyond official policy rhetoric to explore how international education and migration governance is lived, evaluated, and internalised in students' everyday life. In doing so, the article contributes to a deeper understanding of how seemingly technical policy instruments function as technologies of affect, shaping not only international education and migration outcomes but also students' sense of belonging, self-worth, and future possibilities. Particularly, this article offers an original conceptual framework by introducing three new concepts to the international education literature: 'temporal bordering', 'aspirational compromise', and 'affective governance in international education' to illuminate how international education-migration policies shape international students' experiences, aspirations, emotions, and sense of belonging. It reconceptualises international education governance as relational and affective, moving beyond macro-level policy analysis to highlight the affective dimensions of students' experiences with shifting geopolitical and policy contexts.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"543-576"},"PeriodicalIF":3.0,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13180022/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145745240","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Survey Follow-Up in Randomized Trials With Dual Long- and Short-Form Instruments.","authors":"David Ross Judkins","doi":"10.1177/0193841X261416558","DOIUrl":"10.1177/0193841X261416558","url":null,"abstract":"<p><p>Many evaluations of human services programs rely heavily on survey follow-up to collect outcome data from randomized controlled trials. Evidence clearinghouses will give their highest grade of evidence quality to such evaluations if attrition is low. Declining survey response rates, particularly in the control group, are making it more difficult for evaluators to meet this clearinghouse standard. Hendra and Hill (2019) suggested that it might be better to settle for substantially lower response rates, finding that the pursuit of high target response rates adds time and money while reducing nonresponse bias little if at all. This paper reports on a new approach to boosting response rates that allows reluctant respondents to complete a shortened version of the data collection instrument. Although the method is effective at increasing the response rate and costs less than traditional approaches for boosting response rates, this paper suggests that the data collected from reluctant respondents with the new method probably did not substantially reduce nonresponse bias on impacts, a finding broadly consistent with that of Hendra and Hill. On the other hand, the method did find some important differences in the means of some outcomes within the study arms, a finding that is could be important for descriptive surveys.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"643-673"},"PeriodicalIF":3.0,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"146031272","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Empowerment + Capacity Building: How Social Organizations Can Contribute to Urban Community Elderly Care Services.","authors":"Jun Fang, Yipin Wang","doi":"10.1177/0193841X261416229","DOIUrl":"10.1177/0193841X261416229","url":null,"abstract":"<p><p>Social organizations' participation in the provision of urban community-based elderly care services serves as a critical pathway to address the challenges posed by an ageing society and to enhance service quality. To answer the livelihood-related question of 'How social organizations can contribute to urban community elderly care services?', this study surveys older adults in City N and uses satisfaction with community-based elderly care services delivered by social organizations as the performance indicator. Drawing on the conceptual framework of government external empowerment and internal capacity building within social organizations, the study develops a supply-side model of social organizations' participation in urban community-based elderly care and conducts an empirical analysis. The results show that government external empowerment, internal capacity building, and supply-demand alignment each have a significant and positive effect on satisfaction with community-based elderly care. Moreover, the integrated 'empowerment + capacity building' model-combining government external empowerment with social organizations' internal capacity building-not only infuses endogenous vitality and external support into their effective participation in providing elderly care services, but also offers a practical and feasible reference for City N to pursue the high-quality and sustainable development of urban community-based elderly care.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"610-642"},"PeriodicalIF":3.0,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145991426","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Factors Associated With Vertical and Horizontal Job-Education Mismatches: Insights From University Graduates in Vietnam.","authors":"Tuyen Quang Tran, Hoai Thu Thi Nguyen, Ngoc Bich Thi Vu, Dao Van Le","doi":"10.1177/0193841X251409287","DOIUrl":"10.1177/0193841X251409287","url":null,"abstract":"<p><p>This study is the first to examine the factors influencing the likelihood of graduates in Vietnam experiencing vertical, horizontal, and full job mismatches. This study employs secondary data from the Labor Force Survey for 2018-2022. Using a multinomial logit model, we identify the key determinants of job mismatch, such as field of study, gender, job sector, and geographic location. Graduates in Education and Pedagogy exhibit a lower likelihood of mismatches than those in almost all other fields. We also observe gender differences, where men were more likely than women to experience all types of mismatches. Additionally, graduates employed in the private and foreign direct investment sectors face higher risks of vertical and full mismatches, whereas urban residents are less likely to experience mismatches than their rural counterparts. Finally, the findings from the doubly robust estimates reveal that a wage penalty is associated with vertical and full mismatches, particularly for women, whereas a horizontal mismatch has a minimal impact on wages.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"577-609"},"PeriodicalIF":3.7,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145795289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}