Evaluation Review最新文献_第2页

Attrition in Randomized Control Trials: Evidence From Early Education Interventions in Sub-Saharan Africa. 随机对照试验中的损耗：来自撒哈拉以南非洲早期教育干预的证据。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-10-01 Epub Date: 2026-04-09 DOI: 10.1177/0193841X261438946

Alejandro Ome, Cally Ardington, Alicia Menendez

引用次数: 0

Union Wage Gap in Vietnam: A Distributional Analysis. 越南工会工资差距：一个分布分析。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-10-01 Epub Date: 2026-03-31 DOI: 10.1177/0193841X261437558

Dung Kieu Nguyen, Mai Thi Xuan Nguyen, Thi Bich Tran, Anh Thi Mai Pham

{"title":"Union Wage Gap in Vietnam: A Distributional Analysis.","authors":"Dung Kieu Nguyen, Mai Thi Xuan Nguyen, Thi Bich Tran, Anh Thi Mai Pham","doi":"10.1177/0193841X261437558","DOIUrl":"10.1177/0193841X261437558","url":null,"abstract":"Labor relations in Vietnam are undergoing a dramatic transition, moving from a system dominated by a single state-led trade union federation toward one that permits the formation of more independent unions. Understanding the impact of trade unions on labor market outcomes is therefore increasingly urgent to support this transition. However, empirical evidence remains scarce due to data limitations. This study provides the first evidence on the effects of trade unions on workers' wages across the wage distribution in the private sector, using a large, nationally representative dataset. Employing the Unconditional Quantile Regression approach, we estimate union effects across the wage distribution and find consistently negative coefficients at all quantiles for men. To further examine the distributional structure of the wage gap, we implement an Oaxaca-Blinder-type decomposition based on the Recentered Influence Function. The decomposition results reveal that, for both men and women, the wage gap becomes increasingly negative from the middle toward the upper end of the wage distribution. While the total explained component displays some instability at the lower quantiles, its absolute magnitude rises substantially at higher quantiles. This research contributes to a deeper understanding of union roles in contexts where political institutions play a dominant role in shaping union activities.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"837-875"},"PeriodicalIF":3.0,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147582526","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Job Mismatch, Overeducation and Overqualification in Canada: A Comparative Study of Immigrant and Native-Born Graduates From Canadian Postsecondary Institutions. 加拿大的工作不匹配、教育过剩和资格过剩：移民和本地出生的加拿大高等院校毕业生的比较研究。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-09-24 DOI: 10.1177/0193841X261490779

Trisha Einmann

{"title":"Job Mismatch, Overeducation and Overqualification in Canada: A Comparative Study of Immigrant and Native-Born Graduates From Canadian Postsecondary Institutions.","authors":"Trisha Einmann","doi":"10.1177/0193841X261490779","DOIUrl":"https://doi.org/10.1177/0193841X261490779","url":null,"abstract":"This study examines job mismatch among immigrant and Canadian-born graduates of Canadian postsecondary institutions. Job mismatch is an important dimension of labour market integration, but widely used measures, such as overeducation based on the formal educational requirements of a job, may not capture the nuance of graduates' employment outcomes. Overeducation and overqualification capture different aspects of mismatch, reflecting the alignment of formal educational requirements and broader assessments of skills, education, and experience. Examining both measures is therefore important for understanding how immigrants and Canadian-born graduates experience the transition from postsecondary education to employment. The analyses utilized data from the 2018 National Graduates Survey to examine 18,794 graduates who completed postsecondary education in Canada in 2015 and entered the labour market by 2018. Bivariate probit models jointly estimated overeducation and overqualification, adjusting for immigration status, sociodemographic characteristics, and educational factors. Mediation analyses assessed whether educational characteristics explained differences between immigrant and Canadian-born graduates. Overall, respondent groups differed in the probability of experiencing distinct combinations of mismatch. For example, joint probability estimates demonstrated recent immigrants were more likely than Canadian-born graduates to report both forms of mismatch simultaneously, whereas established immigrants were more likely to report overeducation in the absence of overqualification. Overeducation and overqualification capture distinct dimensions of job mismatch and offer valuable insights into immigrant labour market integration. Jointly examining both measures highlights the importance of incorporating multiple measures of job mismatch when examining labour market integration and demonstrates the limitations of relying on overeducation alone.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261490779"},"PeriodicalIF":3.0,"publicationDate":"2026-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149041079","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Data-Driven Assessment of Regional Sustainable Development in China: A Hybrid Comparative Method. 中国区域可持续发展数据驱动评估：一种混合比较方法。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-09-23 DOI: 10.1177/0193841X261490169

Ao Zhang, Minghui Lv, Jun Shi, Kanchana Sethanan, Ming-Lang Tseng, Kuo-Jui Wu

{"title":"Data-Driven Assessment of Regional Sustainable Development in China: A Hybrid Comparative Method.","authors":"Ao Zhang, Minghui Lv, Jun Shi, Kanchana Sethanan, Ming-Lang Tseng, Kuo-Jui Wu","doi":"10.1177/0193841X261490169","DOIUrl":"https://doi.org/10.1177/0193841X261490169","url":null,"abstract":"As the 2030 Sustainable Development Agenda nears, research efforts have focused on evaluating sustainable development from a macro perspective. However, this macroscale assessment might be influenced by regional variations. Additionally, previous studies have tended to overemphasize quantitative evaluations. To address these shortcomings, this study applies regional sustainable development theory to structure an assessment framework by proposing a hybrid method that combines qualitative and quantitative assessments. The proposed hybrid method includes K-nearest neighbors, hierarchical clustering, a reliability test, and a decision-making trial and evaluation laboratory. It makes three significant contributions: (1) The complex causal interrelationships that are revealed strengthen the theoretical foundation and enhance the understanding of regional sustainable development; (2) the proposed hybrid method considers quantitative and qualitative factors simultaneously, resulting in a comprehensive evaluation; and (3) the simple visual assessment offers clear guidance for resource allocation adjustments. The assessment results reveal that the government prioritizes eco-coordination over the opinions of experts on cultural-environmental livability. On this basis, compared with the 292.64% variation in infrastructure support across regions, eco-innovation exhibits the least variation of 50.00%. The results also suggest that the provinces in Central China have a higher level of consensus in terms of pursuing regional sustainable development.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261490169"},"PeriodicalIF":3.0,"publicationDate":"2026-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149026571","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Performance Analysis of Dynamic Entity Representation and Dual-Perspective Query Mechanisms for Document-Level Relation Extraction. 文档级关系抽取中动态实体表示和双视角查询机制的性能分析。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-09-18 DOI: 10.1177/0193841X261491411

Yi Zhang, Xiuqi Ruan, Xinbin Cheng, Zhaotian Dong, Jinle Chen

{"title":"Performance Analysis of Dynamic Entity Representation and Dual-Perspective Query Mechanisms for Document-Level Relation Extraction.","authors":"Yi Zhang, Xiuqi Ruan, Xinbin Cheng, Zhaotian Dong, Jinle Chen","doi":"10.1177/0193841X261491411","DOIUrl":"https://doi.org/10.1177/0193841X261491411","url":null,"abstract":"Document-level relation extraction must identify relations when entity mentions and supporting evidence are distributed across multiple sentences. Existing methods often use entity representations that remain fixed after encoding and provide limited support for progressively retrieving and combining dispersed evidence. This study improves complex cross-sentence relation reasoning by allowing entity representations to evolve during inference and by retrieving evidence from both entities in a target pair. The proposed multilayer iterative framework combines the Dynamic Entity Representation Mechanism (DERM) and Dual-Perspective Query Mechanism (DPQM). DERM propagates and updates entity states across reasoning layers using document context. DPQM retrieves evidence separately from head- and tail-entity perspectives and adaptively fuses the resulting representations. The framework was evaluated on Re-DocRED using BERT-base with Adaptive Thresholding and Localized cOntext Pooling (ATLOP) and DocuNet as backbones. Evaluations included overall F1, Ign F1, inter-sentence F1, evidence-based recall, ablation studies, and computational cost analysis. With ATLOP, the proposed method achieved 76.42% F1 and 75.22% Ign F1, exceeding the baseline by 2.72 and 2.46 percentage points, respectively. Inter-sentence F1 increased by 3.74 percentage points. For relations supported by three or more evidence sentences, recall improved from 54.65% to 66.40%. In ablation results, DERM and DPQM provided complementary improvements, with DERM making the larger contribution in complex cases. Explicit entity-state propagation and evidence retrieval from both entity perspectives improved dispersed evidence integration in long documents. The largest gains occurred in cross-sentence relations and instances requiring multiple supporting evidence sentences; however, stronger evidence constraints and calibration are required to reduce unsupported predictions.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261491411"},"PeriodicalIF":3.0,"publicationDate":"2026-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149002651","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Evaluating the Link Between Distributed Leadership, School Innovative Climate, and Teacher Job Satisfaction: A Doubly Latent Multilevel Structural Equation Modeling Approach. 评估分布式领导、学校创新氛围和教师工作满意度之间的联系：一个双重潜在的多层次结构方程建模方法。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-09-08 DOI: 10.1177/0193841X261486510

Hoi Vo, Tran Le Huu Nghia, Karen Skilling, Huu-Lam Luong

{"title":"Evaluating the Link Between Distributed Leadership, School Innovative Climate, and Teacher Job Satisfaction: A Doubly Latent Multilevel Structural Equation Modeling Approach.","authors":"Hoi Vo, Tran Le Huu Nghia, Karen Skilling, Huu-Lam Luong","doi":"10.1177/0193841X261486510","DOIUrl":"10.1177/0193841X261486510","url":null,"abstract":"This study aims to examine the association between distributed leadership and teacher job satisfaction and the extent to which this relationship is mediated by school innovative climate. A large-scale international sample of 153,682 lower secondary teachers (ISCED level 2) from the TALIS 2018 data was analyzed, using doubly latent multilevel structural equation modeling. Results indicated that teachers' perceived school innovative climate partially mediated the association between perceived distributed leadership and teacher satisfaction with school and fully mediated the association between distributed leadership and teacher satisfaction with profession. The results highlight the important role of school leaders in creating a mutually responsible and shared decision-making school culture in which teachers feel safe and empowered to embrace innovations and changes, which is in turn associated with higher job satisfaction. The findings also underscore the need to examine teacher job satisfaction as a multidimensional construct as different aspects of teacher job satisfaction are differentially related to school leadership practices and school innovative climate.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261486510"},"PeriodicalIF":3.0,"publicationDate":"2026-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148913739","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Poor Transparency of Legal Methods in Empirical Studies of the Effects of Law: A Case Study of Health Policy Research. 法律效果实证研究中法律方法缺乏透明度：以卫生政策研究为例。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-08-24 DOI: 10.1177/0193841X261479457

Scott Burris, Carolina Villamil Grest, Adam Herpolsheimer

{"title":"Poor Transparency of Legal Methods in Empirical Studies of the Effects of Law: A Case Study of Health Policy Research.","authors":"Scott Burris, Carolina Villamil Grest, Adam Herpolsheimer","doi":"10.1177/0193841X261479457","DOIUrl":"10.1177/0193841X261479457","url":null,"abstract":"Law is a primary mechanism to promote socially desirable behaviors and standards, and so an important subject of evaluation research. Research credibility depends on meeting scientific standards of transparency and replicability. Prior research suggests that information on methods used to construct legal variables in policy research is often not reported. We assessed the transparency of legal research methods in 100 highly cited health policy impact studies published between 2009 and 2019. Papers and any cited sources of legal data were examined independently by two researchers to capture information provided about legal research, coding, and quality control. Coding was reviewed and discrepancies resolved by an author. Papers were rated as Transparent, Partly Transparent, or Not Transparent. Fifty-eight of one hundred papers in our study sample were Not Transparent. Sixteen papers were Partly Transparent, providing methods information on legal research or coding but not both. Eleven studies provided no information about the source of either their legal research or coding, and six provided no information about both. Most papers obtained legal information from secondary sources, including 40% of studies that relied on websites that were not primary sources of law, not designed to produce scientific data, and not transparent as to how their legal research and analysis were performed. Readily adopted improvements in legal research transparency can facilitate replication, support further methodological progress, uphold basic norms of science, and maintain public confidence in policy research.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261479457"},"PeriodicalIF":3.0,"publicationDate":"2026-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148814605","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Hollow by Design: Why Evaluation Systems Decouple in the MENA Region. 设计的空洞：为什么在中东和北非地区评估系统解耦。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-08-21 DOI: 10.1177/0193841X261479461

Anis Ben Brik

{"title":"Hollow by Design: Why Evaluation Systems Decouple in the MENA Region.","authors":"Anis Ben Brik","doi":"10.1177/0193841X261479461","DOIUrl":"https://doi.org/10.1177/0193841X261479461","url":null,"abstract":"Institutional theory predicts that formal governance structures often develop without corresponding operational substance, a phenomenon variously described as decoupling or isomorphic mimicry. The evaluation governance literature has acknowledged this possibility but has not subjected it to rigorous set-theoretic analysis. The present study applies fuzzy-set Qualitative Comparative Analysis to data from 15 countries in the Middle East and North Africa to examine which institutional conditions are necessary and which are sufficient for substantive evaluation practice. Four conditions drawn from an established three-system framework of evaluation institutionalisation are tested: political institutionalisation, political use, social system development, and professionalisation. Political institutionalisation meets the necessity threshold for substantive practice but falls well short of sufficiency, confirming the structural decoupling. Professionalisation exhibits near-zero correlation with substantive practice, a result that challenges prevailing assumptions in evaluation capacity development about the catalytic role of professional infrastructure. The article introduces the concept of professional hollowness to characterise settings in which the formal apparatus of a profession develops without generating corresponding practice. No single condition and no two-condition conjunction reaches the sufficiency threshold for substantive practice, a finding consistent with the configurational premise that genuine evaluation institutionalisation is irreducible to any single dimension. Findings are robust to a purified-conditions robustness specification reported in the supplementary materials. Implications for institutional theory, evaluation policy, and the design of evaluation capacity development interventions are discussed.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261479461"},"PeriodicalIF":3.0,"publicationDate":"2026-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148799643","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Supply Chain Contract Coordination in Retailer Equity Buybacks. 零售商股权回购中的供应链契约协调。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-08-14 DOI: 10.1177/0193841X261477562

Xin Li, Shimiao Xu, Jie Deng, Wang Chen

{"title":"Supply Chain Contract Coordination in Retailer Equity Buybacks.","authors":"Xin Li, Shimiao Xu, Jie Deng, Wang Chen","doi":"10.1177/0193841X261477562","DOIUrl":"https://doi.org/10.1177/0193841X261477562","url":null,"abstract":"This study examines how retailer share repurchases interact with supply chain contract design in expanding markets, focusing on retailers' market development efforts, suppliers' pricing strategies, and the choice between wholesale price and revenue-sharing contracts. We construct a supply chain contract model incorporating a retailer's share repurchases, incentive-compatible mechanisms, market expansion, and control premium costs. We compare wholesale price and revenue-sharing contracts to evaluate their effects on risk-reward allocation and upstream-downstream coordination. Share repurchases can reduce agency conflicts and make retailers' market-expansion commitments more observable. However, they may also generate control premium costs and weaken channel coordination. Revenue-sharing contracts linked to retailer share repurchases can align the interests of original shareholders, private equity institutions, and suppliers while mitigating control premium effects and tunneling incentives. Retailer share repurchases are not merely capital-market transactions; their supply chain value depends on whether buyback-induced financial incentives can be translated into coordinated pricing, effort, and operational decisions. Retailers should align repurchase decisions with market development and ordering strategies. Suppliers can use revenue-sharing contracts to balance pricing incentives and downstream revenue allocation. Private equity institutions should calibrate governance mechanisms to support collaborative operations rather than excessive ownership-based control.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261477562"},"PeriodicalIF":3.0,"publicationDate":"2026-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148762090","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Effectiveness of Evaluation: Informing Teacher Professional Development Guided by the PrimeD Framework. 评价的有效性：PrimeD框架指导下的教师专业发展。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-08-13 DOI: 10.1177/0193841X261476745

Robert N Ronau, Christopher R Rakes, Monika Trivedi, Parastoo Zareie, Sarah B Bush, Ashley Schmidt, Michele Stites, Jon Saderholm, Margaret J Mohr-Schroeder

{"title":"The Effectiveness of Evaluation: Informing Teacher Professional Development Guided by the PrimeD Framework.","authors":"Robert N Ronau, Christopher R Rakes, Monika Trivedi, Parastoo Zareie, Sarah B Bush, Ashley Schmidt, Michele Stites, Jon Saderholm, Margaret J Mohr-Schroeder","doi":"10.1177/0193841X261476745","DOIUrl":"https://doi.org/10.1177/0193841X261476745","url":null,"abstract":"This study examines an evaluation that used Schwandt's post-normal evaluation design to create a structure that would capture the uncertainties and complexities encountered in implementing a novel professional development (PD) program at four university teacher preparation programs. Three distinct levels of evaluation were addressed in the study: (1) the evaluation of the PD implementation (RQ 1-2), the evaluation within the project conducted by the PD team internally (RQ 3-4), and an evaluation of the evaluation design itself (RQ 5-6). The PrimeD framework guided the PD implementation and all levels of the evaluation. PrimeD supported continuous collaboration among and within evaluator and implementation teams, which strengthened the focus and consistency of the project vision and goals across all four institutions. Monthly Networked Improvement Community (NIC) meetings provided a forum for participants to share ideas and develop plans for improving their professional practice using Plan-Do-Study-Act (PDSA) cycles. Conclusions, best practices, and contextual challenges were shared across institutions by the participants (teacher candidates, program alumni, classroom mentor teachers, and field experience supervisors). Observations of NIC meetings and focus groups of participants provided the data used to adjust approaches to the implementation and evaluation. Throughout this 5-year PD project, evaluation and research grew to become an integral part of everyday lesson development conversation. The PD implementation team also shared findings across institutions, resulting in modifications of the teacher preparation and early career programs across all four sites that led to better alignment across programs while retaining necessary contextual differences.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"193841X261476745"},"PeriodicalIF":3.0,"publicationDate":"2026-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148765766","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0