Evaluation Review最新文献

Under What Conditions Does Evidence Travel? Assessing Context Sensitivity and Generalizability in Cash Transfer Program Effectiveness. 证据在什么条件下传播？评估现金转移计划有效性的情境敏感性和普遍性。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-12-01 Epub Date: 2026-07-14 DOI: 10.1177/0193841X261463320

Anis Ben Brik

{"title":"Under What Conditions Does Evidence Travel? Assessing Context Sensitivity and Generalizability in Cash Transfer Program Effectiveness.","authors":"Anis Ben Brik","doi":"10.1177/0193841X261463320","DOIUrl":"10.1177/0193841X261463320","url":null,"abstract":"The evidence-based policy movement assumes that rigorously evaluated interventions replicate across contexts to produce similar effects. This universalist assumption may be unwarranted for complex social programs, where context shapes effectiveness. This study examines generalizability using 15 cash transfer programs evaluated across 12 Middle Eastern and North African countries through four complementary approaches: leave-one-out cross-validation, permutation tests, equivalence testing, and fragility indices. Leave-one-out analysis demonstrates robust stability, with 100% of key relationships maintaining a magnitude within 25% of full-sample estimates. The correlation between transfer size and poverty reduction (r = 0.711, p < .001) shows strong consistency, and permutation tests yield p = .001, indicating genuine signals rather than chance patterns. Equivalence testing reveals that programs with nearly identical designs can produce statistically distinguishable outcomes, with confidence intervals excluding practical equivalence in 67% of matched comparisons. Fragility indices of 2 to 3 for most relationships indicate moderate robustness. These findings suggest that some design-outcome relationships show stability while context matters substantially for program effectiveness. This study offers methodological tools for assessing evidence robustness in small-sample comparative research and argues for epistemic humility in cross-context predictions.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1094-1139"},"PeriodicalIF":3.0,"publicationDate":"2026-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148449967","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Green Policies for the Circular Economy and Entrepreneurship: International Evidence. 循环经济和创业的绿色政策：国际证据。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-12-01 Epub Date: 2026-05-31 DOI: 10.1177/0193841X261456358

Nga Phan Thi Hang

引用次数: 0

Peer-led Support Groups for Parents Following Child Removal: A Mixed-Methods Evaluation Study. 儿童移除后父母的同伴领导支持小组：一项混合方法评估研究。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-12-01 Epub Date: 2026-06-23 DOI: 10.1177/0193841X261462222

Linda M Callejas, Connie Walker-Egea, Svetlana Yampolskaya, Aaliyah Torres, Anna Davidson Abella

{"title":"Peer-led Support Groups for Parents Following Child Removal: A Mixed-Methods Evaluation Study.","authors":"Linda M Callejas, Connie Walker-Egea, Svetlana Yampolskaya, Aaliyah Torres, Anna Davidson Abella","doi":"10.1177/0193841X261462222","DOIUrl":"10.1177/0193841X261462222","url":null,"abstract":"The evidence base for parent support groups in child welfare systems is limited but growing. Evaluation of such programs requires flexible and context-specific designs that capture both outcomes and mechanisms of change. This exploratory mixed-methods evaluation examined a peer-led support group program for parents who experienced child removal in a large Florida county to better understand how these programs operate and benefit parents working toward reunification. A total of 22 parents participated in weekly sessions facilitated by peer specialists with prior child welfare involvement. Quantitative assessments measured changes in psychosocial functioning and engagement in child welfare services, while semi-structured interviews (n = 8) explored participant perceptions of group processes and benefits. Significant decreases were observed in depression, trauma, and loneliness, alongside increases in perceived emotional support. Thematic analysis identified four interrelated themes that informed an empirically grounded conceptual framework describing the functions and benefits of support groups.This evaluation study demonstrates how mixed-methods approaches can yield actionable evidence from small scale community-based interventions and offers insight into the mechanisms that may inform future implementation and evaluation of peer-led models.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1034-1059"},"PeriodicalIF":3.0,"publicationDate":"2026-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148309946","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Brokerage, Gender, and Academic Performance in Interdisciplinary Co-Authorship Networks: A Study of Policy-Related Social Learning Publications. 跨学科合著网络中的经纪、性别与学术表现：政策相关社会学习出版物的研究。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-12-01 Epub Date: 2026-07-01 DOI: 10.1177/0193841X261464677

Elisa Espín-Gallardo, José Antonio Belso-Martínez, María José López-Sánchez

{"title":"Brokerage, Gender, and Academic Performance in Interdisciplinary Co-Authorship Networks: A Study of Policy-Related Social Learning Publications.","authors":"Elisa Espín-Gallardo, José Antonio Belso-Martínez, María José López-Sánchez","doi":"10.1177/0193841X261464677","DOIUrl":"10.1177/0193841X261464677","url":null,"abstract":"Brokers serve as key connectors linking academic researchers who might otherwise remain unconnected, to co-authorship networks. This study examines whether more complex interdisciplinary co-authorships yield greater scholarly impact than ties with authors from the same discipline, which are facilitated by cognitive similarity. It also tests the extent to which such collaborations influence the academic performance of female researchers. The study analyzed 594 authors and 271 papers in the field of social learning. Despite their complexity, regression analyses confirm the benefits of novel sources and combinations of interdisciplinary knowledge. The higher coordination and communication costs of interdisciplinary collaboration are offset by the potential of the new knowledge generated. Interdisciplinary collaboration is associated with higher performance among female scholars, contributing to increased recognition and reputation. This pattern suggests that collaboration strategies and institutional support should reduce coordination barriers in interdisciplinary co-authorship and facilitate women's access to high-impact brokerage opportunities.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1060-1093"},"PeriodicalIF":3.0,"publicationDate":"2026-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148362351","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Insights From Developmental and Formative Evaluations: Developing and Implementing a Limited-Term Housing Mobility Program. 发展性和形成性评估的见解：制定和实施一项有期限的住房流动计划。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-12-01 Epub Date: 2026-07-16 DOI: 10.1177/0193841X261468394

Jee Young Lee, Jason Reece, Rachel Garshick Kleit

{"title":"Insights From Developmental and Formative Evaluations: Developing and Implementing a Limited-Term Housing Mobility Program.","authors":"Jee Young Lee, Jason Reece, Rachel Garshick Kleit","doi":"10.1177/0193841X261468394","DOIUrl":"10.1177/0193841X261468394","url":null,"abstract":"This paper aims to demonstrate how evaluation methods can inform the development of a program, using the example of a novel housing mobility program. The limited availability of Housing Choice Vouchers (HCVs) and other affordable housing assistance restricts the ability to address US national housing needs; millions more households qualify for HCVs than receive them. Those with HCVs encounter challenges in using vouchers in so-called high-opportunity areas. To address the dearth of HCVs and difficulty using them, a collaboration between faculty at Ohio State University and the community developed a new housing mobility program to increase the affordable housing supply, engaging stakeholders to understand the needs of low-income renters who are less likely to obtain an HCV. This paper outlines the Families Flourish program's development using both developmental and formative evaluations, examining the progress of the implementation and immediate outcomes using mixed methods. The developmental evaluation process required collaboration with a wide variety of stakeholders, partners, and the project team. According to the formative evaluation of the pilot program, participants' experiences suggested that enhanced housing security was associated with improvements in physical and mental health for parents and their children, and that a more stable and safe neighborhood environment was similarly associated with gains in employment, education, and income. Throughout the process of evaluation, particularly the developmental evaluation, the evaluator's communication and collaboration skills were essential to the methodology. The study concludes with lessons learned, as well as recommendations for policy and directions for future research.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"1140-1190"},"PeriodicalIF":3.0,"publicationDate":"2026-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13672924/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148473117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Affirmative Action in Brazilian Universities: Evidence From Longitudinal Data. 巴西大学的平权行动：来自纵向数据的证据。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-10-01 Epub Date: 2026-03-18 DOI: 10.1177/0193841X261430056

Claudia Bueno Rocha Vidigal, Vinicius Gonçalves Vidigal

引用次数: 0

"I Can Make My Own Schedule": A Mixed Methods Analysis of the Impact of the Health Profession Opportunity Grant Program on Workplace Flexibility. “我可以制定我自己的时间表”：健康职业机会补助计划对工作场所灵活性影响的混合方法分析。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-10-01 Epub Date: 2026-05-04 DOI: 10.1177/0193841X261446039

Muazzam Toshmatova, Andrea Hetling, Grace Maruska, Victoria Coty

{"title":"\"I Can Make My Own Schedule\": A Mixed Methods Analysis of the Impact of the Health Profession Opportunity Grant Program on Workplace Flexibility.","authors":"Muazzam Toshmatova, Andrea Hetling, Grace Maruska, Victoria Coty","doi":"10.1177/0193841X261446039","DOIUrl":"10.1177/0193841X261446039","url":null,"abstract":"Policymakers are increasingly focused on promoting job quality as a means to enhance financial stability and well-being through employment. Thus, evaluations of public workforce inventions are adding employment outcome measures that go beyond wages in order to assess job quality more broadly. This study employs a mixed methods design to understand what aspects of job quality, beyond wages and benefits, are valued by most participants of a federally funded sectoral job training program and then assess the impact of the program using these grounded insights. We use secondary data from a randomized control trial of the Health Profession Opportunity Grant (HPOG) for our analyses. Themes from a qualitative analysis of 153 participant interviews informed the selection of three flexibility-related outcome measures for quantitative analysis using experimental survey data. Intention-to-treat estimates were generated using linear regression and ordered logit models, with subgroup analyses examining race/ethnicity, nativity, parental status, and education. Workplace flexibility emerged as a widely valued aspect of job quality, with participants emphasizing scheduling choice as a strategy to achieve work-life balance. Statistical models demonstrate that the program facilitates access to jobs with greater workplace flexibility. Heterogeneity analysis reveals differential impacts by ethnicity and education level, and notable positive results for individuals with children, a group more likely to value and benefit from flexibility. HPOG improved access to jobs offering workplace flexibility-an aspect of job quality prioritized by participants. Findings underscore the importance of incorporating non-wage metrics, especially work-life balance, in workforce program evaluations.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"970-1008"},"PeriodicalIF":3.0,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147844334","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Modeling for Effective Aviation Emergency Scheduling in Flood-Stricken Areas: A Material Demand Urgency Evaluation Approach. 洪水灾区航空应急调度的有效建模：一种物资需求紧急度评估方法。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-10-01 Epub Date: 2026-04-27 DOI: 10.1177/0193841X261447020

Xinyao Guo, Jiayi Li, Jintao Lu, Anh Ngoc Quang Huynh

{"title":"Modeling for Effective Aviation Emergency Scheduling in Flood-Stricken Areas: A Material Demand Urgency Evaluation Approach.","authors":"Xinyao Guo, Jiayi Li, Jintao Lu, Anh Ngoc Quang Huynh","doi":"10.1177/0193841X261447020","DOIUrl":"10.1177/0193841X261447020","url":null,"abstract":"Knowing how to implement emergency material scheduling and transportation during emergency rescues, such as major and critical emergencies, has become a research hotspot in academia and industry in recent years. To leverage the speed and terrain-insensitive advantages of aviation, the weak limitations of geographical conditions must be addressed, and the material scheduling efficiency of aviation rescue centers in disaster-stricken areas needs to be improved. In this study, CRITIC and cloud model theory were integrated to evaluate the urgency of emergency material demands in different flood-stricken areas under catastrophic flood disaster risks. Furthermore, a mathematical model for a single aviation emergency rescue center to dispatch emergency materials to multiple disaster-stricken sites was designed based on the optimized ant colony algorithm. A penalty function was then incorporated to formulate a multi-objective aviation scheduling model, aiming to minimize both total rescue time and total cost. The model was solved using an improved genetic algorithm. Taking rainstorm-induced flood disasters in the megacity of Zhengzhou, China, in 2021 as the empirical research case, the operating paths for the aviation emergency rescue center to serve multiple demand points were optimized. The impact of material demand urgency on scheduling decisions was analyzed. Results revealed that when material demand urgency is considered, aircraft complete deliveries according to urgency rankings and return to the center. All tasks can be completed within the required time via four routes. Although total time increases, economic cost is significantly reduced, and disaster loss is mitigated. The findings obtained from this study provide a decision-making reference for improving the efficiency of aviation emergency rescue and enhancing urban risk management capabilities in response to major and critical emergencies.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"898-930"},"PeriodicalIF":3.0,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147785604","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The Change From Passive to Active Parental Consent on Sample Composition; Do We Exclude At-Risk Youth? 父母同意在样本构成上由被动同意向主动同意的转变我们排斥高危青少年吗？

IF 3 4区社会学

Evaluation Review Pub Date : 2026-10-01 Epub Date: 2026-04-21 DOI: 10.1177/0193841X261446673

Ina M Koning, Vincent G van der Rijst

{"title":"The Change From Passive to Active Parental Consent on Sample Composition; Do We Exclude At-Risk Youth?","authors":"Ina M Koning, Vincent G van der Rijst","doi":"10.1177/0193841X261446673","DOIUrl":"10.1177/0193841X261446673","url":null,"abstract":"The aim of this study was to investigate the impact of the shift in recent years from passive to active parental consent for youth' participation in research. A longitudinal study that took place during this change provided the unique opportunity to analyze which adolescent (demographic, alcohol use, norms) and parental factors predict the recipient of consent. The sample consisted of 691 adolescents between 12 and 17 years old (Mage = 14.22; SD = 1.03; 44.9% boys). Factors for each and across five domains (socio-demographic, alcohol use, individual, group/peers, and parental factors) were included in a multiple logistic regression analysis to predict non-consent at follow-up. Across domains, results showed that adolescents who are older (OR = 0.60, p < .001), female (OR = 0.60, p < .001) and those perceived less strict rules about alcohol (OR = 1.26, p = .05), have a higher odds of not having consent for participation. These findings indicate that a specific selection of adolescents were given permission to participate in research, yet this was not particularly an at-risk group. Implications of these findings, such as the balance between autonomy and protection, are discussed.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"876-897"},"PeriodicalIF":3.0,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13558813/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147785571","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Acceptability, Cost, and Uptake of a Multicomponent Menstrual, Sexual, and Reproductive Health Intervention in Secondary Schools in Northwest Tanzania: Lessons From the PASS MHW Pilot Study. 坦桑尼亚西北部中学多成分月经、性和生殖健康干预的可接受性、成本和吸收：来自PASS MHW试点研究的经验教训。

IF 3 4区社会学

Evaluation Review Pub Date : 2026-10-01 Epub Date: 2026-02-28 DOI: 10.1177/0193841X261422289

Elialilia S Okello, Yovitha Sedekia, Dunstan J Matungwa, Belen Torondel, Giulia Greco, Jennifer Rubli, Philip Ayieko, Onike Mcharo, John Luwayi, Brooke Hunsaker, Ramadhan Hashim, Sia Towo, Fauzia Nahay, Saidi Kapiga, Jenny Renju

{"title":"Acceptability, Cost, and Uptake of a Multicomponent Menstrual, Sexual, and Reproductive Health Intervention in Secondary Schools in Northwest Tanzania: Lessons From the PASS MHW Pilot Study.","authors":"Elialilia S Okello, Yovitha Sedekia, Dunstan J Matungwa, Belen Torondel, Giulia Greco, Jennifer Rubli, Philip Ayieko, Onike Mcharo, John Luwayi, Brooke Hunsaker, Ramadhan Hashim, Sia Towo, Fauzia Nahay, Saidi Kapiga, Jenny Renju","doi":"10.1177/0193841X261422289","DOIUrl":"10.1177/0193841X261422289","url":null,"abstract":"Negative menstruation experiences adversely affect schoolgirls' social participation, education, and overall health, yet comprehensive menstrual health interventions are limited in Tanzanian schools. This study evaluated the feasibility, acceptability, cost, and potential impact mechanisms of a comprehensive school-based menstrual, sexual, and reproductive health (MSRH) intervention. The intervention, piloted in four secondary schools, included education sessions for girls and boys, pain management, distribution of menstrual kits (reusable pads and menstrual cups), WASH improvements, and stakeholder engagement. A mixed-methods process evaluation assessed acceptability, fidelity, cost, context, and potential impact mechanisms using qualitative methods (in-depth interviews, focus group discussions, and WASH observations) and quantitative methods (survey questionnaires, structured observation of education sessions, costing, and monitoring data). The intervention was well received by students, teachers, and local government authorities; MSRH education reached 86% of schoolgirls and 72% of schoolboys, while over 93% of girls received menstrual kits. Total implementation cost across the four schools was 111,347,467 TZS (38,003 GBP), approximately 39.05 GBP per student, lower than comparable initiatives in East Africa. Findings indicate the intervention is feasible and acceptable in school settings and can inform future menstrual health and hygiene programs, though further research is needed to assess broader effectiveness and sustainability.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"771-801"},"PeriodicalIF":3.0,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147318454","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0