Evaluation and Program Planning最新文献

{"title":"If you really love nothing. Evaluating second-order factors in the case of Italian constitutional referendum of 2020","authors":"Marzia Ippolito ,&nbsp;Adriano Cozzolino ,&nbsp;Salvatore Ercolano","doi":"10.1016/j.evalprogplan.2023.102386","DOIUrl":"10.1016/j.evalprogplan.2023.102386","url":null,"abstract":"<div><p><span>The paper evaluates several second-order factors to explain the outcomes of the 2020 constitutional referendum held in Italy. This particular referendum serves as a relevant case study to assess the significance of second-order factors, given its unique characteristics, including the simplicity of the referendum question regarding the reduction in the number of parliamentarians (MPs), the minimal impact on public finances resulting from this reduction, and the subsequent decrease in territorial democratic representation. While it might have been expected that a significant majority would vote in favour of the “No” option, thus preserving the current levels of territorial coverage (and democratic representation) of MPs, the actual results saw a substantial majority in favour of the “Yes” vote (69%). Our argument posits that the overwhelming prevalence of the “Yes” vote (to reduce the number of MPs), especially in poorer areas of the country, can be attributed to specific factors that influence individual evaluations in a direct-democratic setting. In greater detail, by using cross-sectional data, the paper tests the role of socio-economic condition, trust in institutions and political participation in affecting the referendum outcome. The results of our empirical analysis confirm our hypotheses, demonstrating that second-order factors indeed influenced the referendum's outcome. Specifically, our analysis reveals that: (</span><em>i</em>) a higher socio-economic condition could generate a higher share of “No” votes; (<em>ii</em>) a higher trust in institutions could lead to an increase in the share of “No” votes; finally, that (<em>iii</em><span>) an increase in political participation could produce a decrease in the share of “No” votes. In the concluding section of the paper, we discuss how this analysis contributes new insights to the study of voting behaviour in direct-democratic contexts.</span></p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2023-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135614181","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Equity-related ‘knots’ in theory of change development: Conceptualization and case illustrations","authors":"Emily Gates ,&nbsp;Kathy Chau Rohn ,&nbsp;Kiruba Murugaiah","doi":"10.1016/j.evalprogplan.2023.102385","DOIUrl":"10.1016/j.evalprogplan.2023.102385","url":null,"abstract":"<div><p>Theory of change (ToC) is an approach widely used to guide planning, implementing, and evaluating change initiatives. While there is substantial guidance, there has been little attention on equity within ToC research and practice. We propose and illustrate the metaphor of ‘knots’ to frame practical and ethical challenges that arise when centering equity within ToC processes. Drawing on our experiences using a ToC approach in two case examples, we identify and illustrate five equity-related knots: (a) clarify root causes, pathways, and success; (b) facilitate participation across power and perspective differences; (c) integrate research evidence and practitioner knowledge; (d) represent complex change visually; and (e) creatively navigate constraints. We show why framing these as knots can help practitioners make wise judgments within the circumstances and close with recommendations for including knots in ToC processes, reporting, and guidance.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2023-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135614437","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Beyond implementation: A collective case study exploring the conceptions and facilitators of sustainability in a quality improvement collaborative","authors":"Madelyn daSilva ,&nbsp;Melanie Dissanayake ,&nbsp;Shannon L. Sibbald","doi":"10.1016/j.evalprogplan.2023.102384","DOIUrl":"10.1016/j.evalprogplan.2023.102384","url":null,"abstract":"<div><p>Chronic Obstructive Pulmonary Disease (COPD) is a primary cause of adult hospitalizations and imposes substantial burdens on patients and healthcare systems. Initiatives that support providers and patients in addressing needs at each stage of this illness are needed. The INSPIRED COPD Outreach Program™ was introduced in 2010 in Halifax, Nova Scotia, Canada to improve care for those with advanced COPD. The huge success of the program led to its expansion to various contexts and geographic locations through a pan-Canadian quality improvement collaborative (QIC). Our study explored early elements of program planning and practice with an aim to understand factors that influence program sustainability. We evaluated the implementation process of 19 teams across Canada; post-collaborative team reports, focus groups, interviews and self-ratings of progress were collected from all teams. Analysis of data revealed three phases important to fostering sustainability (facilitating implementation, keeping the momentum, and securing sustainability) and each phase had unique supporting themes. Not surprisingly, teams that planned for sustainability early in the implementation process were more likely to successfully achieve program sustainability. However, teams also benefited more broadly from sustainability planning; this included being better able to plan for program spread as well as skill retention and knowledge transfer. This was also seen for quality improvement skills introduced early in the program that were more likely to be maintained and used through other contexts when sustainability planning was present. This study highlights that a QIC can be effective in not only influencing program sustainability but also beyond program implementation through improving knowledge and skill acquisition.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2023-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0149718923001611/pdfft?md5=9d974a14522cf0690aea7dfc0e0b18ac&pid=1-s2.0-S0149718923001611-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72211364","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Data-driven analysis on the performance evaluation of national R&D projects in Korea","authors":"Heejung Cho ,&nbsp;Hyeongjin Ahn ,&nbsp;Eunil Park","doi":"10.1016/j.evalprogplan.2023.102383","DOIUrl":"10.1016/j.evalprogplan.2023.102383","url":null,"abstract":"<div><p>Research and development (R&amp;D) is a crucial competency in both developing and developed countries. As a result, evaluating the performance of R&amp;D programs has become a significant research topic for academic and governmental researchers. This study aims to investigate the impact of various factors, such as the characteristics of national R&amp;D projects, research stages, technology types, and management institutions, on their performance. Specifically, we focus on identifying key factors that influence the efficiency of national R&amp;D investments in South Korea. To achieve this, we compiled a dataset of 98,224 government-funded R&amp;D projects conducted between 2016 and 2019. The dataset includes information on project characteristics (research stage, technology types, and management institutions) as well as outcomes (patent applications, patent registrations, publications, royalties, and sales). Through factorial Kruskal-Wallis tests, we found that the research stage and technology type significantly affected the project outcomes, while the research stage did not significantly influence royalty and sales amounts. Additionally, our analysis of South Korean research management institutions revealed variations in their overall performance, suggesting differences in management capabilities among institutions. Based on these findings, we provide insights into setting appropriate research goals for each project, considering their unique characteristics. Finally, we discuss the implications and limitations of this study.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2023-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S014971892300160X/pdfft?md5=52c952d08e9705289c680ac547cda480&pid=1-s2.0-S014971892300160X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71487487","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Investigating the relationship between participation in the building infrastructure leading to diversity (BUILD) initiative and intent to pursue a science career: A cross-sectional analysis","authors":"Hector V. Ramos ,&nbsp;Krystle P. Cobian ,&nbsp;Jayashri Srinivasan ,&nbsp;Christina A. Christie ,&nbsp;Catherine M. Crespi ,&nbsp;Teresa Seeman","doi":"10.1016/j.evalprogplan.2023.102380","DOIUrl":"10.1016/j.evalprogplan.2023.102380","url":null,"abstract":"<div><p>This paper presents an analysis of survey data to examine the association between supervised structured mentoring and students’ intent to pursue a career in science. Data were collected from students in the 10 Building Infrastructure Leading to Diversity (BUILD) research training programs, developed through grants from the National Institutes of Health. Propensity score matching and multinomial logistic regression demonstrated that exposure to BUILD programs—meaning participation in undergraduate research, receipt of mentoring from a primary mentor, and/or participation as a funded scholar and/or associate of each BUILD site’s training program—was associated with increased intent to pursue a science career. These findings have implications for STEM program evaluation and practice in higher education.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2023-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49693154","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Exploring power building capacity at the ecosystem level: A case study of a justice-oriented organizational network","authors":"Daniel J. Fish,&nbsp;Claire Devine,&nbsp;Aisha K. Gilmore,&nbsp;Lisa Angus","doi":"10.1016/j.evalprogplan.2023.102381","DOIUrl":"10.1016/j.evalprogplan.2023.102381","url":null,"abstract":"<div><p>Community organizing and base building groups operate as part of a larger ecosystem of organizations, each with complementary capacities necessary to build power and achieve social change. Analytic approaches to assessing power in organizational networks can generate data to inform strategy, identify gaps, and help nurture organizational ecosystems that support communities in building and exercising power. This article uses a network of 43 justice-focused organizations in the Bay Area, California and their 267 reported connections as a case study to assess the feasibility of measuring power building capacities using social network analyses. We evaluated network capacity for different power-building capacities and explored the relationships between organizations’ positions in the network and their access to capacity. We found that justice-focused organizations were more likely than their connections to have mature capacity for creating alliances and coalitions and for research/legal strategies, whereas their connections were more likely to report mature capacity for community organizing. Most participants in the network were connected within one degree to an organization that was mature in organizing and base building. These results highlight the potential to assess community power building capacities within networks of organizations to identify ecosystem strengths and weaknesses and opportunities for strategic development.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2023-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41239873","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Alliance-building for equity and justice: An inter-organizational perspective","authors":"Krista A. Haapanen ,&nbsp;Brian D. Christens ,&nbsp;Daniel G. Cooper ,&nbsp;Jordan Jurinsky","doi":"10.1016/j.evalprogplan.2023.102382","DOIUrl":"10.1016/j.evalprogplan.2023.102382","url":null,"abstract":"<div><p>Cultivating alliances between specific sectors or fields with unrealized synergies is a promising strategy for systems change. Social network analysis is a useful tool for assessing whether such alliances build relationships between these previously disparate organizations. Two waves of valued network data were collected from the members (N = 25) of a justice system reform coalition composed of two types of community-based organizations: those involved in restorative justice practice and those involved in grassroots community organizing. Social network homophily analyses were employed to characterize the impact of alliance participation on relationships over time across three domains: working together, doing impactful work together, and sharing a philosophy about justice system reform. Results indicate marked increases in the prevalence of relationships between restorative justice and community organizing organizations across all domains, with the greatest increases occurring in perceptions of shared philosophy. Network structures at each time point differed by relational domain and organization type. Findings suggest that the alliance strengthened relationships between restorative justice and community organizing organizations, particularly in perceptions of shared philosophy, but that the magnitude of these changes varied depending on pre-existing interorganizational relationships and organization type. Findings challenge the idea that close working relationships between diverse members is critical to coalition effectiveness, pointing instead to the value of ambidextrous networks and alignment in members’ philosophy and vision.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2023-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49693153","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Planning traffic surveillance in Spain: How to optimize the management of police resources to reduce road fatalities","authors":"José I. Castillo-Manzano,&nbsp;Mercedes Castro-Nuño,&nbsp;Lourdes Lopez-Valpuesta","doi":"10.1016/j.evalprogplan.2023.102379","DOIUrl":"10.1016/j.evalprogplan.2023.102379","url":null,"abstract":"<div><p>Although traffic police enforcement is widely recognized as a key action in the road safety field, it can be a costly policy to implement. In addition, governments often impose budget constraints that can limit the resources available for activities such as law enforcement and surveillance. To evaluate the impact of human traffic control resources planning on traffic fatalities on Spanish NUTS-3 regions interurban roads, this paper uses an econometric model to investigate the performance of police enforcement intensity by focusing on two crucial traffic law infractions (i.e., speeding and drunk driving). After controlling for a range of economic, demographic, climate, and risk exposure variables, results highlight the relevance of visible, human, and in-person traffic law enforcement through regular vehicle patrols for reducing traffic crashes, with a non-significant effect of automatic enforcement. Our findings have important implications for traffic police resource management regarding the effective maintenance of patrol cars and plans to digitalize and automatize police administrative tasks and procedures.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2023-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49683623","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Conditional selection of multifactor evidence for the levels of anaemia among women of reproductive age group","authors":"Pavan Kumar S.T ,&nbsp;Biswajit Lahiri","doi":"10.1016/j.evalprogplan.2023.102344","DOIUrl":"10.1016/j.evalprogplan.2023.102344","url":null,"abstract":"<div><p>The study aims at ascertaining the conditional selection of key indicators affecting severe, moderate, mild, and no anaemia levels for women of reproductive age in India. The secondary data for levels of anaemia and personal records of individuals collected for India from the 7th phase of District Health Survey program of the United States Agency for International Development data depository. The data was cleaned and summarised using frequency and percentages. Then the variables were tested for association with levels of anaemia using the Chi-square (χ2) test. The multinomial logistic regression<span><span> model was employed to ascertain the key indicators through a conditional selection of reference categories. Results suggest that severe anaemia was significantly prevalent among women in the reproductive stage, especially among the 15–29 age groups. Secondary and higher education had a negative effect on the severity of severe, moderate, and mild anaemia. The poorest wealth index stratum had higher and more significant severe anaemia, and households with two adults of the opposite sex had a significant negative effect (β = −0.116, OR = 0.89, p &lt; 0.001) on severe anaemia level while having a significant positive effect on moderate and mild anaemia. Rural households were associated negatively and significantly with moderate and mild anaemia, and nuclear </span>household structures had a higher prevalence of severe anaemia. Therefore, these indicators across different levels of anaemia should be considered for a faster rate of reduction at the national level. Despite several initiatives by the public sector, the anaemia level has remained elevated among women of reproductive age. Education, wealth index, age, pregnancy, relationship structure, household structure, and place of residence were found to be key indicators for the level of anaemia. The significant variables will act as a crucial input to formulate cost-effective public interventions and finally encourage the faster reduction of anaemia levels.</span></p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10453588","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Creating a developmental framework for evaluating RRI implementation in research organisations","authors":"Evanthia Kalpazidou Schmidt","doi":"10.1016/j.evalprogplan.2023.102350","DOIUrl":"10.1016/j.evalprogplan.2023.102350","url":null,"abstract":"<div><p>The evaluation of Responsible Research and Innovation (RRI) actions presents important challenges for the key stakeholders engaged in the process of RRI implementation, such as policy makers, programme managers, and researchers. While there is a considerable body of literature on the conceptualization of responsibility in research and a plethora of attempts to practice RRI, there is a need for increased attention to the monitoring and evaluation of case studies of RRI implementations in research organisations, in particular regarding their structural change effects. This paper aims to discuss a contextualised developmental framework for evaluating RRI implementation in research organisations, with a specific focus on achieving structural change through tailor-made action plans. The framework, developed through RRI evaluation work in the field of biosciences, adopts a systemic and process-oriented perspective, encompassing participatory, anticipatory, reflexive, and responsive dimensions. Concrete empirical examples from bioscience organizations are provided to illustrate how the framework relates to specific conditions, experiences, and solutions, demonstrating how conceptual insights have emerged from real-life practices and data analysis. While the framework was initially customized for the specific contexts of six bioscience research organizations, it holds potential for broader relevance and applicability in addressing challenges related to RRI design, implementation, and evaluation.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":null,"pages":null},"PeriodicalIF":1.6,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10133810","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}