发布求助
文献互助 智能选刊 最新文献

American Journal of Evaluation最新文献

筛选
英文 中文
Extending Evaluation Capacity Building Theory to Improvement Science Networks 将评价能力建设理论扩展到改进科学网络
IF 1.7 3区 社会学
American Journal of Evaluation Pub Date : 2021-12-27 DOI: 10.1177/1098214020963189
Kristen Rohanna
{"title":"Extending Evaluation Capacity Building Theory to Improvement Science Networks","authors":"Kristen Rohanna","doi":"10.1177/1098214020963189","DOIUrl":"https://doi.org/10.1177/1098214020963189","url":null,"abstract":"Evaluation practices are continuing to evolve, particularly in those areas related to formative, participatory, and improvement approaches. Improvement science is one of the evaluative practices. Its strength is that it seeks to embrace stakeholders’ and frontline workers’ knowledge and experience, who are often tasked with leading improvement activities in their organizations. However, very little guidance exists on how to develop crucial improvement capacity. Evaluation capacity building literature has the potential to fill this gap. This multiple methods case study follows a networked improvement community’s first year in a public education setting as network leaders sought to build capacity by incorporating Preskill and Boyle’s multidisciplinary model as its guiding framework. The purpose of this study was to better understand how to build improvement science capacity, along with what facilitates implementation and beneficial learnings. This article ends by reconceptualizing and extending Preskill and Boyle’s model to improvement science networks.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"43 1","pages":"46 - 65"},"PeriodicalIF":1.7,"publicationDate":"2021-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44111882","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Conceptualizing and Engaging in Reflective Practice: Experienced Evaluators’ Perspectives 概念化和参与反思性实践：经验丰富的评估者的视角
IF 1.7 3区 社会学
American Journal of Evaluation Pub Date : 2021-12-22 DOI: 10.1177/1098214020983926
Tiffany L. S. Tovey, Gary J. Skolits
{"title":"Conceptualizing and Engaging in Reflective Practice: Experienced Evaluators’ Perspectives","authors":"Tiffany L. S. Tovey, Gary J. Skolits","doi":"10.1177/1098214020983926","DOIUrl":"https://doi.org/10.1177/1098214020983926","url":null,"abstract":"The purpose of this study was to determine professional evaluators’ perceptions of reflective practice (RP) and the extent and manner in which they engage in RP behaviors. Nineteen evaluators with 10 or more years of experience in the evaluation field were interviewed to explore our understanding and practice of RP in evaluation. Findings suggest that RP is a process of self and contextual awareness, involving thinking and questioning, and individual and group meaning-making, focused on facilitating growth in the form of learning and improvement. The roles of individual and collaborative reflection as well as reflection in- and on-action are also discussed. Findings support a call for the further refinement of our understanding of RP in evaluation practice. Evaluators seeking to be better reflective practitioners should be competent in skills such as facilitation and interpersonal skills, as well as budget needed time for RP in evaluation accordingly.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"43 1","pages":"5 - 25"},"PeriodicalIF":1.7,"publicationDate":"2021-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47861524","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Method for Scoring Dose of Multicomponent Interventions: A Building Block for Future Evaluations 多组分干预剂量评分方法：未来评估的基础
IF 1.7 3区 社会学
American Journal of Evaluation Pub Date : 2021-10-21 DOI: 10.1177/1098214020962223
S. Hewawitharana, Janice Kao, C. Rider, Evan Talmage, S. Costello, K. Webb, Wendi Gosliner, G. Woodward-Lopez
{"title":"Method for Scoring Dose of Multicomponent Interventions: A Building Block for Future Evaluations","authors":"S. Hewawitharana, Janice Kao, C. Rider, Evan Talmage, S. Costello, K. Webb, Wendi Gosliner, G. Woodward-Lopez","doi":"10.1177/1098214020962223","DOIUrl":"https://doi.org/10.1177/1098214020962223","url":null,"abstract":"Schools are a critical setting for improving child nutrition and food security and preventing obesity in the United States. The U.S. Department of Agriculture mandates that the Supplemental Nutrition Assistance Program–Education, known as CalFresh Healthy Living (CFHL) in California, implements obesity prevention efforts that utilize multicomponent policy, systems, and environmental change interventions supplemented with direct and indirect education. However, evaluation of these complex interventions has proven challenging due to a lack of established evaluation methods, particularly for comprehensively measuring the dose of multicomponent interventions. This article proposes and demonstrates a method to score the dose of multicomponent California Department of Public Health–funded CFHL school interventions received by children attending public schools, using administrative data collected by CFHL in California.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"43 1","pages":"193 - 213"},"PeriodicalIF":1.7,"publicationDate":"2021-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49411820","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
There’s So Much to Do and Not Enough Time to Do It! A Case for Sentiment Analysis to Derive Meaning From Open Text Using Student Reflections of Engineering Activities 有太多的事情要做，却没有足够的时间去做!利用学生工程活动反思从开放文本中提取意义的情感分析案例
IF 1.7 3区 社会学
American Journal of Evaluation Pub Date : 2021-10-19 DOI: 10.1177/1098214020962576
Abhik Roy, Karen E. Rambo‐Hernandez
{"title":"There’s So Much to Do and Not Enough Time to Do It! A Case for Sentiment Analysis to Derive Meaning From Open Text Using Student Reflections of Engineering Activities","authors":"Abhik Roy, Karen E. Rambo‐Hernandez","doi":"10.1177/1098214020962576","DOIUrl":"https://doi.org/10.1177/1098214020962576","url":null,"abstract":"Evaluators often find themselves in situations where resources to conduct thorough evaluations are limited. In this paper, we present a familiar instance where there is an overwhelming amount of open text to be analyzed under the constraints of time and personnel. In instances when timely feedback is important, the data are plentiful, and answers to the study questions carry lower consequences, we build a case for using a machine learning, in particular a sentiment analysis. We begin by explaining the rationale for the use of sentiment analysis and provide an introduction to this method. Next, we provide an example of a sentiment analysis leveraging data collected from a program evaluation of an engineering education intervention, specifically to text extracted from student reflections of course activities. Finally, limitations of sentiment analysis and related techniques are discussed as well as areas for future research.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"42 1","pages":"559 - 576"},"PeriodicalIF":1.7,"publicationDate":"2021-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45871179","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Using Social Psychology to Constructively Involve Colleagues in Internal Evaluation 运用社会心理学建设性地让同事参与内部评价
IF 1.7 3区 社会学
American Journal of Evaluation Pub Date : 2021-10-05 DOI: 10.1177/1098214020959465
Alison Rogers, Leanne M. Kelly, Alicia McCoy
{"title":"Using Social Psychology to Constructively Involve Colleagues in Internal Evaluation","authors":"Alison Rogers, Leanne M. Kelly, Alicia McCoy","doi":"10.1177/1098214020959465","DOIUrl":"https://doi.org/10.1177/1098214020959465","url":null,"abstract":"Internal evaluators can lead positive, helpful, promotive interactions among colleagues to make evaluation more appropriate, understandable, and accessible. As the motivations and abilities of non-evaluator colleagues are highly varied, interpersonal skills help facilitate cooperation and promote evaluation. Social interdependence theory from social psychology can assist with understanding teamwork and developing interpersonal competence. While the literature links social interdependence theory with evaluation, there is limited understanding of its application in practice. In this article, we share our internal evaluation experiences in three Australian nonprofit organizations to elucidate how we harnessed social connections and interpersonal dynamics to achieve cooperative goals. The purpose of this article is to share our process for using theory and literature to assist with reflecting, planning, and acting, around the way we interact with colleagues. Evaluators may find this process useful when considering how to personalize professional development around interpersonal competencies for evaluation.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"42 1","pages":"541 - 558"},"PeriodicalIF":1.7,"publicationDate":"2021-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48690897","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
A Behavioral Design to Reform Italy’s Evaluation Policy 意大利评估政策改革的行为设计
IF 1.7 3区 社会学
American Journal of Evaluation Pub Date : 2021-10-05 DOI: 10.1177/1098214020972791
M. Marra
{"title":"A Behavioral Design to Reform Italy’s Evaluation Policy","authors":"M. Marra","doi":"10.1177/1098214020972791","DOIUrl":"https://doi.org/10.1177/1098214020972791","url":null,"abstract":"Drawing on the extensive ethnographic research I conducted on Italy’s performance evaluation system, this article highlights the cognitive biases associated with evidence use in decision making and institution working. Framing effects, status quo bias, motivated reasoning, and tacit conflicts between personal and organizational interests were only some of the behavioral phenomena policy makers, managers, and evaluators showed to limit their exposure to performance information. Integrating behavioral findings with theories of governance, evaluation utilization, and critical evidence–informed policymaking, this article discusses behavioral reform strategies to overcome (i) tacit conflicts of interests among evaluators, (ii) the compliance mentality with performance assessment among managers, and (iii) adversarial relationships between courts and administrative agencies as well as polarized politics with respect to evidence use and experts’ behavior. A behavioral design is relevant to reform evaluation policies, especially in countries where performance regimes have been criticized, contested, resisted, and/or perceived as red tape and surveillance mechanisms.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"42 1","pages":"483 - 504"},"PeriodicalIF":1.7,"publicationDate":"2021-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45777610","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Transformative Needs Assessment Methodology: A Mixed Approach for Organizations Serving Marginalized Communities 变革需求评估方法:服务边缘社区组织的混合方法
IF 1.7 3区 社会学
American Journal of Evaluation Pub Date : 2021-10-03 DOI: 10.1177/1098214020960798
Nicole Sankofa
{"title":"Transformative Needs Assessment Methodology: A Mixed Approach for Organizations Serving Marginalized Communities","authors":"Nicole Sankofa","doi":"10.1177/1098214020960798","DOIUrl":"https://doi.org/10.1177/1098214020960798","url":null,"abstract":"Needs assessments (NAs) for marginalized communities would ideally contextualize needs in the sociocultural context, use agency-supportive methods, and result in liberatory action planning. This article develops the Transformative Needs Assessment With Marginalized Communities (TNAMC) using a mixed-methods approach that examines internal and external factors of needs for marginalized communities using liberatory methods to arrive at emancipatory action planning. This nonlinear process includes identifying concerns, checking assumptions, action committee selection, identifying need areas, situating need areas in context, identifying metrics of needs, collecting and analyzing data, prioritizing needs, creating action strategies, and developing an action plan. Each phase is discussed using the examination of anti-recidivism adolescent development needs in a predominately Black juvenile detention facility (N = 87 juveniles) as exemplar. The development of TNAMC is designed to aid NA evaluators in designing assessments that integrate social action as a primary purpose of the NA while empowering marginalized communities throughout research processes.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"42 1","pages":"505 - 522"},"PeriodicalIF":1.7,"publicationDate":"2021-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44272015","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Book Review: Scaling Impact: Innovation for the Public Good by Robert McLean & John Gargani. 书评:罗伯特·麦克莱恩和约翰·加尔加尼的《扩大影响:公共利益的创新》。
IF 1.7 3区 社会学
American Journal of Evaluation Pub Date : 2021-09-30 DOI: 10.1177/10982140211009971
Erica Di Ruggiero
{"title":"Book Review: Scaling Impact: Innovation for the Public Good by Robert McLean & John Gargani.","authors":"Erica Di Ruggiero","doi":"10.1177/10982140211009971","DOIUrl":"https://doi.org/10.1177/10982140211009971","url":null,"abstract":"Robert McLean and John Gargani tackle one of these thorny issues in I Scaling Impact: Innovation for the Public Good i . With the guiding principles and practical applications, McLean and Gargani have provided us with a strong foundation on which to further build the field of scaling science. These guiding principles about scaling impact - justification, optimal scale, coordination, and dynamic evaluation - anchor the book. [Extracted from the article] Copyright of American Journal of Evaluation is the property of Sage Publications, Ltd. and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full . (Copyright applies to all s.)","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"42 1","pages":"602 - 605"},"PeriodicalIF":1.7,"publicationDate":"2021-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"65470503","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Tools for Evaluating the Implementation of Complex Education Interventions 评估复杂教育干预措施实施情况的工具
IF 1.7 3区 社会学
American Journal of Evaluation Pub Date : 2021-09-01 DOI: 10.1177/1098214020958490
K. Kainz, Allison Metz, Noreen Yazejian
{"title":"Tools for Evaluating the Implementation of Complex Education Interventions","authors":"K. Kainz, Allison Metz, Noreen Yazejian","doi":"10.1177/1098214020958490","DOIUrl":"https://doi.org/10.1177/1098214020958490","url":null,"abstract":"Large-scale education interventions aimed at diminishing disparities and generating equitable learning outcomes are often complex, involving multiple components and intended impacts. Evaluating implementation of complex interventions is challenging because of the interactive and emergent nature of intervention components. Methods that build from systems science have proven useful for addressing evaluation challenges in the complex intervention space. Complexity science shares some terminology with systems science, but the primary aims and methods of complexity science are different from those of systems science. In this paper we describe some of the language and ideas used in complexity science. We offer a set of priorities for evaluation of complex interventions based on language and ideas used in complexity science and methodologies aligned with the priorities.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"42 1","pages":"399 - 414"},"PeriodicalIF":1.7,"publicationDate":"2021-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1177/1098214020958490","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46524920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Opportunities and Challenges Ahead for University-Based Evaluator Education Programs, Faculty, and Students 面向大学评估者教育项目、教师和学生的机遇和挑战
IF 1.7 3区 社会学
American Journal of Evaluation Pub Date : 2021-09-01 DOI: 10.1177/1098214020937808
J. LaVelle, S. Donaldson
{"title":"Opportunities and Challenges Ahead for University-Based Evaluator Education Programs, Faculty, and Students","authors":"J. LaVelle, S. Donaldson","doi":"10.1177/1098214020937808","DOIUrl":"https://doi.org/10.1177/1098214020937808","url":null,"abstract":"The profession of evaluation continues to grow, generating more demand for evaluation services than can be fulfilled by the supply of well-trained evaluation practitioners. In this brief forum article, we discuss the current state of evaluator education in the United States and the ways in which university-based programs support the development of evaluation practitioners and scholars. We then discuss the opportunities and challenges university-based programs face, focusing on program design, the challenges of being an evaluation-focused faculty member, and the specific needs of evaluation graduate students. We conclude by providing a research agenda for evaluation scholars interested in advancing the knowledge base about university-based evaluator education.","PeriodicalId":51449,"journal":{"name":"American Journal of Evaluation","volume":"42 1","pages":"428 - 438"},"PeriodicalIF":1.7,"publicationDate":"2021-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46895913","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
首页 上一页 下一页 尾页
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整，为了账户安全，请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们：info@booksci.cn Book学术提供免费学术资源搜索服务，方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号：481959085
Book学术官方微信