Evaluation practicePub Date : 1997-09-01Epub Date: 2003-04-25DOI: 10.1016/S0886-1633(97)90032-5
Jody Fitzpatrick
{"title":"Dialogue with James Riccio","authors":"Jody Fitzpatrick","doi":"10.1016/S0886-1633(97)90032-5","DOIUrl":"https://doi.org/10.1016/S0886-1633(97)90032-5","url":null,"abstract":"","PeriodicalId":84713,"journal":{"name":"Evaluation practice","volume":"18 3","pages":"Pages 243-252"},"PeriodicalIF":0.0,"publicationDate":"1997-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S0886-1633(97)90032-5","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71823240","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Evaluation practicePub Date : 1997-03-01Epub Date: 2002-09-23DOI: 10.1016/S0886-1633(97)90015-5
Robert Stake, Christopher Migotsky, Rita Davis, Edith J. Cisneros, Gary Depaul, Christopher Dunbar Jr., Raquel Farmer, Joan Feltovich, Edna Johnson, Brent Williams, Martha Zurita, Iduina Chaves
{"title":"The evolving syntheses of program value","authors":"Robert Stake, Christopher Migotsky, Rita Davis, Edith J. Cisneros, Gary Depaul, Christopher Dunbar Jr., Raquel Farmer, Joan Feltovich, Edna Johnson, Brent Williams, Martha Zurita, Iduina Chaves","doi":"10.1016/S0886-1633(97)90015-5","DOIUrl":"https://doi.org/10.1016/S0886-1633(97)90015-5","url":null,"abstract":"<div><p>In this paper, we object to Michael Scriven's claim that the basic logic of evaluation is criterial and standards-based. We note that valuing is an integral part of perception and that valuing within perception, repeatedly refined, is an even more basic logic of evaluation. We find unpersuasive his claim that making the final synthesis “governed” will diminish bias, noting that bias will find its way into the required statements of need, function, standards and weighting. We offer our alternative for disciplining the synthesis process, by urging more systematic and demanding critiques of emerging interpretations and values, and by more deliberately using competing conceptual organizers (e.g., goals, issues, decisions and elements of the rules Scriven advocates) as temporary and dialectical grounds for reconsidering the evolving meanings of the program, including its merit and shortcoming.</p></div>","PeriodicalId":84713,"journal":{"name":"Evaluation practice","volume":"18 2","pages":"Pages 89-103"},"PeriodicalIF":0.0,"publicationDate":"1997-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S0886-1633(97)90015-5","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71868440","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Evaluation practicePub Date : 1997-03-01Epub Date: 2002-09-23DOI: 10.1016/S0886-1633(97)90018-0
Jill Florence Lackey , D.Paul Moberg , Matt Balistrieri
{"title":"By whose standards? Reflections on empowerment evaluation and grassroots groups","authors":"Jill Florence Lackey , D.Paul Moberg , Matt Balistrieri","doi":"10.1016/S0886-1633(97)90018-0","DOIUrl":"https://doi.org/10.1016/S0886-1633(97)90018-0","url":null,"abstract":"<div><p>Our recent work with grassroots organizations raises several questions about empowerment evaluation. Critics have focused on concerns such as lack of rigor and objectivity, but few have addressed deeper philosophical issues. One of these issues centers on evaluation standards. Empowered program stakeholders who set the research agenda in the empowerment model may have different ideas from those of the professional evaluator about the structure of inquiry and the use of evaluation. In some cases, the evaluator may question the ethics underlying their choices. One critical issue is whether overarching standards for empowerment evaluation are needed, and if so, who defines them. A second issue focuses on whether there is harmony between the model's twin goals of evaluation ownership and group advocacy, which we found to be incompatible in some situations. Many grassroots organizations who were concerned with group advocacy (e.g., receiving recognition, attracting funding) found it pragmatic to surrender evaluation ownership to the institutionally-based, professional evaluators, particularly when they anticipated favorable evaluation findings.</p></div>","PeriodicalId":84713,"journal":{"name":"Evaluation practice","volume":"18 2","pages":"Pages 137-146"},"PeriodicalIF":0.0,"publicationDate":"1997-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S0886-1633(97)90018-0","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71784154","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Evaluation practicePub Date : 1997-03-01Epub Date: 2002-09-23DOI: 10.1016/S0886-1633(97)90017-9
George A. Johanson
{"title":"Differential item functioning in attitude assessment","authors":"George A. Johanson","doi":"10.1016/S0886-1633(97)90017-9","DOIUrl":"https://doi.org/10.1016/S0886-1633(97)90017-9","url":null,"abstract":"<div><p>Differential item functioning (DIF) is not often seen in the literature on attitude assessment. A brief discussion of DIF and methods of implementation is followed by an illustrative example from a program evaluation, using an attitude-towards-science scale with 1550 children in grades one through six. An item exhibiting substantial DIF with respect to gender was detected using the Mantel-Haenszel procedure. In a second example, data from workshop evaluations with 1682 adults were recoded to a binary format, and it was found that an item suspected of functioning differentially with respect to age groups was, in fact, not doing so. Implications for evaluation practice are discussed.</p></div>","PeriodicalId":84713,"journal":{"name":"Evaluation practice","volume":"18 2","pages":"Pages 127-135"},"PeriodicalIF":0.0,"publicationDate":"1997-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S0886-1633(97)90017-9","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71784155","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Planning and conducting needs assessments: A practical guide: by Belle Ruth Witkin and James W. Altschuld, Sage Publications, Thousand Oaks, CA, 1995, 302 pp","authors":"P. Brook","doi":"10.1016/S0886-1633(97)90022-2","DOIUrl":"https://doi.org/10.1016/S0886-1633(97)90022-2","url":null,"abstract":"","PeriodicalId":84713,"journal":{"name":"Evaluation practice","volume":"18 1","pages":"179-180"},"PeriodicalIF":0.0,"publicationDate":"1997-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S0886-1633(97)90022-2","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"56198784","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Evaluation practicePub Date : 1997-03-01Epub Date: 2002-09-23DOI: 10.1016/S0886-1633(97)90016-7
Rosalie T. Torres , Hallie S. Preskill , Mary E. Piontek
{"title":"Communicating and reporting: Practices and concerns of internal and external evaluators","authors":"Rosalie T. Torres , Hallie S. Preskill , Mary E. Piontek","doi":"10.1016/S0886-1633(97)90016-7","DOIUrl":"https://doi.org/10.1016/S0886-1633(97)90016-7","url":null,"abstract":"<div><p>This study investigated internal and external evaluators' practices and concerns about communicating and reporting evaluation findings. Approximately three-quarters (72%) of a random sample of American Evaluation Association members responded to a survey on this topic. Most of those responding: (1) adhere to traditional reporting formats; (2) are only moderately satisfied with their communicating and reporting efforts; (3) found that insufficient time and political/organizational complexity impedes success in communicating and reporting; and (4) describe effective practice as typically entailing high stakeholder involvement. Internal evaluation was found to be not only equally as prevalent as external evaluation, but different in relation to certain communication and reporting practices.</p></div>","PeriodicalId":84713,"journal":{"name":"Evaluation practice","volume":"18 2","pages":"Pages 105-125"},"PeriodicalIF":0.0,"publicationDate":"1997-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S0886-1633(97)90016-7","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"71868441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}