{"title":"Evaluation as the Co-Construction of Knowledge: Case Studies of Place-Based Leadership and Public Service Innovation","authors":"J. Howard, A. Flores, R. Hambleton","doi":"10.1108/S1474-786320140000015008","DOIUrl":"https://doi.org/10.1108/S1474-786320140000015008","url":null,"abstract":"Abstract \u0000This chapter introduces the notion of the ‘Innovation Story’ as a methodological approach to public policy evaluation, which builds in greater opportunity for learning and reflexivity. \u0000 \u0000The Innovation Story is an adaptation of the case study approach and draws on participatory action research traditions. It is a structured narrative that describes a particular public policy innovation in the personalised contexts in which it is experienced by innovators. Its construction involves a discursive process through which involved actors tell their story, explain it to others, listen to their questions and co-construct knowledge of change together. \u0000 \u0000The approach was employed to elaborate five case studies of place-based leadership and public service innovation in the United Kingdom, The Netherlands and Mexico. The key findings are that spaces in which civic leaders come together from different ‘realms’ of leadership in a locality (community, business, professional managers and political leaders) can become innovation zones that foster inventive behaviour. Much depends on the quality of civic leadership, and its capacity to foster genuine dialogue and co-responsibility. This involves the evaluation seeking out influential ideas from below the level of strategic management, and documenting leadership activities of those who are skilled at ‘boundary crossing’ – for example, communicating between sectors. \u0000 \u0000The evaluator can be a key player in this process, as a convenor of safe spaces for actors to come together to discuss and deliberate before returning to practice. Our approach therefore argues for a particular awareness of the political nature of policy evaluation in terms of negotiating these spaces, and the need for politically engaged evaluators who are skilled in facilitating collective learning processes.","PeriodicalId":171248,"journal":{"name":"Advances in Program Evaluation","volume":"75 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115272681","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"On the Importance of Revisiting the Study of Ethics in Evaluation","authors":"Thomas A. Schwandt","doi":"10.1016/S1474-7863(07)10008-9","DOIUrl":"https://doi.org/10.1016/S1474-7863(07)10008-9","url":null,"abstract":"","PeriodicalId":171248,"journal":{"name":"Advances in Program Evaluation","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130548615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"School self-evaluation: Origins, definition, approaches, methods and implementation","authors":"J. Scheerens","doi":"10.1016/S1474-7863(02)80006-0","DOIUrl":"https://doi.org/10.1016/S1474-7863(02)80006-0","url":null,"abstract":"","PeriodicalId":171248,"journal":{"name":"Advances in Program Evaluation","volume":"222 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2002-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134451335","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"School self-evaluation in the Netherlands","authors":"J. Scheerens, M. Hendriks","doi":"10.1016/S1474-7863(02)80009-6","DOIUrl":"https://doi.org/10.1016/S1474-7863(02)80009-6","url":null,"abstract":"","PeriodicalId":171248,"journal":{"name":"Advances in Program Evaluation","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2000-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129243194","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Chapter 12 A validity study of the certification system of the National Board for Professional Teaching Standards","authors":"Tracy W. Smith, W. K. Baker, J. Hattie, L. Bond","doi":"10.1016/S1474-7863(07)11012-7","DOIUrl":"https://doi.org/10.1016/S1474-7863(07)11012-7","url":null,"abstract":"","PeriodicalId":171248,"journal":{"name":"Advances in Program Evaluation","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116643690","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Data-centered school self-evaluation in the Netherlands: Characteristics and prerequisites","authors":"K. Schildkamp, A. J. Visscher","doi":"10.1108/S1474-7863(2013)0000014014","DOIUrl":"https://doi.org/10.1108/S1474-7863(2013)0000014014","url":null,"abstract":"Data-based decision making and school self-evaluation are important themes in education nowadays. Schildkamp (2007) defines school selfevaluation as “a procedure involving systematic information gathering that is initiated by the school itself and intends to assess the functioning of the school and the attainment of its educational goals for purposes of supporting decision making and learning and for fostering school improvement as a whole” (p. 4). Studies into the effects of (self)-evaluation have shown that self-evaluation can improve school quality (Schildkamp, Visscher, & Luyten, 2009) in terms of improved student achievement levels (Tymms & Albone, 2002). Data can be defined as “information that is collected and organized to represent some aspect of, for example, schools” (Lai & Schildkamp, 2012, p. 10). If the data (e.g., student achievement data, student work made in","PeriodicalId":171248,"journal":{"name":"Advances in Program Evaluation","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125892953","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Twice-told tales? How public inquiry could inform N of 1 case study research","authors":"T. Greenhalgh","doi":"10.1108/S1474-786320140000015007","DOIUrl":"https://doi.org/10.1108/S1474-786320140000015007","url":null,"abstract":"Abstract \u0000This chapter considers the usefulness and validity of public inquiries as a source of data and preliminary interpretation for case study research. Using two contrasting examples – the Bristol Inquiry into excess deaths in a children’s cardiac surgery unit and the Woolf Inquiry into a breakdown of governance at the London School of Economics (LSE) – I show how academics can draw fruitfully on, and develop further analysis from, the raw datasets, published summaries and formal judgements of public inquiries. \u0000 \u0000Academic analysis of public inquiries can take two broad forms, corresponding to the two main approaches to individual case study defined by Stake: instrumental (selecting the public inquiry on the basis of pre-defined theoretical features and using the material to develop and test theoretical propositions) and intrinsic (selecting the public inquiry on the basis of the particular topic addressed and using the material to explore questions about what was going on and why). \u0000 \u0000The advantages of a public inquiry as a data source for case study research typically include a clear and uncontested focus of inquiry; the breadth and richness of the dataset collected; the exceptional level of support available for the tasks of transcribing, indexing, collating, summarising and so on; and the expert interpretations and insights of the inquiry’s chair (with which the researcher may or may not agree). A significant disadvantage is that whilst the dataset collected for a public inquiry is typically ‘rich’, it has usually been collected under far from ideal research conditions. Hence, while public inquiries provide a potentially rich resource for researchers, those who seek to use public inquiry data for research must justify their choice on both ethical and scientific grounds.","PeriodicalId":171248,"journal":{"name":"Advances in Program Evaluation","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115097655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Informed consent: An instrumental or deceptive principle in qualitative educational research","authors":"Sabar","doi":"10.1016/S1474-7863(08)12004-X","DOIUrl":"https://doi.org/10.1016/S1474-7863(08)12004-X","url":null,"abstract":"","PeriodicalId":171248,"journal":{"name":"Advances in Program Evaluation","volume":"8 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132915676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Chapter 4 Validating the specification of standards for teaching: Applications to the National Board for Professional Teaching Standards’ Assessments","authors":"J. Hattie","doi":"10.1016/S1474-7863(07)11004-8","DOIUrl":"https://doi.org/10.1016/S1474-7863(07)11004-8","url":null,"abstract":"","PeriodicalId":171248,"journal":{"name":"Advances in Program Evaluation","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124806967","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Freedom from the Rubric","authors":"R. Stake","doi":"10.1108/S1474-786320140000015010","DOIUrl":"https://doi.org/10.1108/S1474-786320140000015010","url":null,"abstract":"","PeriodicalId":171248,"journal":{"name":"Advances in Program Evaluation","volume":"31 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132127893","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}