{"title":"Democratic Values in Evaluation Systems – A Circle That Can Be Squared?","authors":"Malin Benerdal, M. Larsson","doi":"10.58235/sjpa.v25i3-4.7069","DOIUrl":"https://doi.org/10.58235/sjpa.v25i3-4.7069","url":null,"abstract":"This paper is concerned with the interlocking of democratic values and evaluation systems. A central issue in evaluation has been adherence to democratic values by speaking truth to power or taking an inclusive approach to evaluands. In parallel with these democratic endeavours, evaluation design has increasingly moved from ad-hoc evaluations toward evaluation systems. The question we raise in this paper is how compatible the democratic endeavours of evaluation are with the rise of evaluation systems as the modus operandi. We apply this question to the case of the Swedish school system and its built-in evaluation system: systematic quality work (SQW). In order to explore the research question, school principals were asked to articulate how the democratic mission is visible in their SQW. The results indicate that prominent managing logics at different school levels seem to affect how well democratic values are incorporated into the SQW, highlighting the need to address the institutional and governing setting of evaluation systems in combination with the actors’ roles and decisions in accordance with the democratic evaluation literature.","PeriodicalId":31772,"journal":{"name":"Scandinavian Journal of Public Administration","volume":"19 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72795907","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evaluating the Democratic Quality of Local Democratic Practices – Sampling Seven Frameworks","authors":"K. Löfgren, Annika Agger","doi":"10.58235/sjpa.v25i3-4.7081","DOIUrl":"https://doi.org/10.58235/sjpa.v25i3-4.7081","url":null,"abstract":"There has been an upsurge in more participatory, interactive and citizen-oriented governance practices all around the world since the 1990s. What they all have in common is an emphasis on mobilising citizens and stakeholders affected, strengthening local communities, ensuring efficient planning solutions, and securing enhanced legitimacy for existing governing institutions. Conversely, we have witnessed a growing interest in designing frameworks for evaluating the democratic quality of these innovations, asking questions such as the extent to which they actually are enhancing the quality of democracy? This article juxtaposes seven recent evaluative frameworks developed by academics, which address the question of the democratic quality of these new democratic innovations. The article concludes that there are many overlaps between the different frameworks in terms of criteria with a mix of traditional and more participatory democratic norms at play. Furthermore, it also concludes these evaluative practices in many ways reflect the managerial search for accountability mechanisms in the public sector.","PeriodicalId":31772,"journal":{"name":"Scandinavian Journal of Public Administration","volume":"62 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78612843","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Power of Evaluation","authors":"Kettil Nordesjö, M. Fred","doi":"10.58235/sjpa.v25i3-4.7048","DOIUrl":"https://doi.org/10.58235/sjpa.v25i3-4.7048","url":null,"abstract":"The aim of this special issue is to invite scholars in public administration to address issues of power in relation to evaluation practices in the public sector. Power is one of those big, difficult, and inherently nebulous concepts that both scholars and practitioners appear to consciously or unconsciously avoid. Our ambition in this introduction is not to present a comprehensive conceptual review of power, let alone to present the many different aspects of evaluation. Rather, this is a humble attempt to foster a more explicit discussion of the relationship between power and evaluation. The aim of this introduction is, firstly, to introduce a few basic distinctions and conceptualisations of the relationship between power and evaluation. Secondly, we would like to highlight three themes where power may be an especially fruitful lens when analysing, or just trying to make sense of, evaluation procedures. These are themes found in evaluation research, but where power is not always acknowledged or accounted for. We call them (1) Evaluation and instrumental power, (2) Evaluation and contextual power, and (3) Evaluation and performative power.","PeriodicalId":31772,"journal":{"name":"Scandinavian Journal of Public Administration","volume":"6 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74252414","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Circulation of Evaluative Information","authors":"Peter Dahler-Larsen","doi":"10.58235/sjpa.v25i3-4.7051","DOIUrl":"https://doi.org/10.58235/sjpa.v25i3-4.7051","url":null,"abstract":"Given ongoing changes in the social structuration of evaluation, the circulation of evaluative information is becoming an increasingly important factor in the production of constitutive effects of evaluation. There is power in the circulation of evaluative information, and therefore also power in attempts to regulate or curb it. Based on one case exemplifying massive circulation of evaluative information (Google Scholar), and one with very limited circulation (workplace assessments), we show how infrastructure, interests and institutional rules are useful analytical entry points into studies of circulation. The paper proposes a new theoretical and empirical attention to circulation of evaluative information as a fragile and contested phenomenon.","PeriodicalId":31772,"journal":{"name":"Scandinavian Journal of Public Administration","volume":"24 10 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85213546","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reflection on: “Evaluating the Democratic Quality of Local Democratic Practices – Sampling Seven Frameworks”","authors":"Sofia Rönnqvist","doi":"10.58235/sjpa.v25i3-4.7084","DOIUrl":"https://doi.org/10.58235/sjpa.v25i3-4.7084","url":null,"abstract":"I have been an evaluator for a decade and have been involved in evaluation of programmes and projects with both formative and summative designs. The majority (but far from all) of the evaluations have been funded by the European Union and the stakeholders include municipal, regional and state organisations. My reflections on this article revolve around the usefulness and accessibility of the models discussed. This is because, in my experience, evaluations tend to lose their purpose if they do not meet the needs of practitioners (for example, officials or representatives for NGOs) and policymakers, but also because evaluators often find themselves struggling to put academic evaluation models into practice.","PeriodicalId":31772,"journal":{"name":"Scandinavian Journal of Public Administration","volume":"93 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90584552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reflection on: “The Power and Paradoxes of Evaluation Systems – Increasing Use but Impeding Change”","authors":"Sanja Magdalenić","doi":"10.58235/sjpa.v25i3-4.7066","DOIUrl":"https://doi.org/10.58235/sjpa.v25i3-4.7066","url":null,"abstract":"For me, evaluation is a fascinating field full of paradoxes and I welcome the fact that the article draws attention to the power and paradoxes of evaluation systems. The reflections that follow, rooted in the Swedish context, come from a PhD in sociology who has learned to love evaluation. I am privileged in that I can move across the Swedish evaluation landscape and its various fields of play such as academia, the Swedish Evaluation Society (SVUF) and the arenas that evaluation researchers tend to call “practice”. Here are my thoughts, sparked by the article, on contestability differential, evaluation systems, the paradox of epistemological coherence and the ways forward.","PeriodicalId":31772,"journal":{"name":"Scandinavian Journal of Public Administration","volume":"21 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82462967","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Power and Paradoxes of Evaluation Systems – Increasing Use but Impeding Change","authors":"N. Andersen","doi":"10.58235/sjpa.v25i3-4.7063","DOIUrl":"https://doi.org/10.58235/sjpa.v25i3-4.7063","url":null,"abstract":"In recent years, evaluation systems have become increasingly embedded within public sector organisations. This trend of systematising and institutionalising evaluation activities has generally been perceived as a way to increase the use – and thus the power - of evaluations. However, this article argues that the power of evaluation systems is of a more complicated nature than merely increasing the uptake of evaluative knowledge. By applying the concept of “contestability differential” to a concrete example of an evaluation system within the Danish employment services, it is shown how the institutionalisation of an asymmetric power relation between evaluation system and evaluand creates inherent paradoxes. \u0000The analysis shows how the strong contestability differential between evaluation system and evaluand – necessary for securing the influence of evaluation systems - hinges on the permanence, organisational embeddedness and epistemological fixation of such systems. However, these same elements simultaneously also limit the usefulness of the evaluative knowledge and the capability of the evaluation system to invoke radical change and development in the evaluand. \u0000The article thus highlights an inherent paradox of evaluation systems in that they are simultaneously increasing and decreasing the power of evaluations.","PeriodicalId":31772,"journal":{"name":"Scandinavian Journal of Public Administration","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72638896","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reflection on: “Evaluation in Norway: A 25-Year Assessment”","authors":"P. O. Bastøe","doi":"10.58235/sjpa.v25i3-4.7090","DOIUrl":"https://doi.org/10.58235/sjpa.v25i3-4.7090","url":null,"abstract":"My comments are based on extensive experience of evaluation work over a period of more than 30 years, both as an evaluator, manager, member of review panels and advisory committees in Norway and in multilateral organisations, as well as an author of several books and articles on evaluation and organisational development. I am currently associate professor II at VID specialised university. The assessment under discussion in the article Evaluation in Norway: A-25- year assessment is unique in various ways. It has a long-term perspective, it is based almost exclusively on a public database, and it was conducted by someone outside government. Similar Norwegian assessments use data from surveys and interviews, have a short-term perspective and are performed by someone on the inside of government. Perhaps the most interesting aspect of the article is the interpretations by the authors of what this says about the status of evaluation in Norway.","PeriodicalId":31772,"journal":{"name":"Scandinavian Journal of Public Administration","volume":"28 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90939582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"What Has Changed and What Remains? Institutional Shifts in Nordic Higher Education in the 2000s","authors":"R. Pinheiro","doi":"10.58235/sjpa.v25i3-4.7099","DOIUrl":"https://doi.org/10.58235/sjpa.v25i3-4.7099","url":null,"abstract":"The theme of this special issue, changes in higher education (HE) in the Nordics, might feel somewhat self-evident: by now, the adage from business, “the only constant is change”, seems to encapsulate the reality of higher education in the Nordics. As the movement from industrial welfare states to post-industrial competition states progresses in the Nordics, public universities are slowly but inexorably drawn into the sphere of national economic policy (Poutanen, 2022) as modern “factories” of knowledge production. Starting in the early 2000s, the salience of the knowledge economy paradigm meant that HE institutions (HEIs) were designated as one of the primary engines of economic growth and innovation. New stakeholders and new priorities have been added to universities’ social mission (Pinheiro et al., 2019). While structures of academic self-governance remain, and in this sense Nordic universities have yet to match their Anglophone counterparts in terms of internal and administrative reforms, special emphasis has been placed on concentrating resources, leveraging competitive dynamics, and shifting from the traditional model based on academic, collegial governance towards a more professional and managerial orientation (Geschwind et al., 2019). As elsewhere, Nordic universities are being called upon to compete globally in rankings as well as for funding and prestige alike (Geschwind and Pinheiro, 2017). Academics have been more ambiguous about these new priorities. Collaboration, rather than competition, has served as a guiding principle of academic work. At the micro level, however, academic career models are now subject to increasing competitive pressures (Pietilä and Pinheiro, 2021). Nordic academics are increasingly subject to extraneous metrics, that reflect an idea of a dfs","PeriodicalId":31772,"journal":{"name":"Scandinavian Journal of Public Administration","volume":"40 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79799746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reflection on: “The Circulation of Evaluative Information”","authors":"I. Nyholm","doi":"10.58235/sjpa.v25i3-4.7060","DOIUrl":"https://doi.org/10.58235/sjpa.v25i3-4.7060","url":null,"abstract":"In this text I will focus on evaluation and evaluative information in a rapidly changing environment, as well as evaluation as a process determined by multiple and sometimes even hidden choices. “Evaluation has become such a widespread social phenomenon that the term ‘The Evaluation Society’ is often referred to. This is a society with flows of evaluative information.” This quote from the article “The Circulation of Evaluative Information” (hereafter: the article) illustrates that today evaluative information, the number of evaluations performed, is increasing steadily, at the same time as types and levels of evaluation are becoming more and more diversified.","PeriodicalId":31772,"journal":{"name":"Scandinavian Journal of Public Administration","volume":"34 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88085228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}