{"title":"The Evaluation Scale: Exploring Decisions About Societal Impact in Peer Review Panels.","authors":"Gemma E Derrick, Gabrielle N Samuel","doi":"10.1007/s11024-016-9290-0","DOIUrl":null,"url":null,"abstract":"<p><p>Realising the societal gains from publicly funded health and medical research requires a model for a reflexive evaluation precedent for the societal impact of research. This research explores UK Research Excellence Framework evaluators' values and opinions and assessing societal impact, prior to the assessment taking place. Specifically, we discuss the characteristics of two different impact assessment extremes - the \"quality-focused\" evaluation and \"societal impact-focused\" evaluation. We show the wide range of evaluator views about impact, and that these views could be conceptually reflected in a range of different positions along a conceptual evaluation scale. We describe the characteristics of these extremes in detail, and discuss the different beliefs evaluators had which could influence where they positioned themselves along the scale. These decisions, we argue, when considered together, form a dominant definition of societal impact that influences the direction of its evaluation by the panel.</p>","PeriodicalId":47427,"journal":{"name":"Minerva","volume":"54 ","pages":"75-97"},"PeriodicalIF":3.2000,"publicationDate":"2016-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4786604/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Minerva","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1007/s11024-016-9290-0","RegionNum":2,"RegionCategory":"哲学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2016/2/9 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Realising the societal gains from publicly funded health and medical research requires a model for a reflexive evaluation precedent for the societal impact of research. This research explores UK Research Excellence Framework evaluators' values and opinions and assessing societal impact, prior to the assessment taking place. Specifically, we discuss the characteristics of two different impact assessment extremes - the "quality-focused" evaluation and "societal impact-focused" evaluation. We show the wide range of evaluator views about impact, and that these views could be conceptually reflected in a range of different positions along a conceptual evaluation scale. We describe the characteristics of these extremes in detail, and discuss the different beliefs evaluators had which could influence where they positioned themselves along the scale. These decisions, we argue, when considered together, form a dominant definition of societal impact that influences the direction of its evaluation by the panel.
期刊介绍:
Minerva is devoted to the study of ideas, traditions, cultures and institutions in science, higher education and research. It is concerned no less with history than with present practice, and with the local as well as the global. It speaks to the scholar, the teacher, the policy-maker and the administrator. It features articles, essay reviews and ''special'' issues on themes of topical importance. It represents no single school of thought, but welcomes diversity, within the rules of rational discourse. Its contributions are peer-reviewed. Its audience is world-wide.