N. Robinson-García, R. Costas, Tina Nane, T. V. van Leeuwen
{"title":"Valuation regimes in academia: Researchers’ attitudes towards their diversity of activities and academic performance","authors":"N. Robinson-García, R. Costas, Tina Nane, T. V. van Leeuwen","doi":"10.31235/osf.io/ve7d3","DOIUrl":null,"url":null,"abstract":"Evaluation systems have been long criticised for abusing and misusing bibliometric indicators. This has created a culture by which academics are constantly exposing their daily work to the standards they are expected to perform. In this study we investigate whether researchers’ own values and expectations are in line with the expectations of the evaluation system. We conduct a multiple case-study of five departments in two Dutch universities to examine how they balance between their own valuation regimes and the evaluation schemes. For this we combine curriculum analysis with a series of semi-structured interviews. We propose a model to study diversity of academic activities and apply it to the multiple-case study to understand how such diversity is shaped by discipline and career stage. We conclude that the observed misalignment is not only resulting from an abuse of metrics, but also by a lack of tools to evaluate performance in a contextualised and adaptable way.","PeriodicalId":47668,"journal":{"name":"Research Evaluation","volume":" ","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2021-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Evaluation","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.31235/osf.io/ve7d3","RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"INFORMATION SCIENCE & LIBRARY SCIENCE","Score":null,"Total":0}
引用次数: 1
Abstract
Evaluation systems have been long criticised for abusing and misusing bibliometric indicators. This has created a culture by which academics are constantly exposing their daily work to the standards they are expected to perform. In this study we investigate whether researchers’ own values and expectations are in line with the expectations of the evaluation system. We conduct a multiple case-study of five departments in two Dutch universities to examine how they balance between their own valuation regimes and the evaluation schemes. For this we combine curriculum analysis with a series of semi-structured interviews. We propose a model to study diversity of academic activities and apply it to the multiple-case study to understand how such diversity is shaped by discipline and career stage. We conclude that the observed misalignment is not only resulting from an abuse of metrics, but also by a lack of tools to evaluate performance in a contextualised and adaptable way.
期刊介绍:
Research Evaluation is a peer-reviewed, international journal. It ranges from the individual research project up to inter-country comparisons of research performance. Research projects, researchers, research centres, and the types of research output are all relevant. It includes public and private sectors, natural and social sciences. The term "evaluation" applies to all stages from priorities and proposals, through the monitoring of on-going projects and programmes, to the use of the results of research.