学术界的评估制度:研究人员对其活动多样性和学术表现的态度

IF 2.9 4区 管理学 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE
N. Robinson-García, R. Costas, Tina Nane, T. V. van Leeuwen
{"title":"学术界的评估制度:研究人员对其活动多样性和学术表现的态度","authors":"N. Robinson-García, R. Costas, Tina Nane, T. V. van Leeuwen","doi":"10.31235/osf.io/ve7d3","DOIUrl":null,"url":null,"abstract":"Evaluation systems have been long criticised for abusing and misusing bibliometric indicators. This has created a culture by which academics are constantly exposing their daily work to the standards they are expected to perform. In this study we investigate whether researchers’ own values and expectations are in line with the expectations of the evaluation system. We conduct a multiple case-study of five departments in two Dutch universities to examine how they balance between their own valuation regimes and the evaluation schemes. For this we combine curriculum analysis with a series of semi-structured interviews. We propose a model to study diversity of academic activities and apply it to the multiple-case study to understand how such diversity is shaped by discipline and career stage. We conclude that the observed misalignment is not only resulting from an abuse of metrics, but also by a lack of tools to evaluate performance in a contextualised and adaptable way.","PeriodicalId":47668,"journal":{"name":"Research Evaluation","volume":" ","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2021-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Valuation regimes in academia: Researchers’ attitudes towards their diversity of activities and academic performance\",\"authors\":\"N. Robinson-García, R. Costas, Tina Nane, T. V. van Leeuwen\",\"doi\":\"10.31235/osf.io/ve7d3\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Evaluation systems have been long criticised for abusing and misusing bibliometric indicators. This has created a culture by which academics are constantly exposing their daily work to the standards they are expected to perform. In this study we investigate whether researchers’ own values and expectations are in line with the expectations of the evaluation system. We conduct a multiple case-study of five departments in two Dutch universities to examine how they balance between their own valuation regimes and the evaluation schemes. For this we combine curriculum analysis with a series of semi-structured interviews. We propose a model to study diversity of academic activities and apply it to the multiple-case study to understand how such diversity is shaped by discipline and career stage. We conclude that the observed misalignment is not only resulting from an abuse of metrics, but also by a lack of tools to evaluate performance in a contextualised and adaptable way.\",\"PeriodicalId\":47668,\"journal\":{\"name\":\"Research Evaluation\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2021-11-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Research Evaluation\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://doi.org/10.31235/osf.io/ve7d3\",\"RegionNum\":4,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"INFORMATION SCIENCE & LIBRARY SCIENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Evaluation","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.31235/osf.io/ve7d3","RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"INFORMATION SCIENCE & LIBRARY SCIENCE","Score":null,"Total":0}
引用次数: 1

摘要

长期以来,评价系统一直因滥用文献计量指标而受到批评。这创造了一种文化,通过这种文化,学者们不断地将他们的日常工作暴露在他们期望达到的标准之下。在这项研究中,我们调查了研究人员自己的价值观和期望是否符合评估系统的期望。我们对荷兰两所大学的五个系进行了多个案例研究,以考察它们如何在自己的评估制度和评估方案之间取得平衡。为此,我们将课程分析与一系列半结构化访谈相结合。我们提出了一个研究学术活动多样性的模型,并将其应用于多案例研究,以了解学科和职业阶段是如何形成这种多样性的。我们得出的结论是,观察到的偏差不仅是由于滥用指标造成的,而且是由于缺乏以情境化和适应性的方式评估绩效的工具造成的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Valuation regimes in academia: Researchers’ attitudes towards their diversity of activities and academic performance
Evaluation systems have been long criticised for abusing and misusing bibliometric indicators. This has created a culture by which academics are constantly exposing their daily work to the standards they are expected to perform. In this study we investigate whether researchers’ own values and expectations are in line with the expectations of the evaluation system. We conduct a multiple case-study of five departments in two Dutch universities to examine how they balance between their own valuation regimes and the evaluation schemes. For this we combine curriculum analysis with a series of semi-structured interviews. We propose a model to study diversity of academic activities and apply it to the multiple-case study to understand how such diversity is shaped by discipline and career stage. We conclude that the observed misalignment is not only resulting from an abuse of metrics, but also by a lack of tools to evaluate performance in a contextualised and adaptable way.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Research Evaluation
Research Evaluation INFORMATION SCIENCE & LIBRARY SCIENCE-
CiteScore
6.00
自引率
18.20%
发文量
42
期刊介绍: Research Evaluation is a peer-reviewed, international journal. It ranges from the individual research project up to inter-country comparisons of research performance. Research projects, researchers, research centres, and the types of research output are all relevant. It includes public and private sectors, natural and social sciences. The term "evaluation" applies to all stages from priorities and proposals, through the monitoring of on-going projects and programmes, to the use of the results of research.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信