Identifying Metrics for Measuring Research Culture at the University of Leeds

Shareefa Fadhel, Gaynor Miller, Catherine Davies
{"title":"Identifying Metrics for Measuring Research Culture at the University of Leeds","authors":"Shareefa Fadhel, Gaynor Miller, Catherine Davies","doi":"10.31273/eirj.v11i3.1576","DOIUrl":null,"url":null,"abstract":"Evaluating research quality, environment, and impact has become standard in Higher Education (HE) and is largely based on quantitative data and expert assessments. Data-driven evaluations that focus on high-level statistics or conventional outputs can compromise the recognition of a wider range of research outputs and outcomes by a more diverse range of contributors. Hence, the mechanisms for evaluating research must be applicable and inclusive of a wide range of research activities. In contrast, research culture covers a vast breadth of areas, from career development, career pathways, reward, and recognition, to research integrity and equality. Most of these areas are not easily measurable, with capacity and capability limitations compounding the challenge. Clearly, there is a wealth of measurement options, which many research institutions are currently grappling with to best suit their local context.  However, there are concerns as to whether it is appropriate or even possible to measure research cultural change. Concentrating too heavily on metrics rather than the changes themselves may pose additional barriers to the cultural change we desire. Thus, we argue that the adopted measures must be nuanced for context and for success relative to where we started and what we collectively understand as being measured.\nHere we discuss the University of Leeds’ process of selecting metrics to measure research culture change over the next five years. We share how we engaged with the SCOPE framework to identify, shortlist, and probe potential metrics across the four strategic objectives we have identified are best placed to enhance our research culture. From an initial list of more than 80 metrics we have been able to narrow down to just five robust metrics that we feel, with regular monitoring, will maintain adaptability, resilience, and rigour.\nThis paper aims to provide open and transparent insight into how we have chosen to measure our change in research culture, in order to: benefit the wider sector; foster the sharing of best practices and avoid duplication of efforts. Thus, capturing the true essence of what we at the University of Leeds think it means to change culture.","PeriodicalId":139812,"journal":{"name":"Exchanges: The Interdisciplinary Research Journal","volume":"13 7","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Exchanges: The Interdisciplinary Research Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.31273/eirj.v11i3.1576","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Evaluating research quality, environment, and impact has become standard in Higher Education (HE) and is largely based on quantitative data and expert assessments. Data-driven evaluations that focus on high-level statistics or conventional outputs can compromise the recognition of a wider range of research outputs and outcomes by a more diverse range of contributors. Hence, the mechanisms for evaluating research must be applicable and inclusive of a wide range of research activities. In contrast, research culture covers a vast breadth of areas, from career development, career pathways, reward, and recognition, to research integrity and equality. Most of these areas are not easily measurable, with capacity and capability limitations compounding the challenge. Clearly, there is a wealth of measurement options, which many research institutions are currently grappling with to best suit their local context.  However, there are concerns as to whether it is appropriate or even possible to measure research cultural change. Concentrating too heavily on metrics rather than the changes themselves may pose additional barriers to the cultural change we desire. Thus, we argue that the adopted measures must be nuanced for context and for success relative to where we started and what we collectively understand as being measured. Here we discuss the University of Leeds’ process of selecting metrics to measure research culture change over the next five years. We share how we engaged with the SCOPE framework to identify, shortlist, and probe potential metrics across the four strategic objectives we have identified are best placed to enhance our research culture. From an initial list of more than 80 metrics we have been able to narrow down to just five robust metrics that we feel, with regular monitoring, will maintain adaptability, resilience, and rigour. This paper aims to provide open and transparent insight into how we have chosen to measure our change in research culture, in order to: benefit the wider sector; foster the sharing of best practices and avoid duplication of efforts. Thus, capturing the true essence of what we at the University of Leeds think it means to change culture.
确定衡量利兹大学研究文化的标准
对研究质量、环境和影响进行评估已成为高等教育 (HE) 的标准做法,主要基于定量数据和专家评估。数据驱动的评估侧重于高层次的统计数据或常规产出,可能会影响对更广泛的研究产出和成果的认可,而这些研究产出和成果是由更多不同的贡献者提供的。因此,评估研究的机制必须适用于并包含广泛的研究活动。相比之下,研究文化涵盖的领域非常广泛,从职业发展、职业道路、奖励和认可,到研究诚信和平等。这些领域中的大多数都不容易衡量,而能力和实力方面的限制又加剧了这一挑战。显然,有大量的衡量选择,许多研究机构目前正在努力使其最适合本地情况。 然而,人们担心,衡量研究文化变革是否合适,甚至是否可能。过于关注衡量标准而非变革本身,可能会给我们所期望的文化变革带来更多障碍。因此,我们认为,所采用的衡量标准必须根据我们的起点和我们共同理解的衡量标准的背景和成功与否进行细微调整。在此,我们将讨论利兹大学选择衡量标准来衡量未来五年研究文化变革的过程。我们将分享如何利用 SCOPE 框架来识别、筛选和探究四个战略目标中的潜在衡量标准,我们已经确定这四个战略目标最适合提升我们的研究文化。从最初的 80 多个衡量标准清单中,我们筛选出了五个稳健的衡量标准,我们认为,通过定期监测,这五个衡量标准将保持适应性、复原力和严谨性。本文旨在公开透明地介绍我们如何选择衡量研究文化变革的方法,以便:让更广泛的部门受益;促进最佳实践共享,避免重复劳动。因此,本文捕捉到了我们利兹大学所认为的文化变革的真谛。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书