{"title":"Beyond declarations: Metrics, rankings and responsible assessment","authors":"","doi":"10.1016/j.respol.2024.105093","DOIUrl":null,"url":null,"abstract":"<div><p>Responsible assessment promotes expert judgment and opposes sole reliance on research metrics when assessing research excellence. While many institutions and national research panels declare commitment to responsible assessment practices, we ask: have these declarations affected the outcomes of research evaluation? Using data from the UK's 2021 national research quality exercise and focusing on the business and management discipline, we show that the strong association between journal rankings and expert evaluations has not changed, despite institutional endorsements of DORA (Declaration on Research Assessment). Additionally, we find that this correlation is strongest for the most prestigious journals. The implications of these findings are profound: they enhance understanding of the use of metrics in research evaluations post-DORA and highlight potential constraints in the deployment of responsible assessment.</p></div>","PeriodicalId":48466,"journal":{"name":"Research Policy","volume":null,"pages":null},"PeriodicalIF":7.5000,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0048733324001422/pdfft?md5=f7b743d95a907a2e7a14acc260bd5e83&pid=1-s2.0-S0048733324001422-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Policy","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0048733324001422","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MANAGEMENT","Score":null,"Total":0}
引用次数: 0
Abstract
Responsible assessment promotes expert judgment and opposes sole reliance on research metrics when assessing research excellence. While many institutions and national research panels declare commitment to responsible assessment practices, we ask: have these declarations affected the outcomes of research evaluation? Using data from the UK's 2021 national research quality exercise and focusing on the business and management discipline, we show that the strong association between journal rankings and expert evaluations has not changed, despite institutional endorsements of DORA (Declaration on Research Assessment). Additionally, we find that this correlation is strongest for the most prestigious journals. The implications of these findings are profound: they enhance understanding of the use of metrics in research evaluations post-DORA and highlight potential constraints in the deployment of responsible assessment.
期刊介绍:
Research Policy (RP) articles explore the interaction between innovation, technology, or research, and economic, social, political, and organizational processes, both empirically and theoretically. All RP papers are expected to provide insights with implications for policy or management.
Research Policy (RP) is a multidisciplinary journal focused on analyzing, understanding, and effectively addressing the challenges posed by innovation, technology, R&D, and science. This includes activities related to knowledge creation, diffusion, acquisition, and exploitation in the form of new or improved products, processes, or services, across economic, policy, management, organizational, and environmental dimensions.