{"title":"The forced battle between peer-review and scientometric research assessment: Why the CoARA initiative is unsound","authors":"Giovanni Abramo","doi":"10.1093/reseval/rvae021","DOIUrl":null,"url":null,"abstract":"\n Endorsed by the European Research Area, a Coalition for Advancing Research Assessment (CoARA), primarily composed of research institutions and funders, was established in 2022. Its mission is to reform research assessment, emphasizing a shift towards qualitative judgment. This study examines the CoARA initiative from theoretical, practical, and applicative perspectives, exploring its implications. The manuscript questions a standardized way to evaluate research suitable in every context. Through empirical evidence and internal logical arguments, it challenges the supremacy of qualitative over quantitative methods in terms of robustness, accuracy, validity, functionality, and time and cost convenience in STEMM research assessment. The aim is to clear up common misunderstandings and offer insights to policymakers and decision-makers in charge of defining how research should be evaluated.","PeriodicalId":47668,"journal":{"name":"Research Evaluation","volume":null,"pages":null},"PeriodicalIF":2.9000,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Evaluation","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1093/reseval/rvae021","RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"INFORMATION SCIENCE & LIBRARY SCIENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Endorsed by the European Research Area, a Coalition for Advancing Research Assessment (CoARA), primarily composed of research institutions and funders, was established in 2022. Its mission is to reform research assessment, emphasizing a shift towards qualitative judgment. This study examines the CoARA initiative from theoretical, practical, and applicative perspectives, exploring its implications. The manuscript questions a standardized way to evaluate research suitable in every context. Through empirical evidence and internal logical arguments, it challenges the supremacy of qualitative over quantitative methods in terms of robustness, accuracy, validity, functionality, and time and cost convenience in STEMM research assessment. The aim is to clear up common misunderstandings and offer insights to policymakers and decision-makers in charge of defining how research should be evaluated.
期刊介绍:
Research Evaluation is a peer-reviewed, international journal. It ranges from the individual research project up to inter-country comparisons of research performance. Research projects, researchers, research centres, and the types of research output are all relevant. It includes public and private sectors, natural and social sciences. The term "evaluation" applies to all stages from priorities and proposals, through the monitoring of on-going projects and programmes, to the use of the results of research.