对被引用次数最多的出版物进行排名分析,这是一种新的研究评估方法

IF 3.4 2区 管理学 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Alonso Rodríguez-Navarro , Ricardo Brito
{"title":"对被引用次数最多的出版物进行排名分析,这是一种新的研究评估方法","authors":"Alonso Rodríguez-Navarro ,&nbsp;Ricardo Brito","doi":"10.1016/j.joi.2024.101503","DOIUrl":null,"url":null,"abstract":"<div><p>Citation metrics are the best tools for research assessments. However, current metrics may be misleading in research systems that pursue simultaneously different goals, such as to push the boundaries of knowledge or incremental innovations, because their publications have different citation distributions. We estimate the contribution to the progress of knowledge by studying only a limited number of the most cited papers, which are dominated by publications pursuing this progress. To field-normalize the metrics, we substitute the number of citations by the rank position of papers from one country in the global list of papers. Using synthetic series of lognormally distributed numbers, simulating citations, we developed the <em>Rk-</em>index, which is calculated from the global ranks of the 10 highest numbers in each series, and demonstrate its equivalence to the number of papers in top percentiles, P<sub>top 0.1 %</sub> and P<sub>top 0.01 %</sub>. In real cases, the <em>Rk-</em>index is simple and easy to calculate, and evaluates the contribution to the progress of knowledge better than less stringent metrics. Although further research is needed, rank analysis of the most cited papers is a promising approach for research evaluation. It is also demonstrated that, for this purpose, domestic and collaborative papers should be studied independently.</p></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"18 2","pages":"Article 101503"},"PeriodicalIF":3.4000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1751157724000166/pdfft?md5=39c50d1041454d10d6b0530e48b2fe1c&pid=1-s2.0-S1751157724000166-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Rank analysis of most cited publications, a new approach for research assessments\",\"authors\":\"Alonso Rodríguez-Navarro ,&nbsp;Ricardo Brito\",\"doi\":\"10.1016/j.joi.2024.101503\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Citation metrics are the best tools for research assessments. However, current metrics may be misleading in research systems that pursue simultaneously different goals, such as to push the boundaries of knowledge or incremental innovations, because their publications have different citation distributions. We estimate the contribution to the progress of knowledge by studying only a limited number of the most cited papers, which are dominated by publications pursuing this progress. To field-normalize the metrics, we substitute the number of citations by the rank position of papers from one country in the global list of papers. Using synthetic series of lognormally distributed numbers, simulating citations, we developed the <em>Rk-</em>index, which is calculated from the global ranks of the 10 highest numbers in each series, and demonstrate its equivalence to the number of papers in top percentiles, P<sub>top 0.1 %</sub> and P<sub>top 0.01 %</sub>. In real cases, the <em>Rk-</em>index is simple and easy to calculate, and evaluates the contribution to the progress of knowledge better than less stringent metrics. Although further research is needed, rank analysis of the most cited papers is a promising approach for research evaluation. It is also demonstrated that, for this purpose, domestic and collaborative papers should be studied independently.</p></div>\",\"PeriodicalId\":48662,\"journal\":{\"name\":\"Journal of Informetrics\",\"volume\":\"18 2\",\"pages\":\"Article 101503\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2024-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S1751157724000166/pdfft?md5=39c50d1041454d10d6b0530e48b2fe1c&pid=1-s2.0-S1751157724000166-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Informetrics\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1751157724000166\",\"RegionNum\":2,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Informetrics","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1751157724000166","RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

引用指标是研究评估的最佳工具。然而,在同时追求不同目标(如推动知识进步或渐进式创新)的研究系统中,当前的衡量标准可能会产生误导,因为它们的出版物具有不同的引用分布。我们只研究数量有限的被引用次数最多的论文,来估算这些论文对知识进步的贡献,因为这些论文主要是追求知识进步的论文。为了使度量指标现场正态化,我们用一个国家的论文在全球论文列表中的排名位置来代替引用次数。我们使用对数正态分布数字的合成序列来模拟引文,开发出了 Rk 指数,该指数由每个序列中最高的 10 个数字的全球排名计算得出,并证明了它等同于最高百分位数、Ptop 0.1 % 和 Ptop 0.01 % 的论文数量。在实际情况中,Rk-指数简单易算,与不太严格的指标相比,它能更好地评估对知识进步的贡献。尽管还需要进一步研究,但对被引用次数最多的论文进行排名分析是一种很有前途的研究评估方法。研究还表明,为此目的,应独立研究国内论文和合作论文。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Rank analysis of most cited publications, a new approach for research assessments

Citation metrics are the best tools for research assessments. However, current metrics may be misleading in research systems that pursue simultaneously different goals, such as to push the boundaries of knowledge or incremental innovations, because their publications have different citation distributions. We estimate the contribution to the progress of knowledge by studying only a limited number of the most cited papers, which are dominated by publications pursuing this progress. To field-normalize the metrics, we substitute the number of citations by the rank position of papers from one country in the global list of papers. Using synthetic series of lognormally distributed numbers, simulating citations, we developed the Rk-index, which is calculated from the global ranks of the 10 highest numbers in each series, and demonstrate its equivalence to the number of papers in top percentiles, Ptop 0.1 % and Ptop 0.01 %. In real cases, the Rk-index is simple and easy to calculate, and evaluates the contribution to the progress of knowledge better than less stringent metrics. Although further research is needed, rank analysis of the most cited papers is a promising approach for research evaluation. It is also demonstrated that, for this purpose, domestic and collaborative papers should be studied independently.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Informetrics
Journal of Informetrics Social Sciences-Library and Information Sciences
CiteScore
6.40
自引率
16.20%
发文量
95
期刊介绍: Journal of Informetrics (JOI) publishes rigorous high-quality research on quantitative aspects of information science. The main focus of the journal is on topics in bibliometrics, scientometrics, webometrics, patentometrics, altmetrics and research evaluation. Contributions studying informetric problems using methods from other quantitative fields, such as mathematics, statistics, computer science, economics and econometrics, and network science, are especially encouraged. JOI publishes both theoretical and empirical work. In general, case studies, for instance a bibliometric analysis focusing on a specific research field or a specific country, are not considered suitable for publication in JOI, unless they contain innovative methodological elements.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信