{"title":"解决研究出版物中公制通货膨胀的建议框架。","authors":"Peter Mora, Simone Pilia","doi":"10.1080/08989621.2024.2445280","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Since the advent of online research metrics, which began with Web of Science in 1997, these metrics have been increasingly used to rank researchers and universities. Over the last two decades, the easy access to research metrics has greatly benefitted the academic community and beyond by providing quantitative measures for ranking researchers, universities and departments. However, this accessibility, accompanied by a tendency to quantitatively evaluate research quality and impact, has also shifted the focus toward practices aimed at enhancing research metrics rather than pursuing high-quality, potentially path-breaking research. This trend threatens to degrade global research advancement and invalidate rankings.</p><p><strong>Methodology: </strong>We perform an analysis of statistics from the Stanford's top 2% list and Nobel Laureates.</p><p><strong>Results: </strong>We demonstrate that an accelerating number of researchers - on the order of 10% or 20,000 researchers on Stanford's Top 2% researchers - are achieving implausibly high-publication and new coauthor rates, with many producing tens to hundreds of papers per year, and gaining hundreds to thousands of new coauthors annually.</p><p><strong>Conclusions: </strong>We propose a method to renormalize research metrics. Our renormalized metrics aim to remove the incentive for researchers to prioritize quantity or resort to unethical practices to boost their metrics.</p>","PeriodicalId":50927,"journal":{"name":"Accountability in Research-Policies and Quality Assurance","volume":" ","pages":"1-22"},"PeriodicalIF":2.8000,"publicationDate":"2024-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A proposed framework to address metric inflation in research publications.\",\"authors\":\"Peter Mora, Simone Pilia\",\"doi\":\"10.1080/08989621.2024.2445280\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Since the advent of online research metrics, which began with Web of Science in 1997, these metrics have been increasingly used to rank researchers and universities. Over the last two decades, the easy access to research metrics has greatly benefitted the academic community and beyond by providing quantitative measures for ranking researchers, universities and departments. However, this accessibility, accompanied by a tendency to quantitatively evaluate research quality and impact, has also shifted the focus toward practices aimed at enhancing research metrics rather than pursuing high-quality, potentially path-breaking research. This trend threatens to degrade global research advancement and invalidate rankings.</p><p><strong>Methodology: </strong>We perform an analysis of statistics from the Stanford's top 2% list and Nobel Laureates.</p><p><strong>Results: </strong>We demonstrate that an accelerating number of researchers - on the order of 10% or 20,000 researchers on Stanford's Top 2% researchers - are achieving implausibly high-publication and new coauthor rates, with many producing tens to hundreds of papers per year, and gaining hundreds to thousands of new coauthors annually.</p><p><strong>Conclusions: </strong>We propose a method to renormalize research metrics. Our renormalized metrics aim to remove the incentive for researchers to prioritize quantity or resort to unethical practices to boost their metrics.</p>\",\"PeriodicalId\":50927,\"journal\":{\"name\":\"Accountability in Research-Policies and Quality Assurance\",\"volume\":\" \",\"pages\":\"1-22\"},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2024-12-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Accountability in Research-Policies and Quality Assurance\",\"FirstCategoryId\":\"98\",\"ListUrlMain\":\"https://doi.org/10.1080/08989621.2024.2445280\",\"RegionNum\":1,\"RegionCategory\":\"哲学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MEDICAL ETHICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accountability in Research-Policies and Quality Assurance","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1080/08989621.2024.2445280","RegionNum":1,"RegionCategory":"哲学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICAL ETHICS","Score":null,"Total":0}
引用次数: 0
摘要
背景:自从1997年Web of Science开始出现在线研究指标以来,这些指标越来越多地用于对研究人员和大学进行排名。在过去的二十年里,通过为研究人员、大学和院系排名提供量化指标,研究指标的便捷获取极大地惠及了学术界和其他领域。然而,这种可及性,伴随着定量评估研究质量和影响的趋势,也将重点转向旨在提高研究指标的实践,而不是追求高质量的、潜在的开创性研究。这种趋势可能会降低全球研究的进步,并使排名失效。方法:我们对斯坦福大学前2%的名单和诺贝尔奖获得者的统计数据进行分析。结果:我们证明,研究人员的数量正在加速增长——在斯坦福大学排名前2%的研究人员中,大约有10%或20,000名研究人员——正在取得令人难以置信的高发表率和新合著者率,其中许多人每年发表数十至数百篇论文,每年获得数百至数千名新合著者。结论:我们提出了一种重新规范化研究指标的方法。我们重新标准化的指标旨在消除研究人员优先考虑数量或诉诸不道德的做法来提高他们的指标的动机。
A proposed framework to address metric inflation in research publications.
Background: Since the advent of online research metrics, which began with Web of Science in 1997, these metrics have been increasingly used to rank researchers and universities. Over the last two decades, the easy access to research metrics has greatly benefitted the academic community and beyond by providing quantitative measures for ranking researchers, universities and departments. However, this accessibility, accompanied by a tendency to quantitatively evaluate research quality and impact, has also shifted the focus toward practices aimed at enhancing research metrics rather than pursuing high-quality, potentially path-breaking research. This trend threatens to degrade global research advancement and invalidate rankings.
Methodology: We perform an analysis of statistics from the Stanford's top 2% list and Nobel Laureates.
Results: We demonstrate that an accelerating number of researchers - on the order of 10% or 20,000 researchers on Stanford's Top 2% researchers - are achieving implausibly high-publication and new coauthor rates, with many producing tens to hundreds of papers per year, and gaining hundreds to thousands of new coauthors annually.
Conclusions: We propose a method to renormalize research metrics. Our renormalized metrics aim to remove the incentive for researchers to prioritize quantity or resort to unethical practices to boost their metrics.
期刊介绍:
Accountability in Research: Policies and Quality Assurance is devoted to the examination and critical analysis of systems for maximizing integrity in the conduct of research. It provides an interdisciplinary, international forum for the development of ethics, procedures, standards policies, and concepts to encourage the ethical conduct of research and to enhance the validity of research results.
The journal welcomes views on advancing the integrity of research in the fields of general and multidisciplinary sciences, medicine, law, economics, statistics, management studies, public policy, politics, sociology, history, psychology, philosophy, ethics, and information science.
All submitted manuscripts are subject to initial appraisal by the Editor, and if found suitable for further consideration, to peer review by independent, anonymous expert referees.