{"title":"衡量卓越研究的内生因素。波兰科学评价中的内部出版和利益冲突","authors":"Ireneusz Sadowski , Łukasz Zamęcki","doi":"10.1016/j.respol.2024.105134","DOIUrl":null,"url":null,"abstract":"<div><div>The ministerial exercise of evaluation of scientific institutions gained a pivotal role in the Polish system of science and higher education after the 2018 reform. The evaluation process under the new rules was concluded in 2022, and in the fields of social sciences and humanities (SSH), it was based to a large extent on domestic publications. We have compiled a sample of articles in journals that exerted the highest impact in the four selected SSH disciplines (over 19 thousand articles in 67 journals) to show elements of partiality in how the evaluation was administered. In particular, we show that a degree of control over a journal prompted a substantially higher share of in-house (endogenous) publications, and we point to clear signs of adaptation by editors to the changes in evaluation rules introduced by the Ministry of Science. The results of that particular national case illustrate that domestic indicators of research excellence are relatively prone to bias, as institutions very often have dual and conflicting roles.</div></div>","PeriodicalId":48466,"journal":{"name":"Research Policy","volume":"54 1","pages":"Article 105134"},"PeriodicalIF":7.5000,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Endogeny in measuring research excellence. In-house publishing and conflict of interests in Polish science evaluation\",\"authors\":\"Ireneusz Sadowski , Łukasz Zamęcki\",\"doi\":\"10.1016/j.respol.2024.105134\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The ministerial exercise of evaluation of scientific institutions gained a pivotal role in the Polish system of science and higher education after the 2018 reform. The evaluation process under the new rules was concluded in 2022, and in the fields of social sciences and humanities (SSH), it was based to a large extent on domestic publications. We have compiled a sample of articles in journals that exerted the highest impact in the four selected SSH disciplines (over 19 thousand articles in 67 journals) to show elements of partiality in how the evaluation was administered. In particular, we show that a degree of control over a journal prompted a substantially higher share of in-house (endogenous) publications, and we point to clear signs of adaptation by editors to the changes in evaluation rules introduced by the Ministry of Science. The results of that particular national case illustrate that domestic indicators of research excellence are relatively prone to bias, as institutions very often have dual and conflicting roles.</div></div>\",\"PeriodicalId\":48466,\"journal\":{\"name\":\"Research Policy\",\"volume\":\"54 1\",\"pages\":\"Article 105134\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2024-10-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Research Policy\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0048733324001835\",\"RegionNum\":1,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MANAGEMENT\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Policy","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0048733324001835","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MANAGEMENT","Score":null,"Total":0}
Endogeny in measuring research excellence. In-house publishing and conflict of interests in Polish science evaluation
The ministerial exercise of evaluation of scientific institutions gained a pivotal role in the Polish system of science and higher education after the 2018 reform. The evaluation process under the new rules was concluded in 2022, and in the fields of social sciences and humanities (SSH), it was based to a large extent on domestic publications. We have compiled a sample of articles in journals that exerted the highest impact in the four selected SSH disciplines (over 19 thousand articles in 67 journals) to show elements of partiality in how the evaluation was administered. In particular, we show that a degree of control over a journal prompted a substantially higher share of in-house (endogenous) publications, and we point to clear signs of adaptation by editors to the changes in evaluation rules introduced by the Ministry of Science. The results of that particular national case illustrate that domestic indicators of research excellence are relatively prone to bias, as institutions very often have dual and conflicting roles.
期刊介绍:
Research Policy (RP) articles explore the interaction between innovation, technology, or research, and economic, social, political, and organizational processes, both empirically and theoretically. All RP papers are expected to provide insights with implications for policy or management.
Research Policy (RP) is a multidisciplinary journal focused on analyzing, understanding, and effectively addressing the challenges posed by innovation, technology, R&D, and science. This includes activities related to knowledge creation, diffusion, acquisition, and exploitation in the form of new or improved products, processes, or services, across economic, policy, management, organizational, and environmental dimensions.