Linlin Ren , Lei Guo , Hui Yu , Feng Guo , Xinhua Wang , Xiaohui Han
{"title":"与顶尖科学家合作未必能提高论文的新颖性:基于倾向分数匹配法的因果分析","authors":"Linlin Ren , Lei Guo , Hui Yu , Feng Guo , Xinhua Wang , Xiaohui Han","doi":"10.1016/j.joi.2024.101609","DOIUrl":null,"url":null,"abstract":"<div><div>In previous collaboration studies, a majority of them concentrate on examining cooperation models, often overlooking the pivotal role played by a Top Scientist (TS) in scientific advancements. As far as my knowledge extends, only one relevant work delves into the correlation between innovation and collaboration with TSs, and no research has explored this relationship from a causal perspective. More precisely, previous studies suffer from several limitations in their examination of this topic: 1) Existing studies on Papers' Novelty (PN) primarily focus on calculating methods, with limited exploration of its relationship with scientific cooperation. 2) Research that has explored the link between collaboration with TSs and output innovation often adopts a correlational perspective, lacking a causal analysis that could correct for potential confounding factors. 3) Previous methodologies overlook the attributes of citation networks as potential confounding factors, a crucial consideration in identifying identical papers in causal analyses. 4) The impact of disciplinary diversity of papers on the innovation output when collaborating with TSs is often overlooked in prior research. To address these limitations, we conduct a causal analysis of publications in three subfields of computer science from the Web of Science (WoS) database to demonstrate the impact of collaborating with TSs on PN. Specifically, to tackle Limitations 1) and 2), we employ PN as a metric to assess the quality of academic output and explore its causal relationship with collaborating with TSs using the Propensity Score Matching (PSM) method. To address Limitation 3), we comprehensively consider potential confounding factors influencing PSM matching by further incorporating the attributes of citation networks, thereby minimizing selection bias. To deal with Limitation 4), we not only focus on the overall treatment effect but also delve into the treatment effect of intra-disciplinary and interdisciplinary collaboration modes. The research findings indicate that the papers collaborating with TSs exhibit lower PN compared to those without the participation of TSs. This suggests that collaboration with TSs may come at the cost of reduced novelty. This discovery prompts profound reflections on scientific collaboration, emphasizing the challenges and trade-offs that may exist in collaboration.</div></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"19 1","pages":"Article 101609"},"PeriodicalIF":3.4000,"publicationDate":"2024-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Collaborating with top scientists may not improve paper novelty: A causal analysis based on the propensity score matching method\",\"authors\":\"Linlin Ren , Lei Guo , Hui Yu , Feng Guo , Xinhua Wang , Xiaohui Han\",\"doi\":\"10.1016/j.joi.2024.101609\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In previous collaboration studies, a majority of them concentrate on examining cooperation models, often overlooking the pivotal role played by a Top Scientist (TS) in scientific advancements. As far as my knowledge extends, only one relevant work delves into the correlation between innovation and collaboration with TSs, and no research has explored this relationship from a causal perspective. More precisely, previous studies suffer from several limitations in their examination of this topic: 1) Existing studies on Papers' Novelty (PN) primarily focus on calculating methods, with limited exploration of its relationship with scientific cooperation. 2) Research that has explored the link between collaboration with TSs and output innovation often adopts a correlational perspective, lacking a causal analysis that could correct for potential confounding factors. 3) Previous methodologies overlook the attributes of citation networks as potential confounding factors, a crucial consideration in identifying identical papers in causal analyses. 4) The impact of disciplinary diversity of papers on the innovation output when collaborating with TSs is often overlooked in prior research. To address these limitations, we conduct a causal analysis of publications in three subfields of computer science from the Web of Science (WoS) database to demonstrate the impact of collaborating with TSs on PN. Specifically, to tackle Limitations 1) and 2), we employ PN as a metric to assess the quality of academic output and explore its causal relationship with collaborating with TSs using the Propensity Score Matching (PSM) method. To address Limitation 3), we comprehensively consider potential confounding factors influencing PSM matching by further incorporating the attributes of citation networks, thereby minimizing selection bias. To deal with Limitation 4), we not only focus on the overall treatment effect but also delve into the treatment effect of intra-disciplinary and interdisciplinary collaboration modes. The research findings indicate that the papers collaborating with TSs exhibit lower PN compared to those without the participation of TSs. This suggests that collaboration with TSs may come at the cost of reduced novelty. This discovery prompts profound reflections on scientific collaboration, emphasizing the challenges and trade-offs that may exist in collaboration.</div></div>\",\"PeriodicalId\":48662,\"journal\":{\"name\":\"Journal of Informetrics\",\"volume\":\"19 1\",\"pages\":\"Article 101609\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2024-11-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Informetrics\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1751157724001214\",\"RegionNum\":2,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Informetrics","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1751157724001214","RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
Collaborating with top scientists may not improve paper novelty: A causal analysis based on the propensity score matching method
In previous collaboration studies, a majority of them concentrate on examining cooperation models, often overlooking the pivotal role played by a Top Scientist (TS) in scientific advancements. As far as my knowledge extends, only one relevant work delves into the correlation between innovation and collaboration with TSs, and no research has explored this relationship from a causal perspective. More precisely, previous studies suffer from several limitations in their examination of this topic: 1) Existing studies on Papers' Novelty (PN) primarily focus on calculating methods, with limited exploration of its relationship with scientific cooperation. 2) Research that has explored the link between collaboration with TSs and output innovation often adopts a correlational perspective, lacking a causal analysis that could correct for potential confounding factors. 3) Previous methodologies overlook the attributes of citation networks as potential confounding factors, a crucial consideration in identifying identical papers in causal analyses. 4) The impact of disciplinary diversity of papers on the innovation output when collaborating with TSs is often overlooked in prior research. To address these limitations, we conduct a causal analysis of publications in three subfields of computer science from the Web of Science (WoS) database to demonstrate the impact of collaborating with TSs on PN. Specifically, to tackle Limitations 1) and 2), we employ PN as a metric to assess the quality of academic output and explore its causal relationship with collaborating with TSs using the Propensity Score Matching (PSM) method. To address Limitation 3), we comprehensively consider potential confounding factors influencing PSM matching by further incorporating the attributes of citation networks, thereby minimizing selection bias. To deal with Limitation 4), we not only focus on the overall treatment effect but also delve into the treatment effect of intra-disciplinary and interdisciplinary collaboration modes. The research findings indicate that the papers collaborating with TSs exhibit lower PN compared to those without the participation of TSs. This suggests that collaboration with TSs may come at the cost of reduced novelty. This discovery prompts profound reflections on scientific collaboration, emphasizing the challenges and trade-offs that may exist in collaboration.
期刊介绍:
Journal of Informetrics (JOI) publishes rigorous high-quality research on quantitative aspects of information science. The main focus of the journal is on topics in bibliometrics, scientometrics, webometrics, patentometrics, altmetrics and research evaluation. Contributions studying informetric problems using methods from other quantitative fields, such as mathematics, statistics, computer science, economics and econometrics, and network science, are especially encouraged. JOI publishes both theoretical and empirical work. In general, case studies, for instance a bibliometric analysis focusing on a specific research field or a specific country, are not considered suitable for publication in JOI, unless they contain innovative methodological elements.