Scientometrics最新文献

{"title":"A validation test of the Uzzi et al. novelty measure of innovation and applications to collaboration patterns between institutions","authors":"Yuefen Wang, Lipeng Fan, Lei Wu","doi":"10.1007/s11192-024-05071-7","DOIUrl":"https://doi.org/10.1007/s11192-024-05071-7","url":null,"abstract":"<p>Exploring a robust and universal appeal bibliometric indicator for assessing creativity is essential but challenging. The novelty measure of innovation proposed by Uzzi et al. (NoveltyU) has sparked considerable interest and debate. Thus, further validation and understanding of its portfolio form of novelty and scope of application are necessary. This paper delves into the calculation and application of the NoveltyU method to shed light on its effectiveness and scope. Analysis of the calculation process reveals that journal pairs with higher novelty often span independent fundamental areas, while those with lower novelty tend to focus on similar and applied fields. Utilizing collaboration patterns between institutions, as discussed in our prior study (Fan et al., Scientometrics 125:1179–1196, 2020), offers insight into the method’s performance in real-world contexts. Results consistently show higher mean NoveltyU values in MM pattern over time, affirming the method’s validity. Categorizing papers into high conventional, low conventional, low novel, and high novel categories unveils higher overlap degree of terms among different patterns in high novel papers. Moreover, leading terms in MM pattern exhibit specific information, while delay terms tend to be more general, and simultaneous terms are even more so. These findings offer valuable insights into identifying hot and frontier topics, bolstering the credibility and application potential of the NoveltyU method, aligning with the broader objective of establishing valid measures of innovativeness in research.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"24 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Is Management and Organizational Studies divided into (micro-)tribes?","authors":"Oliver Wieczorek, Olof Hallonsten, Fredrik Åström","doi":"10.1007/s11192-024-05013-3","DOIUrl":"https://doi.org/10.1007/s11192-024-05013-3","url":null,"abstract":"<p>Many claims have been made in the past that Management and Organization Studies (MOS) is becoming increasingly fragmented, and that this fragmentation is causing it to drift into self-reference and irrelevance. Despite the weight of this claim, it has not yet been subjected to a systematic empirical test. This paper addresses this research gap using the tribalization approach and diachronic co-citation analyses. Based on 22,430 papers published in 14 MOS journals between 1980 and 2019, we calculate local and global centrality measures and the flow of cited articles between co-citation communities over time. In addition, we use a node-removal strategy to test whether only ritualized citations ensure MOS cohesion. Rather than tribalization, our results suggest a center–periphery structure. Furthermore, more peripheral papers are integrated into the central co-citation communities, but the lion's share of the flow of cited papers occurs over time to only a small number of large clusters. An increase of fragmentation and crowding-out of smaller clusters in MOS in seen in the polycentrically organized core 2014–2019.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"6 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141504464","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Predicting citation impact of academic papers across research areas using multiple models and early citations","authors":"Fang Zhang, Shengli Wu","doi":"10.1007/s11192-024-05086-0","DOIUrl":"https://doi.org/10.1007/s11192-024-05086-0","url":null,"abstract":"<p>As the volume of scientific literature expands rapidly, accurately gauging and predicting the citation impact of academic papers has become increasingly imperative. Citation counts serve as a widely adopted metric for this purpose. While numerous researchers have explored techniques for projecting papers’ citation counts, a prevalent constraint lies in the utilization of a singular model across all papers within a dataset. This universal approach, suitable for small, homogeneous collections, proves less effective for large, heterogeneous collections spanning various research domains, thereby curtailing the practical utility of these methodologies. In this study, we propose a pioneering methodology that deploys multiple models tailored to distinct research domains and integrates early citation data. Our approach encompasses instance-based learning techniques to categorize papers into different research domains and distinct prediction models trained on early citation counts for papers within each domain. We assessed our methodology using two extensive datasets sourced from DBLP and arXiv. Our experimental findings affirm that the proposed classification methodology is both precise and efficient in classifying papers into research domains. Furthermore, the proposed prediction methodology, harnessing multiple domain-specific models and early citations, surpasses four state-of-the-art baseline methods in most instances, substantially enhancing the accuracy of citation impact predictions for diverse collections of academic papers.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"149 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141504465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Investigating the application of work–energy metaphor in interdisciplinary citation analysis","authors":"Guoyang Rong, Changling Li, Zhijian Zhang, Shuaipu Chen, Yuxing Qian","doi":"10.1007/s11192-024-05019-x","DOIUrl":"https://doi.org/10.1007/s11192-024-05019-x","url":null,"abstract":"<p>Metaphors play a crucial role in facilitating the comprehension and analysis of knowledge. “Knowledge as energy” is a well-established metaphorical framework that provides unique benefits for comprehending the dissemination of knowledge and enabling its quantification. Nevertheless, empirical studies employing this framework are limited, especially in the area of the work–energy metaphor, which primarily remains theoretical. This paper proposes an application scheme for the work– energy metaphor in interdisciplinary citation analysis. In this scheme, disciplines are considered entities; various factors that drive the progress of a discipline are considered forces; energy is considered the knowledge produced or transferred in the citations. Building upon the work–energy theorem in physics, this study developed indicators reflecting citation quality and velocity to assess interdisciplinary research progression. An empirical investigation was carried out, utilizing these indicators to evaluate the influence of interdisciplinary citations on disciplines. In the experiments, we used Library and Information Science (LIS) from 2012 to 2021 as an example to analyze the impact of interdisciplinary citations from LIS on other disciplines over two time periods. The experiments demonstrated the feasibility of the work–energy metaphorical framework proposed in this paper. It was also found that Computer Science, Management, and Business experienced the highest impact from LIS interdisciplinary citations and exhibited steady growth over a 10-year period. Environmental Science has substantial potential for the future.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"139 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A citation analysis examining geographical specificity in article titles","authors":"C. Sean Burns, Md. Anwarul Islam","doi":"10.1007/s11192-024-05075-3","DOIUrl":"https://doi.org/10.1007/s11192-024-05075-3","url":null,"abstract":"<p>This investigation explores the impact of geographical names within article titles on citation frequency across a corpus of literature within the field of library and information science, spanning from 2018 to 2020, and encompassing 56 journal titles. We hypothesized that the presence of geographical names of nations in article titles would negatively correlate with citation counts. Our primary analysis of 1330 articles with geographical names in titles versus 8702 without, revealed a statistically significant, albeit small, difference in median citations, favoring articles without geographical names (<i>mdn</i> = 7) over those with geographical names (<i>mdn</i> = 6). Contrary to our secondary hypothesis, a proximity analysis demonstrated a weak, positive correlation between the position of geographical names near the title end and citation counts. Our examination found little evidence supporting differential citation frequency based on the Human Development Index (HDI) of the nations mentioned in titles. However, although a journal’s impact score strongly predicted citation counts for articles, we found that these counts were depressed when articles in those journals contained a geographic name. We found a negative correlation between the frequency of geographical names in article titles and the journals’ impact scores, yet this was weakly, statistically significant. Our data also suggested a vague positional preference for nations within titles, unrelated to HDI. Furthermore, the likelihood of journals publishing articles mentioning nations of varying HDI was found to be statistically insignificant. This study sheds light on the nuanced influence of title specificity, through geographical names, on scholarly communication and citation impact, indicating a slight preference for broader title phrasing in garnering citations.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"75 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Heterogeneous hypergraph learning for literature retrieval based on citation intents","authors":"Kaiwen Shi, Kan Liu, Xinyan He","doi":"10.1007/s11192-024-05066-4","DOIUrl":"https://doi.org/10.1007/s11192-024-05066-4","url":null,"abstract":"<p>Literature retrieval helps scientists find previous work that is relative to their own research or even get new research ideas. However, the discrepancy between retrieval results and the ultimate intention of citation is neglected by most literature retrieval models. Citation intent refers to the researcher’s motivation for citing a paper. A citation intent graph with homogeneous nodes and heterogeneous hyperedges can represent different types of citation intents. By leveraging the citation intent information included in a hypergraph, a retrieval model can guide researchers on where to cite its retrieval result by understanding the citation behaviour in the graph. We present a ranking model called CitenGL (<b>Ci</b>tation In<b>ten</b>t <b>G</b>raph <b>L</b>earning) that aims to extract citation intent information and textual matching signals. The proposed model consists of a heterogeneous hypergraph encoder and a lightweight deep fusion unit for efficiency trade-offs. Compared to traditional literature retrieval, our model fills the gap between retrieval results and citation intention and yields an understandable graph-structured output. We evaluated our model on publicly available full-text paper datasets. Experimental results show that CitenGL outperforms most existing neural ranking models that only consider textual information, which illustrates the effectiveness of integrating citation intent information with textual information. Further ablation analyses show how citation intent information complements text-matching signals and citation networks.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"44 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524270","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Gender assignment in doctoral theses: revisiting Teseo with a method based on cultural consensus theory","authors":"Nataly Matias-Rayme, Iuliana Botezan, Mari Carmen Suárez-Figueroa, Rodrigo Sánchez-Jiménez","doi":"10.1007/s11192-024-05079-z","DOIUrl":"https://doi.org/10.1007/s11192-024-05079-z","url":null,"abstract":"<p>This study critically evaluates gender assignment methods within academic contexts, employing a comparative analysis of diverse techniques, including a SVM classifier, gender-guesser, genderize.io, and a Cultural Consensus Theory based classifier. Emphasizing the significance of transparency, data sources, and methodological considerations, the research introduces nomquamgender, a cultural consensus-based method, and applies it to Teseo, a Spanish dissertation database. The results reveal a substantial reduction in the number of individuals with unknown gender compared to traditional methods relying on INE data. The nuanced differences in gender distribution underscore the importance of methodological choices in gender studies, urging for transparent, comprehensive, and freely accessible methods to enhance the accuracy and reliability of gender assignment in academic research. After reevaluating the problem of gender imbalances in the doctoral system we can conclude that it’s still evident although the trend is clearly set for its reduction. Finaly, specific problems related to some disciplines, including STEM fields and seniority roles are found to be worth of attention in the near future.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"58 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141504466","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Are the confidence scores of reviewers consistent with the review content? Evidence from top conference proceedings in AI","authors":"Wenqing Wu, Haixu Xi, Chengzhi Zhang","doi":"10.1007/s11192-024-05070-8","DOIUrl":"https://doi.org/10.1007/s11192-024-05070-8","url":null,"abstract":"<p>Peer review is a critical process used in academia to assess the quality and validity of research articles. Top-tier conferences in the field of artificial intelligence (e.g. ICLR and ACL et al.) require reviewers to provide confidence scores to ensure the reliability of their review reports. However, existing studies on confidence scores have neglected to measure the consistency between the comment text and the confidence score in a more refined way, which may overlook more detailed details (such as aspects) in the text, leading to incomplete understanding of the results and insufficient objective analysis of the results. In this work, we propose assessing the consistency between the textual content of the review reports and the assigned scores at a fine-grained level, including word, sentence and aspect levels. The data used in this paper is derived from the peer review comments of conferences in the fields of deep learning and natural language processing. We employed deep learning models to detect hedge sentences and their corresponding aspects. Furthermore, we conducted statistical analyses of the length of review reports, frequency of hedge word usage, number of hedge sentences, frequency of aspect mentions, and their associated sentiment to assess the consistency between the textual content and confidence scores. Finally, we performed correlation analysis, significance tests and regression analysis on the data to examine the impact of confidence scores on the outcomes of the papers. The results indicate that textual content of the review reports and their confidence scores have high level of consistency at the word, sentence, and aspect levels. The regression results reveal a negative correlation between confidence scores and paper outcomes, indicating that higher confidence scores given by reviewers were associated with paper rejection. This indicates that current overall assessment of the paper’s content and quality by the experts is reliable, making the transparency and fairness of the peer review process convincing. We release our data and associated codes at https://github.com/njust-winchy/confidence_score.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"62 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Closer in time and higher correlation: disclosing the relationship between citation similarity and citation interval","authors":"Wei Cheng, Dejun Zheng, Shaoxiong Fu, Jingfeng Cui","doi":"10.1007/s11192-024-05080-6","DOIUrl":"https://doi.org/10.1007/s11192-024-05080-6","url":null,"abstract":"<p>Investigating the intricate relationship between citation similarity and the citation interval offers vital insights for refining citation recommendation systems and enhancing citation evaluation models. This is also a new perspective for understanding citation patterns. In this study, we used the Library and Information Science (LIS) field as an example to determine and discuss the correlation between citation similarity and the citation interval. Using the methods of data collection, paper title preprocessing, text vectorization based on simCSE, calculation of citation similarity and the citation interval, and calculation of the index per citing paper, this study found the following LIS domain-based results: (i) there is a significant negative correlation between citation similarity and the citation interval, but the correlation coefficient is low. (ii) The citation intervals of the least relevant series of cited papers exhibit a more pronounced susceptibility to citation similarity than the most relevant series of cited papers. (iii) The citation intervals of the most relevant cited papers are more concentrated within 12 years and more likely to be published within the average citation interval, typically from the newer half of the cited paper list and published later within 5 years of the citation half-life. This study concludes that researchers usually pay more attention to the latest and most cutting-edge and strongly relevant existing research than to weakly relevant existing research. Continuous attention and timely incorporation of knowledge into the research direction will promote a more rapid and specialized diffusion of knowledge. These findings are influenced by the accelerated dissemination of information via Internet, heightened academic competition, and the concentration of research endeavors in specialized disciplines. This study not only contributes to the scholarly discussion of citation analysis but also lays the foundation for future exploration and understanding of citation patterns.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"111 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The many publics of science: using altmetrics to identify common communication channels by scientific field","authors":"Daniel Torres-Salinas, Domingo Docampo, Wenceslao Arroyo-Machado, Nicolas Robinson-Garcia","doi":"10.1007/s11192-024-05077-1","DOIUrl":"https://doi.org/10.1007/s11192-024-05077-1","url":null,"abstract":"<p>Altmetrics have led to new quantitative studies of science through social media interactions. However, there are no models of science communication that respond to the multiplicity of non-academic channels. Using the 3653 authors with the highest volume of altmetrics mentions from the main channels (Twitter, News, Facebook, Wikipedia, Blog, Policy documents, and Peer reviews) to their publications (2016-2020), it has been analyzed where the audiences of each discipline are located. The results evidence the generalities and specificities of these new communication models and the differences between areas. These findings are useful for the development of science communication policies and strategies.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"207 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524316","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}