{"title":"Investigating the application of work–energy metaphor in interdisciplinary citation analysis","authors":"Guoyang Rong, Changling Li, Zhijian Zhang, Shuaipu Chen, Yuxing Qian","doi":"10.1007/s11192-024-05019-x","DOIUrl":"https://doi.org/10.1007/s11192-024-05019-x","url":null,"abstract":"<p>Metaphors play a crucial role in facilitating the comprehension and analysis of knowledge. “Knowledge as energy” is a well-established metaphorical framework that provides unique benefits for comprehending the dissemination of knowledge and enabling its quantification. Nevertheless, empirical studies employing this framework are limited, especially in the area of the work–energy metaphor, which primarily remains theoretical. This paper proposes an application scheme for the work– energy metaphor in interdisciplinary citation analysis. In this scheme, disciplines are considered entities; various factors that drive the progress of a discipline are considered forces; energy is considered the knowledge produced or transferred in the citations. Building upon the work–energy theorem in physics, this study developed indicators reflecting citation quality and velocity to assess interdisciplinary research progression. An empirical investigation was carried out, utilizing these indicators to evaluate the influence of interdisciplinary citations on disciplines. In the experiments, we used Library and Information Science (LIS) from 2012 to 2021 as an example to analyze the impact of interdisciplinary citations from LIS on other disciplines over two time periods. The experiments demonstrated the feasibility of the work–energy metaphorical framework proposed in this paper. It was also found that Computer Science, Management, and Business experienced the highest impact from LIS interdisciplinary citations and exhibited steady growth over a 10-year period. Environmental Science has substantial potential for the future.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"139 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
ScientometricsPub Date : 2024-06-21DOI: 10.1007/s11192-024-05075-3
C. Sean Burns, Md. Anwarul Islam
{"title":"A citation analysis examining geographical specificity in article titles","authors":"C. Sean Burns, Md. Anwarul Islam","doi":"10.1007/s11192-024-05075-3","DOIUrl":"https://doi.org/10.1007/s11192-024-05075-3","url":null,"abstract":"<p>This investigation explores the impact of geographical names within article titles on citation frequency across a corpus of literature within the field of library and information science, spanning from 2018 to 2020, and encompassing 56 journal titles. We hypothesized that the presence of geographical names of nations in article titles would negatively correlate with citation counts. Our primary analysis of 1330 articles with geographical names in titles versus 8702 without, revealed a statistically significant, albeit small, difference in median citations, favoring articles without geographical names (<i>mdn</i> = 7) over those with geographical names (<i>mdn</i> = 6). Contrary to our secondary hypothesis, a proximity analysis demonstrated a weak, positive correlation between the position of geographical names near the title end and citation counts. Our examination found little evidence supporting differential citation frequency based on the Human Development Index (HDI) of the nations mentioned in titles. However, although a journal’s impact score strongly predicted citation counts for articles, we found that these counts were depressed when articles in those journals contained a geographic name. We found a negative correlation between the frequency of geographical names in article titles and the journals’ impact scores, yet this was weakly, statistically significant. Our data also suggested a vague positional preference for nations within titles, unrelated to HDI. Furthermore, the likelihood of journals publishing articles mentioning nations of varying HDI was found to be statistically insignificant. This study sheds light on the nuanced influence of title specificity, through geographical names, on scholarly communication and citation impact, indicating a slight preference for broader title phrasing in garnering citations.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"75 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
ScientometricsPub Date : 2024-06-21DOI: 10.1007/s11192-024-05066-4
Kaiwen Shi, Kan Liu, Xinyan He
{"title":"Heterogeneous hypergraph learning for literature retrieval based on citation intents","authors":"Kaiwen Shi, Kan Liu, Xinyan He","doi":"10.1007/s11192-024-05066-4","DOIUrl":"https://doi.org/10.1007/s11192-024-05066-4","url":null,"abstract":"<p>Literature retrieval helps scientists find previous work that is relative to their own research or even get new research ideas. However, the discrepancy between retrieval results and the ultimate intention of citation is neglected by most literature retrieval models. Citation intent refers to the researcher’s motivation for citing a paper. A citation intent graph with homogeneous nodes and heterogeneous hyperedges can represent different types of citation intents. By leveraging the citation intent information included in a hypergraph, a retrieval model can guide researchers on where to cite its retrieval result by understanding the citation behaviour in the graph. We present a ranking model called CitenGL (<b>Ci</b>tation In<b>ten</b>t <b>G</b>raph <b>L</b>earning) that aims to extract citation intent information and textual matching signals. The proposed model consists of a heterogeneous hypergraph encoder and a lightweight deep fusion unit for efficiency trade-offs. Compared to traditional literature retrieval, our model fills the gap between retrieval results and citation intention and yields an understandable graph-structured output. We evaluated our model on publicly available full-text paper datasets. Experimental results show that CitenGL outperforms most existing neural ranking models that only consider textual information, which illustrates the effectiveness of integrating citation intent information with textual information. Further ablation analyses show how citation intent information complements text-matching signals and citation networks.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"44 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524270","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
ScientometricsPub Date : 2024-06-20DOI: 10.1007/s11192-024-05079-z
Nataly Matias-Rayme, Iuliana Botezan, Mari Carmen Suárez-Figueroa, Rodrigo Sánchez-Jiménez
{"title":"Gender assignment in doctoral theses: revisiting Teseo with a method based on cultural consensus theory","authors":"Nataly Matias-Rayme, Iuliana Botezan, Mari Carmen Suárez-Figueroa, Rodrigo Sánchez-Jiménez","doi":"10.1007/s11192-024-05079-z","DOIUrl":"https://doi.org/10.1007/s11192-024-05079-z","url":null,"abstract":"<p>This study critically evaluates gender assignment methods within academic contexts, employing a comparative analysis of diverse techniques, including a SVM classifier, gender-guesser, genderize.io, and a Cultural Consensus Theory based classifier. Emphasizing the significance of transparency, data sources, and methodological considerations, the research introduces nomquamgender, a cultural consensus-based method, and applies it to Teseo, a Spanish dissertation database. The results reveal a substantial reduction in the number of individuals with unknown gender compared to traditional methods relying on INE data. The nuanced differences in gender distribution underscore the importance of methodological choices in gender studies, urging for transparent, comprehensive, and freely accessible methods to enhance the accuracy and reliability of gender assignment in academic research. After reevaluating the problem of gender imbalances in the doctoral system we can conclude that it’s still evident although the trend is clearly set for its reduction. Finaly, specific problems related to some disciplines, including STEM fields and seniority roles are found to be worth of attention in the near future.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"58 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141504466","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
ScientometricsPub Date : 2024-06-20DOI: 10.1007/s11192-024-05070-8
Wenqing Wu, Haixu Xi, Chengzhi Zhang
{"title":"Are the confidence scores of reviewers consistent with the review content? Evidence from top conference proceedings in AI","authors":"Wenqing Wu, Haixu Xi, Chengzhi Zhang","doi":"10.1007/s11192-024-05070-8","DOIUrl":"https://doi.org/10.1007/s11192-024-05070-8","url":null,"abstract":"<p>Peer review is a critical process used in academia to assess the quality and validity of research articles. Top-tier conferences in the field of artificial intelligence (e.g. ICLR and ACL et al.) require reviewers to provide confidence scores to ensure the reliability of their review reports. However, existing studies on confidence scores have neglected to measure the consistency between the comment text and the confidence score in a more refined way, which may overlook more detailed details (such as aspects) in the text, leading to incomplete understanding of the results and insufficient objective analysis of the results. In this work, we propose assessing the consistency between the textual content of the review reports and the assigned scores at a fine-grained level, including word, sentence and aspect levels. The data used in this paper is derived from the peer review comments of conferences in the fields of deep learning and natural language processing. We employed deep learning models to detect hedge sentences and their corresponding aspects. Furthermore, we conducted statistical analyses of the length of review reports, frequency of hedge word usage, number of hedge sentences, frequency of aspect mentions, and their associated sentiment to assess the consistency between the textual content and confidence scores. Finally, we performed correlation analysis, significance tests and regression analysis on the data to examine the impact of confidence scores on the outcomes of the papers. The results indicate that textual content of the review reports and their confidence scores have high level of consistency at the word, sentence, and aspect levels. The regression results reveal a negative correlation between confidence scores and paper outcomes, indicating that higher confidence scores given by reviewers were associated with paper rejection. This indicates that current overall assessment of the paper’s content and quality by the experts is reliable, making the transparency and fairness of the peer review process convincing. We release our data and associated codes at https://github.com/njust-winchy/confidence_score.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"62 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
ScientometricsPub Date : 2024-06-20DOI: 10.1007/s11192-024-05036-w
Katherine W. McCain
{"title":"Collaboration at the phylum level: coauthorship and acknowledgment patterns in the world of the water bears (phylum Tardigrada)","authors":"Katherine W. McCain","doi":"10.1007/s11192-024-05036-w","DOIUrl":"https://doi.org/10.1007/s11192-024-05036-w","url":null,"abstract":"<p>Coauthor and acknowledgment data were captured for 1384 research articles published between 1980 and June, 2023 that focused on tardigrades. Articles indexed in Web of Science or an archives of tardigrade literature were downloaded and thoroughly examined for personal acknowledgment data. Annual publication counts and coauthor maps for four successive time periods (1980–1999, 2000–2008, 2009–2017, 2018-June 2023) showed growth in the literature and increased research activity (more researchers, more complex networks, more international collaboration), beginning in 2000. A two-level Personal Acknowledgments Classification (PAC), was used to code types of acknowledgments. The majority of articles focused on field studies and/or descriptions of new species of tardigrades. This was reflected in rankings of acknowledgment categories and additions to the PAC. Ranked lists of frequently-thanked acknowledgees (all tardigrade researchers) were produced for each period. Acknowledgment profiles of four frequently-thanked researchers identified three different roles that researchers might play in tardigrade studies—”informal academic editorial consultant,” “taxonomic gatekeeper,” and “all-rounder.” Acknowledgments honoring people by naming a new species after them were only found in the species description, not in the formal acknowledgment section.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"63 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
ScientometricsPub Date : 2024-06-20DOI: 10.1007/s11192-024-05080-6
Wei Cheng, Dejun Zheng, Shaoxiong Fu, Jingfeng Cui
{"title":"Closer in time and higher correlation: disclosing the relationship between citation similarity and citation interval","authors":"Wei Cheng, Dejun Zheng, Shaoxiong Fu, Jingfeng Cui","doi":"10.1007/s11192-024-05080-6","DOIUrl":"https://doi.org/10.1007/s11192-024-05080-6","url":null,"abstract":"<p>Investigating the intricate relationship between citation similarity and the citation interval offers vital insights for refining citation recommendation systems and enhancing citation evaluation models. This is also a new perspective for understanding citation patterns. In this study, we used the Library and Information Science (LIS) field as an example to determine and discuss the correlation between citation similarity and the citation interval. Using the methods of data collection, paper title preprocessing, text vectorization based on simCSE, calculation of citation similarity and the citation interval, and calculation of the index per citing paper, this study found the following LIS domain-based results: (i) there is a significant negative correlation between citation similarity and the citation interval, but the correlation coefficient is low. (ii) The citation intervals of the least relevant series of cited papers exhibit a more pronounced susceptibility to citation similarity than the most relevant series of cited papers. (iii) The citation intervals of the most relevant cited papers are more concentrated within 12 years and more likely to be published within the average citation interval, typically from the newer half of the cited paper list and published later within 5 years of the citation half-life. This study concludes that researchers usually pay more attention to the latest and most cutting-edge and strongly relevant existing research than to weakly relevant existing research. Continuous attention and timely incorporation of knowledge into the research direction will promote a more rapid and specialized diffusion of knowledge. These findings are influenced by the accelerated dissemination of information via Internet, heightened academic competition, and the concentration of research endeavors in specialized disciplines. This study not only contributes to the scholarly discussion of citation analysis but also lays the foundation for future exploration and understanding of citation patterns.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"111 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
ScientometricsPub Date : 2024-06-20DOI: 10.1007/s11192-024-05077-1
Daniel Torres-Salinas, Domingo Docampo, Wenceslao Arroyo-Machado, Nicolas Robinson-Garcia
{"title":"The many publics of science: using altmetrics to identify common communication channels by scientific field","authors":"Daniel Torres-Salinas, Domingo Docampo, Wenceslao Arroyo-Machado, Nicolas Robinson-Garcia","doi":"10.1007/s11192-024-05077-1","DOIUrl":"https://doi.org/10.1007/s11192-024-05077-1","url":null,"abstract":"<p>Altmetrics have led to new quantitative studies of science through social media interactions. However, there are no models of science communication that respond to the multiplicity of non-academic channels. Using the 3653 authors with the highest volume of altmetrics mentions from the main channels (Twitter, News, Facebook, Wikipedia, Blog, Policy documents, and Peer reviews) to their publications (2016-2020), it has been analyzed where the audiences of each discipline are located. The results evidence the generalities and specificities of these new communication models and the differences between areas. These findings are useful for the development of science communication policies and strategies.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"207 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141524316","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
ScientometricsPub Date : 2024-06-08DOI: 10.1007/s11192-024-05063-7
Runhui Lin, Biting Li, Yanhong Lu, Yalin Li
{"title":"Degree assortativity in collaboration networks and breakthrough innovation: the moderating role of knowledge networks","authors":"Runhui Lin, Biting Li, Yanhong Lu, Yalin Li","doi":"10.1007/s11192-024-05063-7","DOIUrl":"https://doi.org/10.1007/s11192-024-05063-7","url":null,"abstract":"<p>Collaboration networks are widely recognized as essential channels for accessing innovation resources and facilitating creative activities by enabling the exchange of knowledge and information. However, there is little known about whether and how the similarities and dissimilarities between actors forming ties in a collaboration network can either stimulate or inhibit firms’ breakthrough innovation. This study explores the relationship between degree assortativity in collaboration networks and breakthrough innovation performance, considering the moderating role of knowledge network characteristics. Using a sample of 80,129 semiconductor patents from the United States Patent and Trademark Office database spanning the years 1975 to 2007, we constructed both the internal collaboration network and the knowledge network of firms. To test our hypotheses, we employed a negative binomial regression model. Our findings demonstrate that firms with lower degree assortativity in their collaboration networks tend to exhibit higher levels of breakthrough innovation performance compared to those with higher degree assortativity. Moreover, the number of direct ties in the knowledge network strengthens the negative relationship between collaboration network degree assortativity and breakthrough innovation. Conversely, the number of non-redundant ties in the knowledge network mitigates the negative relationship between collaboration network degree assortativity and breakthrough innovation. This study provides practical guidance for firms aiming to enhance their innovation capabilities by simultaneously developing internal collaboration networks and knowledge networks.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"24 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141504467","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
ScientometricsPub Date : 2024-06-04DOI: 10.1007/s11192-024-05053-9
Abdelghani Maddi, Emmanuel Monneau, Catherine Guaspare-Cartron, Floriana Gargiulo, Michel Dubois
{"title":"Streetlight effect in PubPeer comments: are Open Access publications more scrutinized?","authors":"Abdelghani Maddi, Emmanuel Monneau, Catherine Guaspare-Cartron, Floriana Gargiulo, Michel Dubois","doi":"10.1007/s11192-024-05053-9","DOIUrl":"https://doi.org/10.1007/s11192-024-05053-9","url":null,"abstract":"<p>The <i>Streetlight Effect</i> represents an observation bias that occurs when individuals search for something only where it is easiest to look. Despite the significant development of Post-Publication Peer Review (PPPR) in recent years, facilitated in part by platforms such as PubPeer, existing literature has not examined whether PPPR is affected by this type of bias. In other words, if the PPPR mainly concerns publications to which researchers have direct access (eg to analyze image duplications, etc.). In this study, we compare the Open Access (OA) structures of publishers and journals among 51,882 publications commented on PubPeer to those indexed in OpenAlex database (#156,700,177). Our findings indicate that OA journals are 33% more prevalent in PubPeer than in the global total (52% for the most commented journals). This result can be attributed to disciplinary bias in PubPeer, with overrepresentation of medical and biological research (which exhibits higher levels of openness). However, after normalization, the results reveal that PPPR does not exhibit a Streetlight Effect, as OA publications, within the same discipline, are on average 16% less prevalent in PubPeer than in the global total. These results suggest that the process of scientific self-correction operates independently of publication access status.</p>","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"5 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141253303","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}