Scientometrics最新文献_第6页

Are reviewer scores consistent with citations? 审稿人的评分与引文是否一致？

IF 3.9 3区管理学

Scientometrics Pub Date : 2024-07-13 DOI: 10.1007/s11192-024-05103-2

Weixi Xie, Pengfei Jia, Guangyao Zhang, Xianwen Wang

{"title":"Are reviewer scores consistent with citations?","authors":"Weixi Xie, Pengfei Jia, Guangyao Zhang, Xianwen Wang","doi":"10.1007/s11192-024-05103-2","DOIUrl":"https://doi.org/10.1007/s11192-024-05103-2","url":null,"abstract":"Academic evaluation is a critical component of research, with the interaction between quantitative and qualitative assessments becoming a prominent area of focus. This study examines the relationship between peer review scores and citations within the framework of open peer review. Utilizing data from the OpenReview platform for papers presented at the International Conference on Learning Representations (ICLR), the papers were classified into oral presentations, poster presentations, and rejected manuscripts. Weighted scores were calculated using the confidence score method, followed by an analysis using correlation and regression techniques. The findings reveal significant differences among the three categories in terms of review scores and citations, demonstrating a positive correlation between review scores and citations. Additionally, it was found that papers with greater inconsistency in reviews tended to receive higher citations. Reviewers of rejected papers displayed significantly higher confidence in their assessments compared to reviewers of accepted papers. The results highlight the alignment between peer review and traditional bibliometric indicators in the context of open peer review. However, the degree of concordance between the two evaluation methods is not substantial, suggesting that they are not interchangeable. Therefore, traditional bibliometric indicators should be considered an essential complement to peer review. Furthermore, when evaluating the consistency between quantitative and qualitative assessments and the confidence levels of reviewers, peer review demonstrates greater effectiveness than “traditional peer review” in addressing issues of “poor selection”.","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"154 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141609949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Linguistic perspectives in deciphering citation function classification 从语言学角度解读引文功能分类

IF 3.9 3区管理学

Scientometrics Pub Date : 2024-07-12 DOI: 10.1007/s11192-024-05082-4

Marc Bertin, Iana Atanassova

{"title":"Linguistic perspectives in deciphering citation function classification","authors":"Marc Bertin, Iana Atanassova","doi":"10.1007/s11192-024-05082-4","DOIUrl":"https://doi.org/10.1007/s11192-024-05082-4","url":null,"abstract":"Understanding citations within their context is a complex task in information science, critical for bibliometric analysis. The study of citation contexts and their types has been a central issue in recent work on citations. In this paper, we present an experiment on the semantic annotation of citation contexts using a rule-based approach. We processed articles from seven PLOS journals and performed semantic annotation of citation contexts based on linguistic resources we constructed. We built on previous work on verb form analysis, n-grams, and semantic category modeling in the form of a linguistic ontology. Based on our observations, we propose directions of work for the constitution of a semantically annotated corpora. The intermediate results obtained lead us to formulate hypotheses on the relation between the IMRaD structure and certain semantic categories. Furthermore, our results demonstrate the semantic richness of citation contexts and underscore the importance of access to full-text articles for ontology population in open science. The findings suggest that semantic categories vary across disciplines and rhetorical structures, necessitating further exploration with larger and more diverse datasets.","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"18 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141609950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

From informal to formal: scientific knowledge role transition prediction 从非正式到正式：科学知识角色转变预测

IF 3.9 3区管理学

Scientometrics Pub Date : 2024-07-12 DOI: 10.1007/s11192-024-05093-1

Jinqing Yang, Zhifeng Liu, Yong Huang

{"title":"From informal to formal: scientific knowledge role transition prediction","authors":"Jinqing Yang, Zhifeng Liu, Yong Huang","doi":"10.1007/s11192-024-05093-1","DOIUrl":"https://doi.org/10.1007/s11192-024-05093-1","url":null,"abstract":"Comprehending the patterns of knowledge evolution benefits funding agencies, policymakers, and researchers in developing creative ideas. We introduce the notation of scientific knowledge role transition as an evolution from informal to formal. We investigate how different factors affect the role transition of scientific knowledge, considering the two primary levels—transition pace and transition possibility. The interpretive machine learning models are conducted to discover that the Gradient Boosting classifier performs better for predicting transition possibility, and Random Forests regression is the most effective for predicting transition pace. Specifically, knowledge attribute features have a more obvious effect on the transition probability, while knowledge network structure has a greater effect on the transition pace. We further find that knowledge relatedness and citation number have negative effects on knowledge role transition, while adoption frequency, indegree centrality in the knowledge citation network, node number of the egocentric co-occurrence network, and journal impact of scientific knowledge have positive effects. The aforementioned discoveries enhance our comprehension of scientific knowledge evolution patterns and provide insight into the trajectory of scientific and technological advancement.","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"16 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141609861","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The cost of open access: comparing public projects’ budgets and article processing charges expenditure 开放存取的成本：公共项目预算与文章处理费支出的比较

IF 3.9 3区管理学

Scientometrics Pub Date : 2024-07-12 DOI: 10.1007/s11192-024-04988-3

Patricia Alonso-Álvarez, Pablo Sastrón-Toledo, Jorge Mañana-Rodriguez

{"title":"The cost of open access: comparing public projects’ budgets and article processing charges expenditure","authors":"Patricia Alonso-Álvarez, Pablo Sastrón-Toledo, Jorge Mañana-Rodriguez","doi":"10.1007/s11192-024-04988-3","DOIUrl":"https://doi.org/10.1007/s11192-024-04988-3","url":null,"abstract":"Open Access (OA) publication often entails payment of Article processing charges (APCs), particularly in the so-called Hybrid and Gold journals. The growth of Gold OA publications linked to the development of OA mandates has forced funders, research institutions, and researchers to develop strategies to pay APCs. Thus, this research tries to estimate the percentage of the budget of the projects funded by the Spanish State Plan for the Generation of Knowledge and Scientific and Technological Strengthening of the R&D&I, Spain's two main public project funding calls in Spain. The period studied is 2013–2019. Additionally, we study the relationships between publication intensity, funding attraction, and the availability of OA journals with APC expenditure at the area level. The results show that €45.87 million were spent on APCs, with most projects spending 3–8% of their budgets. However, numerous outliers with rates over 10% suggest further study on the role of APCs in the financial performance of the research activity. Estimations shown in the paper have to be taken cautiously as the APCs of the publications related to the projects studied in this analysis might not have been fully paid with the projects’ budget but using other funding strategies. Further research is needed to address the researchers’ decisions better when paying APCs. Finally, publication intensity, funding attraction, and the availability of OA journals are highly correlated with the investment in APCs in different fields. These results show that the current APC framework affects disciplines differently and raises questions about alternative publishing and funding models.","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"9 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141609852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

RefCit2vec: embedding models considering references and citations for measuring document similarity RefCit2vec：考虑参考文献和引文的嵌入模型，用于测量文档相似性

IF 3.9 3区管理学

Scientometrics Pub Date : 2024-07-10 DOI: 10.1007/s11192-024-05067-3

Chien-chih Huang, Kuang-hua Chen

{"title":"RefCit2vec: embedding models considering references and citations for measuring document similarity","authors":"Chien-chih Huang, Kuang-hua Chen","doi":"10.1007/s11192-024-05067-3","DOIUrl":"https://doi.org/10.1007/s11192-024-05067-3","url":null,"abstract":"This study outlines the intellectual structure of Library and Information Science in terms of the venues with RefCit2vec, an embedding method inspired by word2vec. The reference lists or cited-by lists of 62,077 articles in 35 venues (journals and proceedings) between 1928 and 2022 are converted into real number vectors by four independent models of RefCit2vec. The document similarities measured by the two models of RefCit2vec exhibit moderate correlations with bibliographical coupling metrics. In contrast, the similarities from the other two models moderately or strongly correlate with co-citation metrics. Each venue is represented by its centroid, the average vector of its constituent documents. By applying hierarchical agglomerative clustering on the venue centroids, 69% of venues robustly emerge in 6 out of 8 clusters. Four clusters consistently form the library-related branch. The bibliometrics/scientometrics branch contains only 1 cluster, whereas the information-related branch contains 3 clusters. 43% of venues are in six subgroups of consistent tree structures. An article is defined as SCIM-alike for it is closer to the SCIM centroid than half of SCIM articles are. 10% of JASIST articles are SCIM-alike upon their reference lists, and 5% of JASIST articles are SCIM-alike in terms of their cited-by lists. The percentage of SCIM-alike articles in JASIST hiked above the average between 2008 and 2018 but has dropped below the average since 2019. As we demonstrate the dynamics in LIS, citation embedding methods like RefCit2vec can incorporate citation-based, text-based, or authorship features to contribute to varied scenarios in investigating or exploring research fronts and scientific knowledge transfer.","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"16 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141574606","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Research performance of higher education institutions in Türkiye: 1980–2022 土耳其高等教育机构的研究绩效：1980-2022

IF 3.9 3区管理学

Scientometrics Pub Date : 2024-07-08 DOI: 10.1007/s11192-024-05097-x

Muammer Maral

{"title":"Research performance of higher education institutions in Türkiye: 1980–2022","authors":"Muammer Maral","doi":"10.1007/s11192-024-05097-x","DOIUrl":"https://doi.org/10.1007/s11192-024-05097-x","url":null,"abstract":"In recent years, there has been a growing interest in the measurement of research performance. These studies evaluate a country or groups of countries according to their research performance and make some inferences to improve their performance. This study analyses the research performance of Turkish higher education, which aims for higher positions in international rankings, in the context of publication productivity, impact and collaboration with data based on Web of Science and comprehensive indicators for the years 1980–2022. In addition, research area-based analyses were also made. In this way, by presenting Türkiye’s performance from past to present in a comprehensive manner, rich information has been provided to policy makers, decision makers, and practical implications have been made for the improvement of performance. According to the results of the study, Türkiye has been faced with low productivity for many years. Both the area-based analyses and the results for the overall publication impact revealed that although there has been an increase in publication impact in recent years, Türkiye’s publication impact has performed below the world average in all years examined. The results indicated that Turkish higher education has some problems in terms of quality. As for research collaboration, the results showed that Türkiye gives more importance to domestic collaborative publications rather than international collaboration, while industry collaboration continues to remain in the background. Based on the results of the study, practical implications for policy makers and decision makers were made.","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"40 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141574607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Overcoming alphabetical disadvantage: factors influencing the use of surname initial techniques and their impact on citation rates in the four major disciplines of social sciences 克服字母劣势：影响社会科学四大学科使用姓氏首字母技术的因素及其对引用率的影响

IF 3.9 3区管理学

Scientometrics Pub Date : 2024-07-05 DOI: 10.1007/s11192-024-05100-5

Ali Barış Öz

{"title":"Overcoming alphabetical disadvantage: factors influencing the use of surname initial techniques and their impact on citation rates in the four major disciplines of social sciences","authors":"Ali Barış Öz","doi":"10.1007/s11192-024-05100-5","DOIUrl":"https://doi.org/10.1007/s11192-024-05100-5","url":null,"abstract":"This study investigates the factors influencing surname initial techniques in academic publications and their impact on citation counts. Focusing on the disciplines of Economics, Psychology, Political Science, and Sociology, we utilized data from the top 500 universities listed in the Shanghai List. Examining 70.377 academic publications from 2.278 academics published between 2011 and 2020, the study reveals that alphabetical ordering is more prevalent in Economics and Political Science. Academics with surnames placed at the beginning of the alphabet in these fields experience increased visibility and recognition. Conversely, those with surnames placed at the end of the alphabet face disadvantages and often employ strategies such as changing surname initials, using hyphenated surnames, or adding prefixes to improve their positioning in the author list of the article. These strategies, influenced by factors like the number of authors, country of origin, gender and whether the advantage is gained or not in positioning of author list, help mitigate the unfairness caused by alphabetization and positively contribute to authors’ citation statistics.","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"23 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141546473","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Which older publications are still highly cited in the field of bibliometrics? Contemporary bibliometric citation classics 在文献计量学领域，哪些旧出版物的引用率仍然很高？当代文献计量学引文经典

IF 3.9 3区管理学

Scientometrics Pub Date : 2024-07-05 DOI: 10.1007/s11192-024-05102-3

Li Li, Jiandong Zhang, Liying Yang, Ronald Rousseau

引用次数: 0

Journal self-citations trends in sport sciences: an analysis of disciplinary journals from 2013 to 2022 体育科学的期刊自引趋势：2013 至 2022 年学科期刊分析

IF 3.9 3区管理学

Scientometrics Pub Date : 2024-07-05 DOI: 10.1007/s11192-024-05096-y

Hunter Bennett, Ben Singh, Flynn Slattery

{"title":"Journal self-citations trends in sport sciences: an analysis of disciplinary journals from 2013 to 2022","authors":"Hunter Bennett, Ben Singh, Flynn Slattery","doi":"10.1007/s11192-024-05096-y","DOIUrl":"https://doi.org/10.1007/s11192-024-05096-y","url":null,"abstract":"This study reports on the yearly rate of journal self-citation (JSC) in sport sciences, how it changes over time, and its association with journal impact factor (JIF). Citations made by all 87 journals in “sport sciences” from 2013 to 2022 were extracted, as was their 2022 JIF. JSC rates were calculated using a Poisson distribution method. A mixed-effects negative binomial regression examined changes in yearly JSC rates over time. The association between average JSC rates and JIF were compared using a negative binomial regression. The median JSC rate was 6.3 self-citations per 100 citations. JSC rates are increasing in sport sciences by ~ 10% per year (incidence rate ratio [IRR] = 1.1, 95% CI 1.1–1.2; trivial effect). There was a significant negative association between JSC rate and JIF (IRR = 0.9, 95% CI 0.9, 1.0; trivial effect). Contrary to observations made in prior literature examining broader disciplines, the increasing JSC rate in sport sciences may be attributed to the growing maturity of this novel discipline. As sport-science topic areas become more established and appear in discipline specific journals, more JSCs may occur due to an increasing body of literature in these journals. The negative association between JSC rate and JIF may be due to specialized and less visible journals having a naturally lower JIF, as their impact is confined to a narrower field.","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"54 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141546474","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Impact as equalizer: the demise of gender-related differences in anti-doping research 作为均衡器的影响：反兴奋剂研究中与性别有关的差异的消亡

IF 3.9 3区管理学

Scientometrics Pub Date : 2024-06-29 DOI: 10.1007/s11192-024-05094-0

Anna Kiss, Sándor Soós, Andrea Petróczi

{"title":"Impact as equalizer: the demise of gender-related differences in anti-doping research","authors":"Anna Kiss, Sándor Soós, Andrea Petróczi","doi":"10.1007/s11192-024-05094-0","DOIUrl":"https://doi.org/10.1007/s11192-024-05094-0","url":null,"abstract":"In general, the presence and performance of women in science have increased significantly in recent decades. However, gender-related differences persist and remain a global phenomenon. Women make a greater contribution to multidisciplinary research, which renders anti-doping research a compelling area for investigating the gendered aspects of academic research. The research design was based on the overall research aim to investigate whether gender in a specific field (ADS) has an effect on different aspects of research impact, including (1) the size of citation impact obtained by the research output, (2) the impact on the development of the knowledge base of ADS, expressed as the capacity of integrating knowledge from different research areas, and (3) the (expected) type of research impact targeting either societal or scientific developments (or both). We used a previously compiled dataset of 1341 scientific outputs. Using regression analysis, we explored the role of authors’ gender in citations and the effect of authorship features on scientific impact. We employed network analysis and developed a novel indicator (LinkScore) to quantify gendered authors’ knowledge integration capacity. We carried out a content analysis on a subsample of 210 outputs to explore gender differences in research goal orientation as related to gender patterns. Women’s representation has been considerably extended in the domain of ADS throughout the last two decades. On average, outputs with female corresponding authors yield a higher average citation score. Regarding women's knowledge integration roles, we can infer that no substantial gender differences can be detected. Dominantly female papers were overrepresented among publications classified as aimed at scientific progress, while the share of male-authored papers was higher in publications classified as aimed at societal progress. Although no significant gender difference was observed in knowledge integration roles, in anti-doping women appear to be more interdisciplinary than men.","PeriodicalId":21755,"journal":{"name":"Scientometrics","volume":"160 1","pages":""},"PeriodicalIF":3.9,"publicationDate":"2024-06-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141504549","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0