Journal of Informetrics最新文献_第10页

Does the handling time of scientific papers relate to their academic impact and social attention? Evidence from Nature, Science, and PNAS 科学论文的处理时间与其学术影响力和社会关注度有关吗？来自《自然》、《科学》和《美国科学院院刊》的证据

IF 3.7 2区管理学

Journal of Informetrics Pub Date : 2024-02-08 DOI: 10.1016/j.joi.2024.101504

Yundong Xie , Qiang Wu , Yezhu Wang , Li Hou , Yuanyuan Liu

{"title":"Does the handling time of scientific papers relate to their academic impact and social attention? Evidence from Nature, Science, and PNAS","authors":"Yundong Xie , Qiang Wu , Yezhu Wang , Li Hou , Yuanyuan Liu","doi":"10.1016/j.joi.2024.101504","DOIUrl":"https://doi.org/10.1016/j.joi.2024.101504","url":null,"abstract":"<div><p>The time required for peer review is a crucial factor for researchers when deciding where to submit their manuscripts, as it is also considered an important predictor of paper impact. This paper analyses the handling time of academic papers at the individual paper level, focusing on three key indicators: editorial handling time, processing handling time, and total handling time. Unlike previous studies that primarily examined the simple correlation between handling time and academic impact of academic papers, this paper uses a negative binomial regression model to analyse the data while controlling for various factors related to total citations. Further, we explore the relationship between handling time and social attention. The dataset used in this study comprises 49,881 papers classified as ‘articles’ and published between 2011 and 2020 in three prestigious journals: <em>Nature, Science</em>, and <em>PNAS</em>. Our main findings reveal significant negative associations between the three measures of handling time and both impact and attention, except that processing handling time and attention have a significant positive relationship. Additionally, heterogeneity analyses indicate that these relationships are affected by the journal, subject, and affiliation. This empirical analysis of handling time's effect on academic impact and social attention expands upon the insights gained from previous research and may stimulate changes in some journal editorial policies to accelerate publishing speed.</p></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"18 2","pages":"Article 101504"},"PeriodicalIF":3.7,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139709390","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

“I'd like to publish in Q1, but there's no Q1 to be found”: Study of journal quartile distributions across subject categories and topics "我想在第一季度发表论文，但找不到第一季度"：跨学科类别和主题的期刊四分位分布研究

IF 3.7 2区管理学

Journal of Informetrics Pub Date : 2024-02-01 DOI: 10.1016/j.joi.2024.101494

Denis Kosyakov, Vladimir Pislyakov

{"title":"“I'd like to publish in Q1, but there's no Q1 to be found”: Study of journal quartile distributions across subject categories and topics","authors":"Denis Kosyakov, Vladimir Pislyakov","doi":"10.1016/j.joi.2024.101494","DOIUrl":"https://doi.org/10.1016/j.joi.2024.101494","url":null,"abstract":"<div><p>The choice to focus on a journal's impact factor, or its quartile, in authoritative rankings, when deciding where to publish research results can be driven by various reasons. These may include personal prestige, enhancing the appeal of a CV, the desire to increase publication-related rewards, meeting the conditions of scientific funds, or fulfilling qualification requirements. While these considerations deviate from the “pure science” perspective, the fact is that they are widely adopted. Our research demonstrates that the conventional division into journal quartiles may privilege certain disciplinary categories while disadvantaging others. Disciplinary categories in Journal Citation Reports (JCR) and similar rankings are imbalanced in terms of the number of articles across different journal quartiles. This is attributable to three factors: the distribution of journals across quartiles, the varying volume of journals, and the selection of the highest quartile when journals are categorized under multiple disciplines. Narrower research areas, such as Topic Clusters from SciVal, may completely lack Q1 journals dedicated to them, or even any such journals at all. This finding might also interest publishers when selecting topics for launching new titles. The apparent inequality between disciplines unveiled in our study offers a new perspective to argue against the use of quartile metrics, at least in a straightforward manner, when evaluating performance and shaping science policies.</p></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"18 1","pages":"Article 101494"},"PeriodicalIF":3.7,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1751157724000075/pdfft?md5=5fafe3bcb6e20fbbb05a743cdecbac42&pid=1-s2.0-S1751157724000075-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139654000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Rank analysis of most cited publications, a new approach for research assessments 对被引用次数最多的出版物进行排名分析，这是一种新的研究评估方法

IF 3.7 2区管理学

Journal of Informetrics Pub Date : 2024-02-01 DOI: 10.1016/j.joi.2024.101503

Alonso Rodríguez-Navarro , Ricardo Brito

{"title":"Rank analysis of most cited publications, a new approach for research assessments","authors":"Alonso Rodríguez-Navarro , Ricardo Brito","doi":"10.1016/j.joi.2024.101503","DOIUrl":"10.1016/j.joi.2024.101503","url":null,"abstract":"<div><p>Citation metrics are the best tools for research assessments. However, current metrics may be misleading in research systems that pursue simultaneously different goals, such as to push the boundaries of knowledge or incremental innovations, because their publications have different citation distributions. We estimate the contribution to the progress of knowledge by studying only a limited number of the most cited papers, which are dominated by publications pursuing this progress. To field-normalize the metrics, we substitute the number of citations by the rank position of papers from one country in the global list of papers. Using synthetic series of lognormally distributed numbers, simulating citations, we developed the <em>Rk-</em>index, which is calculated from the global ranks of the 10 highest numbers in each series, and demonstrate its equivalence to the number of papers in top percentiles, P<sub>top 0.1 %</sub> and P<sub>top 0.01 %</sub>. In real cases, the <em>Rk-</em>index is simple and easy to calculate, and evaluates the contribution to the progress of knowledge better than less stringent metrics. Although further research is needed, rank analysis of the most cited papers is a promising approach for research evaluation. It is also demonstrated that, for this purpose, domestic and collaborative papers should be studied independently.</p></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"18 2","pages":"Article 101503"},"PeriodicalIF":3.7,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1751157724000166/pdfft?md5=39c50d1041454d10d6b0530e48b2fe1c&pid=1-s2.0-S1751157724000166-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139662025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Assessing the stability of collaboration networks: A structural cohesion analysis perspective 评估协作网络的稳定性：结构凝聚力分析视角

IF 3.7 2区管理学

Journal of Informetrics Pub Date : 2024-02-01 DOI: 10.1016/j.joi.2024.101490

Dayong Zhang , Hao Men , Zhaoxin Zhang

{"title":"Assessing the stability of collaboration networks: A structural cohesion analysis perspective","authors":"Dayong Zhang , Hao Men , Zhaoxin Zhang","doi":"10.1016/j.joi.2024.101490","DOIUrl":"https://doi.org/10.1016/j.joi.2024.101490","url":null,"abstract":"<div><p>In collaboration networks, a stable structure can lead to trust and enhance group members’ ties, in turn reducing conflicts and promoting communication and cooperation. Therefore, network stability assessment, especially for collaboration networks, is essential for facilitating the achievement of group goals. However, most previous studies have considered only a fundamental understanding of network stability from the perspective of network connectivity or interpersonal relationships. Few studies have been conducted to reveal the influence of endogenous structural cohesion on network stability. In fact, greater structural cohesion indicates greater adaptability in uncertain environments. Thus, we propose evaluating the stability of collaboration networks from a structural cohesion perspective. Our study focuses on two dimensions of structural cohesion: core member identification and structural robustness measurements. Considering the unique structure of collaboration networks, a new algorithm, named the improved K-shell decomposition algorithm, is proposed to identify the core member set embedded in the innermost layer of a network. Compared with traditional identification algorithms, our algorithm can achieve a better trade-off between computational accuracy and computational complexity. Experimental results obtained on real-world networks verify the performance of our algorithm. In addition, it was found that the stability of collaboration networks can be effectively improved through targeted prevention efforts at the core members identified by our algorithm.</p></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"18 1","pages":"Article 101490"},"PeriodicalIF":3.7,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1751157724000038/pdfft?md5=10df3868fe122aadb2793b254dde7e62&pid=1-s2.0-S1751157724000038-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139654036","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Entropy, heterogeneity, and their impact on technology progress 熵、异质性及其对技术进步的影响

IF 3.7 2区管理学

Journal of Informetrics Pub Date : 2024-02-01 DOI: 10.1016/j.joi.2024.101506

Wonchang Hur

引用次数: 0

Textual features of peer review predict top-cited papers: An interpretable machine learning perspective 同行评审的文本特征可预测高被引论文：可解释的机器学习视角

IF 3.7 2区管理学

Journal of Informetrics Pub Date : 2024-01-25 DOI: 10.1016/j.joi.2024.101501

Zhuanlan Sun

{"title":"Textual features of peer review predict top-cited papers: An interpretable machine learning perspective","authors":"Zhuanlan Sun","doi":"10.1016/j.joi.2024.101501","DOIUrl":"10.1016/j.joi.2024.101501","url":null,"abstract":"<div><p>Peer review is crucial in improving the quality and reliability of scientific research. However, the mechanisms through which peer review practices ensure papers become top-cited papers (TCPs) after publication are not well understood. In this study, by collecting a data set containing 13, 066 papers published between 2016 and 2020 from <em>Nature communications</em> with open peer review reports, we aim to examine how textual features embedded within the peer review reports of papers that reflect the reviewers’ emotions may predict the papers to be TCPs. We compiled a list of 15 textual features and classified them into three categories: peer review features, linguistic features, and sentiment features. We then chose the XGBoost machine learning model with the best performance in predicting TCPs, and utilized the explainable artificial intelligence techniques SHAP to interpret the role of feature importance on the prediction results. The distribution of feature importance ranking results demonstrates that sentiment features play a crucial role in determining papers’ potential to be highly cited. This conclusion still holds, even when the ranking of the feature importance changes in the subgroup analysis of dividing the samples into four disciplines (biological sciences, health sciences, physical sciences, and earth and environmental sciences), as well as two groups based on whether reviewers’ identities were revealed. This research emphasizes the textual features retrieved from peer review reports that play role in improving manuscript quality can predict the post-publication research impact.</p></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"18 2","pages":"Article 101501"},"PeriodicalIF":3.7,"publicationDate":"2024-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139556966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Heterogeneity of national accounting systems, world-class universities and financial resources: What are the links? 国家会计制度、世界一流大学和财政资源的异质性：有哪些联系？

IF 3.7 2区管理学

Journal of Informetrics Pub Date : 2024-01-19 DOI: 10.1016/j.joi.2024.101502

Alessandro Avenali , Cinzia Daraio , Simone Di Leo , Joanna Wolszczak-Derlacz

{"title":"Heterogeneity of national accounting systems, world-class universities and financial resources: What are the links?","authors":"Alessandro Avenali , Cinzia Daraio , Simone Di Leo , Joanna Wolszczak-Derlacz","doi":"10.1016/j.joi.2024.101502","DOIUrl":"https://doi.org/10.1016/j.joi.2024.101502","url":null,"abstract":"<div><p>This study investigates the relationship between university financial resources, applied accounting systems, and the place of a university in the Shanghai Ranking. We find a strong relationship between the financial resources under the control of a world-class university and the position of that university in the highest tier of the global ranking. We propose a model (available online) to predict a university's tier in the ranking through the financial resources it employs. A critical condition for making a university a world-class university could be to provide it with a sufficiently high level of financial resources, and its efficiency could play an important leverage role. In view of the results, policymakers are challenged with a drastic choice: to increase international competition among universities, it is necessary to concentrate a huge amount of resources on a few universities that are already in the ranking. In contrast, the policy of the proportional distribution of resources does not affect international competition and may be inefficient. Furthermore, financial data are not easy to gather homogeneously for universities across countries, due to the existence of different national accounting systems. Finally, we discuss several critical issues associated with the measurement of specific accounting data of universities.</p></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"18 2","pages":"Article 101502"},"PeriodicalIF":3.7,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1751157724000154/pdfft?md5=42c3132e05a5cfcca0ac2049e278fa26&pid=1-s2.0-S1751157724000154-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139503503","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Validity and bias of indicators of international collaboration: A theoretical analysis with an empirical study of Ukraine-Russia-United States and China-United States 国际合作指标的有效性和偏差：理论分析与乌克兰-俄罗斯-美国和中国-美国的实证研究

IF 3.7 2区管理学

Journal of Informetrics Pub Date : 2024-01-18 DOI: 10.1016/j.joi.2024.101488

Lawrence Smolinsky , Seungwon Yang

{"title":"Validity and bias of indicators of international collaboration: A theoretical analysis with an empirical study of Ukraine-Russia-United States and China-United States","authors":"Lawrence Smolinsky , Seungwon Yang","doi":"10.1016/j.joi.2024.101488","DOIUrl":"https://doi.org/10.1016/j.joi.2024.101488","url":null,"abstract":"<div><p>We examine three indicators that give a relative measure of collaborations between countries and introduce a fourth indicator. Of the three established indicators, the Asymmetric Observed to Expected Ratio (AOER-indicator) and the symmetric Observed to Expected Ratio (OER-indicator) have received criticism for some specific theoretical situations. The AOER fails as both a meaningful statistic and an indicator. The OER is a meaningful statistic but fails as an indicator. The Relative Intensity of Collaboration (RIC-indicator) is relatively recent measure that is a meaningful standard statistic and passes Rousseau's criterion for an indicator. The new indicator is the Odds Ratio of Collaboration (ORC-indicator). It is a symmetric and meaningful standard statistic that passes Rousseau's criterion for an indicator. We give interpretations for all four indicators to give a systematic comparison that recommends the RIC and ORC. We then compare them in analyzing some specific dynamic developments over a 20-year period: The Ukraine-Russia-United States relationship and the China-United States relationship. We believe the analysis illustrates the value of the RIC, the inadequacies of the AOER, and is interesting analysis of its own accord.</p></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"18 1","pages":"Article 101488"},"PeriodicalIF":3.7,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1751157724000014/pdfft?md5=8614819ffa8bfa67186cf5d23b440dd5&pid=1-s2.0-S1751157724000014-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139487081","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Dubious cross-national affiliations obscure the assessment of international research collaboration 可疑的跨国隶属关系模糊了对国际研究合作的评估

IF 3.7 2区管理学

Journal of Informetrics Pub Date : 2024-01-18 DOI: 10.1016/j.joi.2024.101496

Chung-Huei Kuan , Dar-Zen Chen , Mu-Hsuan Huang

{"title":"Dubious cross-national affiliations obscure the assessment of international research collaboration","authors":"Chung-Huei Kuan , Dar-Zen Chen , Mu-Hsuan Huang","doi":"10.1016/j.joi.2024.101496","DOIUrl":"https://doi.org/10.1016/j.joi.2024.101496","url":null,"abstract":"<div><p>Assessing international research collaboration through cross-national papers is a common practice but may be compromised by dubious affiliations lacking clear evidence of substantial collaboration. In this study, we analyze cross-national papers indexed in SCIE, SSCI, and A&HCI databases, published between 2012 and 2021, and affiliated respectively with pairs of four nations: the US, China, the United Kingdom, and Australia. Our findings reveal that at least 27 % of them exhibit dubious affiliations, with the proportion potentially rising above 60 % in SCIE papers between the United Kingdom and Australia. This underscores the need to address the potential impact of these papers. We also find that academic practice, cultural proximity, and geopolitical tension have affected the prevalence of different types of dubious affiliations across disciplinary categories and nation pairs. Moreover, papers with dubious affiliations are more prevalent in collaborations among Western nations compared to those involving China. A particular type of dubious affiliations, known as Solo Show, is especially pronounced between the US and China, highlighting the distinctive nature of their pattern of collaboration.</p></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"18 2","pages":"Article 101496"},"PeriodicalIF":3.7,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139487887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Gini-stable Lorenz curves and their relation to the generalised Pareto distribution 吉尼稳定洛伦兹曲线及其与广义帕累托分布的关系

IF 3.7 2区管理学

Journal of Informetrics Pub Date : 2024-01-15 DOI: 10.1016/j.joi.2024.101499

Lucio Bertoli-Barsotti , Marek Gagolewski , Grzegorz Siudem , Barbara Żogała-Siudem

{"title":"Gini-stable Lorenz curves and their relation to the generalised Pareto distribution","authors":"Lucio Bertoli-Barsotti , Marek Gagolewski , Grzegorz Siudem , Barbara Żogała-Siudem","doi":"10.1016/j.joi.2024.101499","DOIUrl":"10.1016/j.joi.2024.101499","url":null,"abstract":"<div><p>We introduce an iterative discrete information production process where we can extend ordered normalised vectors by new elements based on a simple affine transformation, while preserving the predefined level of inequality, G, as measured by the Gini index.</p><p>Then, we derive the family of empirical Lorenz curves of the corresponding vectors and prove that it is stochastically ordered with respect to both the sample size and G which plays the role of the uncertainty parameter. We prove that asymptotically, we obtain all, and only, Lorenz curves generated by a new, intuitive parametrisation of the finite-mean Pickands' Generalised Pareto Distribution (GPD) that unifies three other families, namely: the Pareto Type II, exponential, and scaled beta distributions. The family is not only totally ordered with respect to the parameter G, but also, thanks to our derivations, has a nice underlying interpretation. Our result may thus shed a new light on the genesis of this family of distributions.</p><p>Our model fits bibliometric, informetric, socioeconomic, and environmental data reasonably well. It is quite user-friendly for it only depends on the sample size and its Gini index.</p></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"18 2","pages":"Article 101499"},"PeriodicalIF":3.7,"publicationDate":"2024-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1751157724000129/pdfft?md5=dc3ea80602e26180d550c3dbba8478fc&pid=1-s2.0-S1751157724000129-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139470044","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0