{"title":"衡量主题层面期刊影响力:JNIln(z)系列指标","authors":"Siluo Yang , Zhiling Chen","doi":"10.1016/j.joi.2025.101701","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate assessment of journal impact is essential for informing and guiding journal development. Existing journal normalized impact indicators are predominantly constructed at the field level. With increasing interdisciplinary integration and blurred disciplinary boundaries, the growing diversity of topics has rendered field-level normalized indicators insufficient for fine-grained journal impact evaluation. To address this, we previously proposed the Journal Normalized Impact (<em>JNI</em>), a topic-level normalized indicator that integrates topic modeling and citation data. However, <em>JNI</em> has limitations in topic clustering, the rationality of its calculation, and topic-level impact interpretation. This study proposes an improved framework and develops the <span><math><mi>J</mi><mi>N</mi><msub><mrow><mi>I</mi></mrow><mrow><mi>l</mi><mi>n</mi><mo>(</mo><mi>z</mi><mo>)</mo></mrow></msub></math></span> series indicators, employing in-depth semantic topic modeling approach with z-score normalization and applying a “filter-classify-unify normalization” approach to ensure the robustness and interpretability of impact measurement. Empirical analysis confirms that the <span><math><mi>J</mi><mi>N</mi><msub><mrow><mi>I</mi></mrow><mrow><mi>l</mi><mi>n</mi><mo>(</mo><mi>z</mi><mo>)</mo></mrow></msub></math></span> indicators effectively capture both overall and topic-specific journal impact. Compared to previous indicators, the <span><math><mi>J</mi><mi>N</mi><msub><mrow><mi>I</mi></mrow><mrow><mi>l</mi><mi>n</mi><mo>(</mo><mi>z</mi><mo>)</mo></mrow></msub></math></span> indicators improve evaluative precision, offer more robust and stable measurements, and reveal more nuanced topic-level insights. We hope this study provides a foundation for refined, topic-based journal evaluation and contributes to more accurate and reliable research assessment.</div></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"19 3","pages":"Article 101701"},"PeriodicalIF":3.4000,"publicationDate":"2025-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Measuring the topic-level journal impact: JNIln(z) series indicators\",\"authors\":\"Siluo Yang , Zhiling Chen\",\"doi\":\"10.1016/j.joi.2025.101701\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Accurate assessment of journal impact is essential for informing and guiding journal development. Existing journal normalized impact indicators are predominantly constructed at the field level. With increasing interdisciplinary integration and blurred disciplinary boundaries, the growing diversity of topics has rendered field-level normalized indicators insufficient for fine-grained journal impact evaluation. To address this, we previously proposed the Journal Normalized Impact (<em>JNI</em>), a topic-level normalized indicator that integrates topic modeling and citation data. However, <em>JNI</em> has limitations in topic clustering, the rationality of its calculation, and topic-level impact interpretation. This study proposes an improved framework and develops the <span><math><mi>J</mi><mi>N</mi><msub><mrow><mi>I</mi></mrow><mrow><mi>l</mi><mi>n</mi><mo>(</mo><mi>z</mi><mo>)</mo></mrow></msub></math></span> series indicators, employing in-depth semantic topic modeling approach with z-score normalization and applying a “filter-classify-unify normalization” approach to ensure the robustness and interpretability of impact measurement. Empirical analysis confirms that the <span><math><mi>J</mi><mi>N</mi><msub><mrow><mi>I</mi></mrow><mrow><mi>l</mi><mi>n</mi><mo>(</mo><mi>z</mi><mo>)</mo></mrow></msub></math></span> indicators effectively capture both overall and topic-specific journal impact. Compared to previous indicators, the <span><math><mi>J</mi><mi>N</mi><msub><mrow><mi>I</mi></mrow><mrow><mi>l</mi><mi>n</mi><mo>(</mo><mi>z</mi><mo>)</mo></mrow></msub></math></span> indicators improve evaluative precision, offer more robust and stable measurements, and reveal more nuanced topic-level insights. We hope this study provides a foundation for refined, topic-based journal evaluation and contributes to more accurate and reliable research assessment.</div></div>\",\"PeriodicalId\":48662,\"journal\":{\"name\":\"Journal of Informetrics\",\"volume\":\"19 3\",\"pages\":\"Article 101701\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2025-06-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Informetrics\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1751157725000653\",\"RegionNum\":2,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Informetrics","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1751157725000653","RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
Measuring the topic-level journal impact: JNIln(z) series indicators
Accurate assessment of journal impact is essential for informing and guiding journal development. Existing journal normalized impact indicators are predominantly constructed at the field level. With increasing interdisciplinary integration and blurred disciplinary boundaries, the growing diversity of topics has rendered field-level normalized indicators insufficient for fine-grained journal impact evaluation. To address this, we previously proposed the Journal Normalized Impact (JNI), a topic-level normalized indicator that integrates topic modeling and citation data. However, JNI has limitations in topic clustering, the rationality of its calculation, and topic-level impact interpretation. This study proposes an improved framework and develops the series indicators, employing in-depth semantic topic modeling approach with z-score normalization and applying a “filter-classify-unify normalization” approach to ensure the robustness and interpretability of impact measurement. Empirical analysis confirms that the indicators effectively capture both overall and topic-specific journal impact. Compared to previous indicators, the indicators improve evaluative precision, offer more robust and stable measurements, and reveal more nuanced topic-level insights. We hope this study provides a foundation for refined, topic-based journal evaluation and contributes to more accurate and reliable research assessment.
期刊介绍:
Journal of Informetrics (JOI) publishes rigorous high-quality research on quantitative aspects of information science. The main focus of the journal is on topics in bibliometrics, scientometrics, webometrics, patentometrics, altmetrics and research evaluation. Contributions studying informetric problems using methods from other quantitative fields, such as mathematics, statistics, computer science, economics and econometrics, and network science, are especially encouraged. JOI publishes both theoretical and empirical work. In general, case studies, for instance a bibliometric analysis focusing on a specific research field or a specific country, are not considered suitable for publication in JOI, unless they contain innovative methodological elements.