Assessing journals through a three-dimensional framework based on article citation, author and institution influence

IF 1.8 4区管理学 Q3 COMPUTER SCIENCE, INFORMATION SYSTEMS

Journal of Information Science Pub Date : 2024-03-26 DOI:10.1177/01655515241238401

Ziqiang Zeng, Cuicui Jia, Weiye Zhang, Xinyi Zhuang, Xuan Li

{"title":"Assessing journals through a three-dimensional framework based on article citation, author and institution influence","authors":"Ziqiang Zeng, Cuicui Jia, Weiye Zhang, Xinyi Zhuang, Xuan Li","doi":"10.1177/01655515241238401","DOIUrl":null,"url":null,"abstract":"Journal assessment is of great significance to promote the development of academic platforms. Citation analysis is a recognised tool to assess the citation performance of journals. However, due to the shortcomings such as the inflated Journal Impact Factor and heterogeneity of the citations, additional dimensions are necessary to be considered to balance with the article citation. This article constructs a three-dimensional journal assessment framework to measure the comprehensive influence of a journal based on article citation, author and institution influence. The CRITIC-Entropy weighting method is employed to calculate the weighted average scores for the three dimensions, respectively. Then, a newly defined Pareto-dominated set-based sum of TOPSIS score (PDS-based STS) approach is developed to assess the comprehensive influence of journals. A sample of 76 journals in Economics field is selected to demonstrate the effectiveness and validity of the proposed assessment method. The Chartered Association of Business Schools’ Academic Journal Guide 2021 (CABS-AJG 2021) which is an expert-based journal rating is chosen as a baseline model. It has been found that the assessment method using PDS-based STS shows a more rational journal ranking than that based on the Journal Impact Factor if using the CABS-AJG 2021’s ratings as the benchmark model.","PeriodicalId":54796,"journal":{"name":"Journal of Information Science","volume":"11 1","pages":""},"PeriodicalIF":1.8000,"publicationDate":"2024-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Information Science","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1177/01655515241238401","RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}

引用次数: 0

Abstract

Journal assessment is of great significance to promote the development of academic platforms. Citation analysis is a recognised tool to assess the citation performance of journals. However, due to the shortcomings such as the inflated Journal Impact Factor and heterogeneity of the citations, additional dimensions are necessary to be considered to balance with the article citation. This article constructs a three-dimensional journal assessment framework to measure the comprehensive influence of a journal based on article citation, author and institution influence. The CRITIC-Entropy weighting method is employed to calculate the weighted average scores for the three dimensions, respectively. Then, a newly defined Pareto-dominated set-based sum of TOPSIS score (PDS-based STS) approach is developed to assess the comprehensive influence of journals. A sample of 76 journals in Economics field is selected to demonstrate the effectiveness and validity of the proposed assessment method. The Chartered Association of Business Schools’ Academic Journal Guide 2021 (CABS-AJG 2021) which is an expert-based journal rating is chosen as a baseline model. It has been found that the assessment method using PDS-based STS shows a more rational journal ranking than that based on the Journal Impact Factor if using the CABS-AJG 2021’s ratings as the benchmark model.

查看原文本刊更多论文

通过基于文章引用、作者和机构影响力的三维框架评估期刊

期刊评估对促进学术平台的发展具有重要意义。引文分析是评估期刊引文绩效的公认工具。然而，由于期刊影响因子的虚高、引文的异质性等缺陷，需要考虑更多的维度来平衡文章引文。本文构建了一个三维期刊评估框架，基于文章引用、作者和机构影响力来衡量期刊的综合影响力。采用 CRITIC-Entropy 加权法分别计算三个维度的加权平均分。然后，开发了一种新定义的基于帕累托支配集的 TOPSIS 评分总和（基于 PDS 的 STS）方法来评估期刊的综合影响力。我们选取了经济学领域的 76 种期刊作为样本，以证明所提评估方法的有效性和有效性。此外，还选择了基于专家评级的《英国特许商学院协会 2021 年学术期刊指南》（CABS-AJG 2021）作为基线模型。结果发现，如果以 CABS-AJG 2021 的评级为基准模型，基于 PDS 的 STS 评估方法比基于期刊影响因子的期刊排名更合理。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Information Science 工程技术-计算机：信息系统

CiteScore

6.80

自引率

8.30%

发文量

121

审稿时长

4 months

期刊介绍： The Journal of Information Science is a peer-reviewed international journal of high repute covering topics of interest to all those researching and working in the sciences of information and knowledge management. The Editors welcome material on any aspect of information science theory, policy, application or practice that will advance thinking in the field.