Validity and bias of indicators of international collaboration: A theoretical analysis with an empirical study of Ukraine-Russia-United States and China-United States

IF 3.4 2区管理学 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS

Journal of Informetrics Pub Date : 2024-01-18 DOI:10.1016/j.joi.2024.101488

Lawrence Smolinsky , Seungwon Yang

{"title":"Validity and bias of indicators of international collaboration: A theoretical analysis with an empirical study of Ukraine-Russia-United States and China-United States","authors":"Lawrence Smolinsky , Seungwon Yang","doi":"10.1016/j.joi.2024.101488","DOIUrl":null,"url":null,"abstract":"<div><p>We examine three indicators that give a relative measure of collaborations between countries and introduce a fourth indicator. Of the three established indicators, the Asymmetric Observed to Expected Ratio (AOER-indicator) and the symmetric Observed to Expected Ratio (OER-indicator) have received criticism for some specific theoretical situations. The AOER fails as both a meaningful statistic and an indicator. The OER is a meaningful statistic but fails as an indicator. The Relative Intensity of Collaboration (RIC-indicator) is relatively recent measure that is a meaningful standard statistic and passes Rousseau's criterion for an indicator. The new indicator is the Odds Ratio of Collaboration (ORC-indicator). It is a symmetric and meaningful standard statistic that passes Rousseau's criterion for an indicator. We give interpretations for all four indicators to give a systematic comparison that recommends the RIC and ORC. We then compare them in analyzing some specific dynamic developments over a 20-year period: The Ukraine-Russia-United States relationship and the China-United States relationship. We believe the analysis illustrates the value of the RIC, the inadequacies of the AOER, and is interesting analysis of its own accord.</p></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"18 1","pages":"Article 101488"},"PeriodicalIF":3.4000,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1751157724000014/pdfft?md5=8614819ffa8bfa67186cf5d23b440dd5&pid=1-s2.0-S1751157724000014-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Informetrics","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1751157724000014","RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}

引用次数: 0

Abstract

We examine three indicators that give a relative measure of collaborations between countries and introduce a fourth indicator. Of the three established indicators, the Asymmetric Observed to Expected Ratio (AOER-indicator) and the symmetric Observed to Expected Ratio (OER-indicator) have received criticism for some specific theoretical situations. The AOER fails as both a meaningful statistic and an indicator. The OER is a meaningful statistic but fails as an indicator. The Relative Intensity of Collaboration (RIC-indicator) is relatively recent measure that is a meaningful standard statistic and passes Rousseau's criterion for an indicator. The new indicator is the Odds Ratio of Collaboration (ORC-indicator). It is a symmetric and meaningful standard statistic that passes Rousseau's criterion for an indicator. We give interpretations for all four indicators to give a systematic comparison that recommends the RIC and ORC. We then compare them in analyzing some specific dynamic developments over a 20-year period: The Ukraine-Russia-United States relationship and the China-United States relationship. We believe the analysis illustrates the value of the RIC, the inadequacies of the AOER, and is interesting analysis of its own accord.

查看原文本刊更多论文

国际合作指标的有效性和偏差：理论分析与乌克兰-俄罗斯-美国和中国-美国的实证研究

我们研究了可以相对衡量国家间合作的三个指标，并引入了第四个指标。在这三个既定指标中，非对称观测值与期望值之比（AOER-指标）和对称观测值与期望值之比（OER-指标）因某些特定的理论情况而受到批评。AOER 既不是一个有意义的统计量，也不是一个指标。OER 是一个有意义的统计量，但不能作为一个指标。合作的相对强度（RIC 指标）是一个相对较新的指标，它是一个有意义的标准统计量，并通过了卢梭的指标标准。新指标是合作几率比（ORC-指标）。这是一个对称的、有意义的标准统计量，符合卢梭的指标标准。我们对所有四个指标都进行了解释，并推荐使用 RIC 和 ORC 进行系统比较。然后，我们在分析 20 年间的一些具体动态发展时对它们进行比较：乌克兰-俄罗斯-美国关系和中国-美国关系。我们认为，这些分析说明了《国际收支手册》的价值和《国际收支和汇率手册》的不足，其本身也是一项有趣的分析。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Informetrics Social Sciences-Library and Information Sciences

CiteScore

6.40

自引率

16.20%

发文量

期刊介绍： Journal of Informetrics (JOI) publishes rigorous high-quality research on quantitative aspects of information science. The main focus of the journal is on topics in bibliometrics, scientometrics, webometrics, patentometrics, altmetrics and research evaluation. Contributions studying informetric problems using methods from other quantitative fields, such as mathematics, statistics, computer science, economics and econometrics, and network science, are especially encouraged. JOI publishes both theoretical and empirical work. In general, case studies, for instance a bibliometric analysis focusing on a specific research field or a specific country, are not considered suitable for publication in JOI, unless they contain innovative methodological elements.