‘Not everything that can be counted counts, and not everything that counts can be counted’: Searching for the value of metrics and altmetrics in sociology of sport journals
IF 2.5 3区 教育学Q2 HOSPITALITY, LEISURE, SPORT & TOURISM
{"title":"‘Not everything that can be counted counts, and not everything that counts can be counted’: Searching for the value of metrics and altmetrics in sociology of sport journals","authors":"Rebecca Olive, Stephen Townsend, M. Phillips","doi":"10.1177/10126902221107467","DOIUrl":null,"url":null,"abstract":"Metrics, and increasingly altmetrics, are a pervasive aspect of academic life. A proliferation of digital tools available have seen greater emphasis on the quantification of the ‘performance’ of individual journals. Although metrics and altmetrics are justified in terms of increased accountability and transparency, there are significant inequities in the ways they are deployed. Key among these is the unsuitability of many popular metrics for assessing publications in the humanities and social sciences, as the data, algorithms and systems which support them cater to authorship and citation practices of the various science, technology, engineering and mathematics (STEM) disciplines. These issues are amplified for journals in the sociology of sport, which publish research by humanities and social science scholars whose work is quantified according to the standards of the health science departments in which they frequently work. In this discussion, we critically examine how common forms of metrics and altmetrics, including those produced by Web of Science, Scopus, Google Scholar, and Altmetric.com, are applied to available sociology of sport journals. We analyse and critique how different metric algorithms produce variable measures of performance for each of the journals in the field and reveal how other information available on these databases can augment our understanding of the sociology of sport publishing ecology. Far from advocating the value of metrics and altmetrics, our analysis is intended to arm scholars and journals with the information required to critically navigate the entanglement of metrics and altmetrics with neoliberalism, audit culture and digital technologies in universities.","PeriodicalId":47968,"journal":{"name":"International Review for the Sociology of Sport","volume":"58 1","pages":"431 - 454"},"PeriodicalIF":2.5000,"publicationDate":"2022-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Review for the Sociology of Sport","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1177/10126902221107467","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"HOSPITALITY, LEISURE, SPORT & TOURISM","Score":null,"Total":0}
引用次数: 6
Abstract
Metrics, and increasingly altmetrics, are a pervasive aspect of academic life. A proliferation of digital tools available have seen greater emphasis on the quantification of the ‘performance’ of individual journals. Although metrics and altmetrics are justified in terms of increased accountability and transparency, there are significant inequities in the ways they are deployed. Key among these is the unsuitability of many popular metrics for assessing publications in the humanities and social sciences, as the data, algorithms and systems which support them cater to authorship and citation practices of the various science, technology, engineering and mathematics (STEM) disciplines. These issues are amplified for journals in the sociology of sport, which publish research by humanities and social science scholars whose work is quantified according to the standards of the health science departments in which they frequently work. In this discussion, we critically examine how common forms of metrics and altmetrics, including those produced by Web of Science, Scopus, Google Scholar, and Altmetric.com, are applied to available sociology of sport journals. We analyse and critique how different metric algorithms produce variable measures of performance for each of the journals in the field and reveal how other information available on these databases can augment our understanding of the sociology of sport publishing ecology. Far from advocating the value of metrics and altmetrics, our analysis is intended to arm scholars and journals with the information required to critically navigate the entanglement of metrics and altmetrics with neoliberalism, audit culture and digital technologies in universities.
度量,以及越来越多的altmetrics,是学术生活中普遍存在的一个方面。随着可用数字工具的激增,人们更加重视对个别期刊“表现”的量化。尽管指标和替代指标在提高问责制和透明度方面是合理的,但它们的部署方式存在严重的不公平。其中的关键是,许多流行的指标不适合评估人文和社会科学领域的出版物,因为支持这些出版物的数据、算法和系统迎合了各种科学、技术、工程和数学(STEM)学科的作者和引用实践。这些问题在体育社会学杂志上得到了放大,这些杂志发表了人文和社会科学学者的研究,他们的工作根据他们经常工作的卫生科学部门的标准进行量化。在这场讨论中,我们批判性地研究了常见形式的指标和altmetrics,包括由Web of Science、Scopus、Google Scholar和Altmetric.com制作的指标和altmetrics,是如何应用于现有的体育社会学期刊的。我们分析和批评了不同的度量算法如何为该领域的每一种期刊产生不同的绩效指标,并揭示了这些数据库中的其他可用信息如何增强我们对体育出版生态社会学的理解。我们的分析远没有提倡指标和替代指标的价值,而是旨在为学者和期刊提供所需的信息,以批判性地处理指标和替代标准与大学新自由主义、审计文化和数字技术的纠缠。
期刊介绍:
The International Review for the Sociology of Sport is a peer reviewed academic journal that is indexed on ISI. Eight issues are now published each year. The main purpose of the IRSS is to disseminate research and scholarship on sport throughout the international academic community. The journal publishes research articles of varying lengths, from standard length research papers to shorter reports and commentary, as well as book and media reviews. The International Review for the Sociology of Sport is not restricted to any theoretical or methodological perspective and brings together contributions from anthropology, cultural studies, geography, gender studies, media studies, history, political economy, semiotics, sociology, as well as interdisciplinary research.