Russell Seth Martins, Warda Ahmed, Mehak Barolia, Kostantinos Poulikidis, Joanna Weber, M Jawad Latif, Syed Shahzad Razi, Faiz Y Bhora
{"title":"Novel Journal Metrics in Cardiothoracic Surgery: How Different Are Contemporary Metrics From the Impact Factor?","authors":"Russell Seth Martins, Warda Ahmed, Mehak Barolia, Kostantinos Poulikidis, Joanna Weber, M Jawad Latif, Syed Shahzad Razi, Faiz Y Bhora","doi":"10.1177/15569845231225205","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Despite shortcomings, impact factor (IF) remains the \"gold standard\" metric for journal quality. However, novel metrics including the h-index, g-index, and Altmetric Attention Score (AAS; mentions in mainstream/social media) are gaining traction. We assessed correlations between these metrics among cardiothoracic surgery journals.</p><p><strong>Methods: </strong>For all cardiothoracic surgery journals with a 2021 Clarivate IF (<i>N</i> = 20), the 2-year IF (2019 to 2020) and 5-year IF (2016 to 2020), h-index, and g-index were obtained. Two-year journal-level AAS (2019 to 2020) was also calculated. Journal Twitter presence and activity was sourced from Twitter and the Twitter application programming interface. Correlations were assessed using Spearman correlation, and coefficients of determination were calculated.</p><p><strong>Results: </strong>IF demonstrated a moderate-strong positive correlation with the h-index (<i>r<sub>s</sub></i> = 0.48 to 0.77) and g-index (<i>r<sub>s</sub></i> = 0.49 to 0.79) and a moderate correlation with AAS (<i>r<sub>s</sub></i> = 0.53 to 0.58). The 2-year IF accounted for 25% to 49% of variability in the h-index, 27% to 55% of variability in the g-index, and 32% of variability in the AAS. Among journals with a Twitter account (<i>N</i> = 10), IF was strongly correlated with Twitter following (<i>r<sub>s</sub></i> = 0.81 to 0.86), which was in turn strongly correlated with journal AAS (<i>r<sub>s</sub></i> = 0.79). Article-level AAS was moderately correlated with citation count (<i>r<sub>s</sub></i> = 0.47).</p><p><strong>Conclusions: </strong>IF accounted for only between 25% and 55% of variability in the h-index and g-index, indicating that these newer metrics measure unique dimensions of citation-based impact. Thus, the academic community must familiarize itself with these newer journal metrics. Social media attention may be associated with scholarly impact, although further work is needed to understand these relationships.</p>","PeriodicalId":13574,"journal":{"name":"Innovations: Technology and Techniques in Cardiothoracic and Vascular Surgery","volume":" ","pages":"80-87"},"PeriodicalIF":1.6000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Innovations: Technology and Techniques in Cardiothoracic and Vascular Surgery","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/15569845231225205","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/2/12 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"SURGERY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: Despite shortcomings, impact factor (IF) remains the "gold standard" metric for journal quality. However, novel metrics including the h-index, g-index, and Altmetric Attention Score (AAS; mentions in mainstream/social media) are gaining traction. We assessed correlations between these metrics among cardiothoracic surgery journals.
Methods: For all cardiothoracic surgery journals with a 2021 Clarivate IF (N = 20), the 2-year IF (2019 to 2020) and 5-year IF (2016 to 2020), h-index, and g-index were obtained. Two-year journal-level AAS (2019 to 2020) was also calculated. Journal Twitter presence and activity was sourced from Twitter and the Twitter application programming interface. Correlations were assessed using Spearman correlation, and coefficients of determination were calculated.
Results: IF demonstrated a moderate-strong positive correlation with the h-index (rs = 0.48 to 0.77) and g-index (rs = 0.49 to 0.79) and a moderate correlation with AAS (rs = 0.53 to 0.58). The 2-year IF accounted for 25% to 49% of variability in the h-index, 27% to 55% of variability in the g-index, and 32% of variability in the AAS. Among journals with a Twitter account (N = 10), IF was strongly correlated with Twitter following (rs = 0.81 to 0.86), which was in turn strongly correlated with journal AAS (rs = 0.79). Article-level AAS was moderately correlated with citation count (rs = 0.47).
Conclusions: IF accounted for only between 25% and 55% of variability in the h-index and g-index, indicating that these newer metrics measure unique dimensions of citation-based impact. Thus, the academic community must familiarize itself with these newer journal metrics. Social media attention may be associated with scholarly impact, although further work is needed to understand these relationships.
期刊介绍:
Innovations: Technology and Techniques in Cardiothoracic and Vascular Surgery is the first journal whose main mission is to disseminate information specifically about advances in technology and techniques that lead to less invasive treatment of cardiothoracic and vascular disease. It delivers cutting edge original research, reviews, essays, case reports, and editorials from the pioneers and experts in the field of minimally invasive cardiothoracic and vascular disease, including biomedical engineers. Also included are papers presented at the annual ISMICS meeting. Official Journal of the International Society for Minimally Invasive Cardiothoracic Surgery