Quantitative Science Studies最新文献_第5页

Can the presence of an author photograph and biography have an impact on article citations? The case of chemistry and chemical engineering 作者照片和传记的出现会对文章引用产生影响吗？化学与化学工程案例

IF 6.4

Quantitative Science Studies Pub Date : 2022-10-10 DOI: 10.1162/qss_a_00219

T. Dehdarirad

{"title":"Can the presence of an author photograph and biography have an impact on article citations? The case of chemistry and chemical engineering","authors":"T. Dehdarirad","doi":"10.1162/qss_a_00219","DOIUrl":"https://doi.org/10.1162/qss_a_00219","url":null,"abstract":"Abstract The aim of this study was to investigate whether the presence of an author photograph and biography in scientific articles could have an impact on article citations. The impact of a photograph and biography, in combination with certain author characteristics (i.e., gender, affiliation country (measured as whether the author was affiliated with a high-income country or not), and scientific impact (measured as whether the author was a high-impact author or not)), was also examined, while controlling for several covariates. This study focused on a sample of articles published in the time span of 2016–2018 in chemistry and chemical engineering journals by Elsevier. The articles were downloaded from Scopus. The analysis was done using random effects within-between model analyses. Within authors, the results showed no significant impact of author photograph and biography on citations. Different patterns were found for visibility of articles when the presence of an author photograph and biography was combined with author characteristics. While being affiliated to a high-income country and being a high-impact author had a positive impact on citations, gender (female) had a negative impact. For gender, there was a small citation disadvantage of 5% for female authors when they provided a photograph and biography.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"1024-1039"},"PeriodicalIF":6.4,"publicationDate":"2022-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44068143","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Improving overlay maps of science: Combining overview and detail 改进科学覆盖图:结合概览和细节

IF 6.4

Quantitative Science Studies Pub Date : 2022-10-10 DOI: 10.1162/qss_a_00216

Peter Sjögårde

{"title":"Improving overlay maps of science: Combining overview and detail","authors":"Peter Sjögårde","doi":"10.1162/qss_a_00216","DOIUrl":"https://doi.org/10.1162/qss_a_00216","url":null,"abstract":"Abstract Overlay maps of science are global base maps over which subsets of publications can be projected. Such maps can be used to monitor, explore, and study research through its publication output. Most maps of science, including overlay maps, are flat in the sense that they visualize research fields at one single level. Such maps generally fail to provide both overview and detail about the research being analyzed. The aim of this study is to improve overlay maps of science to provide both features in a single visualization. I created a map based on a hierarchical classification of publications, including broad disciplines for overview and more granular levels to incorporate detailed information. The classification was obtained by clustering articles in a citation network of about 17 million publication records in PubMed from 1995 onwards. The map emphasizes the hierarchical structure of the classification by visualizing both disciplines and the underlying specialties. To show how the visualization methodology can help getting both an overview of research and detailed information about its topical structure, I studied two cases: coronavirus/Covid-19 research and the university alliance called Stockholm Trio.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"1097-1118"},"PeriodicalIF":6.4,"publicationDate":"2022-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42402120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Know thy tools! Limits of popular algorithms used for topic reconstruction 了解你的工具!主题重构常用算法的局限性

IF 6.4

Quantitative Science Studies Pub Date : 2022-10-10 DOI: 10.1162/qss_a_00217

Matthias Held

引用次数: 2

Researchers and their data: A study based on the use of the word data in scholarly articles 研究人员和他们的数据:一项基于学术文章中数据一词使用的研究

IF 6.4

Quantitative Science Studies Pub Date : 2022-10-10 DOI: 10.1162/qss_a_00220

Frédérique Bordignon, M. Maisonobe

{"title":"Researchers and their data: A study based on the use of the word data in scholarly articles","authors":"Frédérique Bordignon, M. Maisonobe","doi":"10.1162/qss_a_00220","DOIUrl":"https://doi.org/10.1162/qss_a_00220","url":null,"abstract":"Abstract Data is one of the most used terms in scientific vocabulary. This article focuses on the relationship between data and research by analyzing the contexts of occurrence of the word data in a corpus of 72,471 research articles (1980–2012) from two distinct fields (Social sciences, Physical sciences). The aim is to shed light on the issues raised by research on data, namely the difficulty of defining what is considered as data, the transformations that data undergo during the research process, and how they gain value for researchers who hold them. Relying on the distribution of occurrences throughout the texts and over time, it demonstrates that the word data mostly occurs at the beginning and end of research articles. Adjectives and verbs accompanying the noun data turn out to be even more important than data itself in specifying data. The increase in the use of possessive pronouns at the end of the articles reveals that authors tend to claim ownership of their data at the very end of the research process. Our research demonstrates that even if data-handling operations are increasingly frequent, they are still described with imprecise verbs that do not reflect the complexity of these transformations.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"1156-1178"},"PeriodicalIF":6.4,"publicationDate":"2022-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41655642","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Assessing the quality of bibliographic data sources for measuring international research collaboration 评估衡量国际研究合作的书目数据来源的质量

IF 6.4

Quantitative Science Studies Pub Date : 2022-09-12 DOI: 10.1162/qss_a_00211

B. Nguyen, Markus Luczak-Rösch, J. Dinneen, V. Larivière

{"title":"Assessing the quality of bibliographic data sources for measuring international research collaboration","authors":"B. Nguyen, Markus Luczak-Rösch, J. Dinneen, V. Larivière","doi":"10.1162/qss_a_00211","DOIUrl":"https://doi.org/10.1162/qss_a_00211","url":null,"abstract":"Abstract Measuring international research collaboration (IRC) is essential to various research assessment tasks but the effect of various measurement decisions, including which data sources to use, has not been thoroughly studied. To better understand the effect of data source choice on IRC measurement, we design and implement a data quality assessment framework specifically for bibliographic data by reviewing and selecting available dimensions and designing appropriate computable metrics, and then validate the framework by applying it to four popular sources of bibliographic data: Microsoft Academic Graph, Web of Science (WoS), Dimensions, and the ACM Digital Library. Successful validation of the framework suggests it is consistent with the popular conceptual framework of information quality proposed by Wang and Strong (1996) and adequately identifies the differences in quality in the sources examined. Application of the framework reveals that WoS has the highest overall quality among the sets considered; and that the differences in quality can be explained primarily by how the data sources are organized. Our study comprises a methodological contribution that enables researchers to apply this IRC measurement tool in their studies and makes an empirical contribution by further characterizing four popular sources of bibliographic data and their impact on IRC measurement.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"529-559"},"PeriodicalIF":6.4,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48703990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

How reliable are unsupervised author disambiguation algorithms in the assessment of research organization performance? 在评估研究机构绩效时，无监督作者消歧算法的可靠性如何?

IF 6.4

Quantitative Science Studies Pub Date : 2022-09-07 DOI: 10.1162/qss_a_00236

G. Abramo, Ciriaco Andrea D’Angelo

{"title":"How reliable are unsupervised author disambiguation algorithms in the assessment of research organization performance?","authors":"G. Abramo, Ciriaco Andrea D’Angelo","doi":"10.1162/qss_a_00236","DOIUrl":"https://doi.org/10.1162/qss_a_00236","url":null,"abstract":"Abstract Assessing the performance of universities by output to input indicators requires knowledge of the individual researchers working within them. Although in Italy the Ministry of University and Research updates a database of university professors, in all those countries where such databases are not available, measuring research performance is a formidable task. One possibility is to trace the research personnel of institutions indirectly through their publications, using bibliographic repertories together with author names disambiguation algorithms. This work evaluates the goodness-of-fit of the Caron and van Eck, CvE unsupervised algorithm by comparing the research performance of Italian universities resulting from its application for the derivation of the universities’ research staff, with that resulting from the supervised algorithm of D’Angelo, Giuffrida, and Abramo (2011), which avails of input data. Results show that the CvE algorithm overestimates the size of the research staff of organizations by 56%. Nonetheless, the performance scores and ranks recorded in the two compared modes show a significant and high correlation. Still, nine out of 69 universities show rank deviations of two quartiles. Measuring the extent of distortions inherent in any evaluation exercises using unsupervised algorithms, can inform policymakers’ decisions on building national research staff databases, instead of settling for the unsupervised approaches.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"4 1","pages":"144-166"},"PeriodicalIF":6.4,"publicationDate":"2022-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45627516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Recategorising research: Mapping from FoR 2008 to FoR 2020 in Dimensions 重新分类研究：从2008年系列到2020年系列的维度映射

IF 6.4

Quantitative Science Studies Pub Date : 2022-08-31 DOI: 10.1162/qss_a_00244

Simon Porter, Daniel W. Hook

引用次数: 3

Peer reviewer topic choice and its impact on interrater reliability: A mixed-method study 同行评议主题选择及其对评议可信度的影响:一项混合方法研究

IF 6.4

Quantitative Science Studies Pub Date : 2022-08-25 DOI: 10.1162/qss_a_00207

Thomas Feliciani, Junwen Luo, K. Shankar

{"title":"Peer reviewer topic choice and its impact on interrater reliability: A mixed-method study","authors":"Thomas Feliciani, Junwen Luo, K. Shankar","doi":"10.1162/qss_a_00207","DOIUrl":"https://doi.org/10.1162/qss_a_00207","url":null,"abstract":"Abstract One of the main critiques of academic peer review is that interrater reliability (IRR) among reviewers is low. We examine an underinvestigated factor possibly contributing to low IRR: reviewers’ diversity in their topic-criteria mapping (“TC-mapping”). It refers to differences among reviewers pertaining to which topics they choose to emphasize in their evaluations, and how they map those topics onto various evaluation criteria. In this paper we look at the review process of grant proposals in one funding agency to ask: How much do reviewers differ in TC-mapping, and do their differences contribute to low IRR? Through a content analysis of review forms submitted to a national funding agency (Science Foundation Ireland) and a survey of its reviewers, we find evidence of interreviewer differences in their TC-mapping. Using a simulation experiment we show that, under a wide range of conditions, even strong differences in TC-mapping have only a negligible impact on IRR. Although further empirical work is needed to corroborate simulation results, these tentatively suggest that reviewers’ heterogeneous TC-mappings might not be of concern for designers of peer review panels to safeguard IRR.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"832-856"},"PeriodicalIF":6.4,"publicationDate":"2022-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45723631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

An open data set of scholars on Twitter 推特上学者的开放数据集

IF 6.4

Quantitative Science Studies Pub Date : 2022-08-23 DOI: 10.1162/qss_a_00250

P. Mongeon, T. Bowman, R. Costas

引用次数: 5

Visualizing academic descendants using modified Pavlo diagrams: Results based on five researchers in biomechanics and biomedicine 使用修改的Pavlo图可视化学术后代:基于生物力学和生物医学五位研究人员的结果

IF 6.4

Quantitative Science Studies Pub Date : 2022-08-20 DOI: 10.1162/qss_a_00205

W. Lievers

{"title":"Visualizing academic descendants using modified Pavlo diagrams: Results based on five researchers in biomechanics and biomedicine","authors":"W. Lievers","doi":"10.1162/qss_a_00205","DOIUrl":"https://doi.org/10.1162/qss_a_00205","url":null,"abstract":"Abstract Visualizing the academic descendants of prolific researchers is a challenging problem. To this end, a modified Pavlo algorithm is presented and its utility is demonstrated based on manually collected academic genealogies of five researchers in biomechanics and biomedicine. The researchers have 15–32 children each and between 93 and 384 total descendants. The graphs generated by the modified algorithm were over 97% smaller than the original. Mentorship metrics were also calculated; their hm-indices are 5–7 and the gm-indices are in the range 7–13. Of the 1,096 unique researchers across the five family trees, 153 (14%) had graduated their own PhD students by the end of 2021. It took an average of 9.6 years after their own graduation for an advisor to graduate their first PhD student, which suggests that an academic generation in this field is approximately one decade. The manually collected data sets used were also compared against the crowd-sourced academic genealogy data from the AcademicTree.org website. The latter included only 45% of the people and 34% of the connections, so this limitation must be considered when using it for analyses where completeness is required. The data sets and an implementation of the algorithm are available for reuse.","PeriodicalId":34021,"journal":{"name":"Quantitative Science Studies","volume":"3 1","pages":"489-511"},"PeriodicalIF":6.4,"publicationDate":"2022-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"64426870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0