Mazen El Makkouk, Cláudia Daniele DE SOUZA, Carlos Suárez Balseiro
{"title":"Adding humanities and social science publications to Wikidata: a contribution to the Open Science movement","authors":"Mazen El Makkouk, Cláudia Daniele DE SOUZA, Carlos Suárez Balseiro","doi":"10.55835/643c5781dc7d38a4a1546e27","DOIUrl":"https://doi.org/10.55835/643c5781dc7d38a4a1546e27","url":null,"abstract":"This is a case study which describes and evaluates the process of creating Wikidata items for academic journals and articles published by the University of Puerto Rico in the humanities and social sciences, as part of an open science initiative. It suggests preliminary steps that can be taken to improve indexing and to register local geographic, disciplinary, and cultural contexts for humanities and social science journals on Wikidata. Finally, argues that these steps can promote a different way of evaluating scholarship in these fields, more appropriate to the humanities and social sciences but nevertheless promoting scholarly cooperation in a spirit consistent with the ethos of open science as perceived by the author.","PeriodicalId":334841,"journal":{"name":"27th International Conference on Science, Technology and Innovation Indicators (STI 2023)","volume":"1992 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128614016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Academic Elitism: Parental Education and the Career Experiences of Faculty in U.S. Institutions","authors":"V. Pham, J. Melkers, Mayra Morales Tirado","doi":"10.55835/6441aefb76bb0bb2c9ff4792","DOIUrl":"https://doi.org/10.55835/6441aefb76bb0bb2c9ff4792","url":null,"abstract":"The U.S. academy has long been accused of elitism. Evidence of high proportions of faculty with PhD parents suggest generational effects on inclusion and access to the profession. Conversely, increased attention to first generation university graduates has not extended to those who succeed in breaking through the potential barriers of generational elitism, completing their doctoral degrees and entering the professoriate. Using a nationwide sample of academic scientists in the United States from across four STEM disciplines and across institutions, we examine the extent to which socioeconomic status offers advantage (or disadvantage) to faculty as they advance in their careers. We find that faculty with PhD parents are one and a half times more likely to work at higher-ranked and more competitive universities, while first-generation faculty are three times more likely to work in lower-ranked and non-doctoral-serving institutions. We find that first-generation scholars are especially disadvantaged in navigating the competitive work environment of research-intensive institutions.","PeriodicalId":334841,"journal":{"name":"27th International Conference on Science, Technology and Innovation Indicators (STI 2023)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114761557","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Examination of Academic Monographs in Library and Information Studies A Dimensions Platform-Based Analysis of Traditional and Altmetrics Indicators","authors":"Jiangbo Li, Mingxuan Ge, Chunling Jiang, Yang Hou","doi":"10.55835/64366b67fdd17c61eba3a7b4","DOIUrl":"https://doi.org/10.55835/64366b67fdd17c61eba3a7b4","url":null,"abstract":"This paper investigates the use of traditional and altmetrics indicators to present a comprehensive study on the evaluation of academic monographs in the field of library and information studies. The research analyzes a dataset of 116 monographs published in the last five years, which are obtained from the Dimensions platform. Traditional citation counts were extracted from Dimensions, whereas altmetrics indicators were collected using API from Altmetric.com. This study investigates the relationship between traditional and altmetrics indicators and finds that altmetrics indicators measure the social impact of monographs, whereas traditional citation indicators measure the academic impact. Moreover, the study reveals that open access (OA) books are more likely to attract altmetrics indicators. This research demonstrates that altmetrics indicators can act as an insightful supplement to traditional citation-based indicators for evaluating academic monographs and further highlights the significance of the Dimensions platform for conducting academic book evaluations. Furthermore, this study provides empirical evidence on the complementarity of traditional and altmetrics indicators in evaluating academic monographs.","PeriodicalId":334841,"journal":{"name":"27th International Conference on Science, Technology and Innovation Indicators (STI 2023)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115793735","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"15 years of Research Assessment Exercises at the University of Antwerp: how evolution in the research landscape leads to change in the assessment practice","authors":"Birgit Houben","doi":"10.55835/64356303633203418604171b","DOIUrl":"https://doi.org/10.55835/64356303633203418604171b","url":null,"abstract":"At the UAntwerpen, new international insights and evolutions with regard to responsible research assessment are processed into the system of the research assessment exercises. In practice however, the assessment system does not seem to work optimal and is showing symptoms of fatigue, such as an inflation of scores given, a traditional mindset of evaluees and evaluators when it comes to indicators, a procedure which is stress-sensitive and assessment reports with predictable outcomes. It is worth considering organising the assessment system in a different way in order to guarantee useful results for everyone involved. A ‘flipped’ system is proposed, in which the unit is assessed ex-ante on the basis of its strategic action plan.","PeriodicalId":334841,"journal":{"name":"27th International Conference on Science, Technology and Innovation Indicators (STI 2023)","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129282162","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Expertise-based Framework for Research Portfolio Management of Institutions at coarse- and fine-grained levels","authors":"Abhirup Nandy, H. Lathabai, V. Singh","doi":"10.55835/644259e5eb3447ac90894e51","DOIUrl":"https://doi.org/10.55835/644259e5eb3447ac90894e51","url":null,"abstract":"Institutional performance assessment is one of the major challenges for various stakeholders including national and institutional policymakers. Existing popular approaches to performance measurement rely on various factors besides research output, which have been criticized on various grounds. In this work, we present a sciento-text framework to assess the core competency/expertise of an institution at two levels: a broad thematic level, based on WoS subject categories, and a finer thematic level based on indexed keywords. The performance measures namely x_d- index and x-index are used for assessment at broad and fine thematic levels, respectively. While national policymakers can make use of x_d- index for the enhancement of national scholarly ecosystem, institutional policymakers and other stakeholders of the institution can make benefit from the wholistic usage of the framework to work for improving its broader expertise diversity as well as enhancing its fine level expertise within suitable disciplines.","PeriodicalId":334841,"journal":{"name":"27th International Conference on Science, Technology and Innovation Indicators (STI 2023)","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124832144","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A local cohesion-maximising algorithm for the exploration of publication networks","authors":"Matthias Held, Bastian Steudel, J. Gläser","doi":"10.55835/644122df83bc0caad0e3333d","DOIUrl":"https://doi.org/10.55835/644122df83bc0caad0e3333d","url":null,"abstract":"The dominant approach to the reconstruction of scientific topics is the application of global community detection algorithms. Some of the properties of these algorithms, however, collide with the sociological discussion on topics. We present here for consideration a new local bibliometric algorithm that is in line with sociological definitions of topics and which reconstructs dense regions in bibliometric networks locally.","PeriodicalId":334841,"journal":{"name":"27th International Conference on Science, Technology and Innovation Indicators (STI 2023)","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124790602","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Matter of Size? Visibility and Impact of Small Open Access Journals in Two Large Databases","authors":"Roberto Cruz Romero","doi":"10.55835/6442b264f6484429f00ec882","DOIUrl":"https://doi.org/10.55835/6442b264f6484429f00ec882","url":null,"abstract":"Small academic publishers are commonly associated with universities, learned societies, or scientific groups with shared research agendas, differing from their larger commercial counterparts. This research explores specific bibliometric data to highlight differences and similarities of citation coverage for small journals indexed in the Web of Science (WoS) and Scopus. The paper looks at small journals in open access format in comparison to larger, non-open access journals. The goal is to problematize and assess the visibility and impact of the literature being cited in indexed and non-indexed journals and discuss the role of small open access journals as bridges for field-specific (usually non-indexed) and highly cited (mostly indexed) literature in these databases. This approach sheds light into the scholarly, publishing practices of different academic fields and disciplines.","PeriodicalId":334841,"journal":{"name":"27th International Conference on Science, Technology and Innovation Indicators (STI 2023)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131876304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kathrine Bjerg Bennike, P. M. Melchiorsen, G. Sivertsen
{"title":"An institutional implementation of the new European reform of research assessment","authors":"Kathrine Bjerg Bennike, P. M. Melchiorsen, G. Sivertsen","doi":"10.55835/64426bdc67b1730895c01156","DOIUrl":"https://doi.org/10.55835/64426bdc67b1730895c01156","url":null,"abstract":"The Agreement on Reforming Research Assessment (Coalition for Advancing Research Assessment, 2022) addresses the assessment of researchers, research proposals, and research performing organizations and units. Our contribution is relevant for the assessment of units within organizations. We describe how the main principles and requirements of the Agreement have inspired a new institutional-level framework at Aalborg University (DK) with the aim to deliver data, statistics, and indicators to support internal strategic development, research assessment and resource allocation. The framework was designed on request from the rectorate and in collaboration with the deans of the four faculties with feedback from their project steering group and the university’s representative bodies.","PeriodicalId":334841,"journal":{"name":"27th International Conference on Science, Technology and Innovation Indicators (STI 2023)","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132108291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yucheng Chen, Zhengyi Guan, Chundong Li, Chenyang Wang, Zhe Wang
{"title":"A Study on Iconic Paper Discovery Based on Deep Learning Models","authors":"Yucheng Chen, Zhengyi Guan, Chundong Li, Chenyang Wang, Zhe Wang","doi":"10.55835/64382c384cc7592973d4786e","DOIUrl":"https://doi.org/10.55835/64382c384cc7592973d4786e","url":null,"abstract":"This paper proposes a new method for selecting iconic papers. We use chapter structure recognition technology and combine it with popular deep learning models to identify the chapter structure of the papers. Based on this identification result, we calculate the sum of the number of times each paper is mentioned in all articles, to discover iconic papers with high mention frequency. We focus on the \"Method\" and \"Conclusion\" sections to find papers that are frequently mentioned in these two sections and determine iconic papers. With this method, we can more accurately discover and evaluate important research results and provide more valuable references for scholars in related fields.","PeriodicalId":334841,"journal":{"name":"27th International Conference on Science, Technology and Innovation Indicators (STI 2023)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117095693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Analysis of the Pubmed Commons Post-Publication Peer Review Plateform.","authors":"P. Gorry, L. Mignot, Antoine Sabouraud","doi":"10.55835/6442f02464eb99f94fe5a307","DOIUrl":"https://doi.org/10.55835/6442f02464eb99f94fe5a307","url":null,"abstract":"The goal of open science is to improve the quality of publications and to overcome the shortcomings of the classic peer review process. Post-Publication Peer Review (PPPR) has been proposed as an alternative. It is of particular interest to study a non-anonymous PPPR platform to dive into the dynamics relative to the position of the commentators in the scientific community. This research-in-progress describes for the first time in detail the publications targeted by PPPR comments on PubMed Commons (PMC) and the commenters in order to better identify the underlying issues. From the original PMC corpus, we extracted a sample of 657 authors who wrote 4514 comments. To run a bibliometric analysis, this sample was matched with Scopus® database in order to inform the status of the commenters and of the publications. Preliminary results show that the distribution of comments over time reveals some events of intense debate. Most of the comments are rather short. The number of comments by authors follow a Pareto distribution. Commenters are scientists with a high reputation but there is no correlation between their critical activity and any bibliometrics indicators. Finally, we identified only a small fraction of retracted publications. Our results seem to reveal the heterogeneity of the profiles, reflecting a divergent interest in PPPR probably related to the researchers’ positions in the scientific field, and the respect of the Mertonian norms of the scientific ethos. Further research is currently underway to investigate these characteristics in more detail.","PeriodicalId":334841,"journal":{"name":"27th International Conference on Science, Technology and Innovation Indicators (STI 2023)","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116818946","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}