Lee Stoner, Craig Paterson, Lane Perry, Simon Higgins, Nathan Woolard, Patricia Pagan Lassalle, Emma Cowley, Yolanda Lassalle
{"title":"Sciducio: a practical framework for guiding the development and leadership of the academic research environment.","authors":"Lee Stoner, Craig Paterson, Lane Perry, Simon Higgins, Nathan Woolard, Patricia Pagan Lassalle, Emma Cowley, Yolanda Lassalle","doi":"10.3389/frma.2023.1205874","DOIUrl":"10.3389/frma.2023.1205874","url":null,"abstract":"<p><p>The goal of this paper is to introduce Sciducio, a practical framework for guiding the development and leadership of an academic research environment. The principal audience for this framework is new academics, that is individuals beginning a tenure-track position in the U.S or a lecturing position elsewhere in the world. However, we also believe this framework will be of use to established academics searching for structure, academics moving to a new institution, and can serve as a training tool for doctoral and postdoctoral mentees. We briefly describe the theory supporting Sciducio, outline the framework and its individual components (blocks), then provide suggested instructions for use. We provide suggested instructions (i.e., descriptive rather than prescriptive), because there is no one-size-fits-all approach for ensuring success. Sciducio incorporates three domains (Plan, Manage, and Deliver), encompasses eight blocks, and is intended to fit on one-sheet of paper or one screen. The Plan domain includes the blocks: value, strategy, and leadership. The Manage domain includes the blocks: activities, key resources, and finances. The Deliver domain includes the blocks: solution and channels. Considering each of the framework blocks is complex, we cannot provide full justice to each component. This paper serves as a general overview and subsequent papers will be more topic specific. Additionally, we encourage others to contribute to and advance this framework.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"8 ","pages":"1205874"},"PeriodicalIF":0.0,"publicationDate":"2023-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10591073/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50159430","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Introducing the open biomedical map of science.","authors":"Michael Ginda, Bruce W Herr, Katy Börner","doi":"10.3389/frma.2023.1274793","DOIUrl":"10.3389/frma.2023.1274793","url":null,"abstract":"<p><p>This article introduces work in progress to develop a new, open biomedical map of science (OBMS) using the PubMed citation database. The new science map represents bimodal network relationships between journals and medical subject heading (MeSH) descriptors, based on a journal's articles indexed in the MEDLINE component of PubMed. We review the current efforts to use PubMed data in science of science studies and science mapping. As part of the development process, we compare the journals indexed in PubMed with journals included in the 2011 UCSD map of science to establish a baseline of disciplinary coverage of PubMed for the period 2009-2019. Journal article frequency is analyzed to establish the minimum number of citations required by a journal for inclusion in a map of science. A prototype OBMS is presented, and we discuss the strengths and weaknesses of the OBMS, as well as the next steps for using and productizing this new open map for general and free usage.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"8 ","pages":"1274793"},"PeriodicalIF":0.0,"publicationDate":"2023-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10582702/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49685758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Anastasia Krithara, James G Mork, Anastasios Nentidis, Georgios Paliouras
{"title":"The road from manual to automatic semantic indexing of biomedical literature: a 10 years journey.","authors":"Anastasia Krithara, James G Mork, Anastasios Nentidis, Georgios Paliouras","doi":"10.3389/frma.2023.1250930","DOIUrl":"10.3389/frma.2023.1250930","url":null,"abstract":"<p><p>Biomedical experts are facing challenges in keeping up with the vast amount of biomedical knowledge published daily. With millions of citations added to databases like MEDLINE/PubMed each year, efficiently accessing relevant information becomes crucial. Traditional term-based searches may lead to irrelevant or missed documents due to homonyms, synonyms, abbreviations, or term mismatch. To address this, semantic search approaches employing predefined concepts with associated synonyms and relations have been used to expand query terms and improve information retrieval. The National Library of Medicine (NLM) plays a significant role in this area, indexing citations in the MEDLINE database with topic descriptors from the Medical Subject Headings (MeSH) thesaurus, enabling advanced semantic search strategies to retrieve relevant citations, despite synonymy, and polysemy of biomedical terms. Over time, advancements in semantic indexing have been made, with Machine Learning facilitating the transition from manual to automatic semantic indexing in the biomedical literature. The paper highlights the journey of this transition, starting with manual semantic indexing and the initial efforts toward automatic indexing. The BioASQ challenge has served as a catalyst in revolutionizing the domain of semantic indexing, further pushing the boundaries of efficient knowledge retrieval in the biomedical field.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"8 ","pages":"1250930"},"PeriodicalIF":0.0,"publicationDate":"2023-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10576528/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41241709","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reflections on the Prospective Outcomes of Injury Study (POIS; 2006-2023): how population-based research can address Māori outcomes and governance.","authors":"Emma H Wyeth, Sarah Derrett","doi":"10.3389/frma.2023.1212827","DOIUrl":"10.3389/frma.2023.1212827","url":null,"abstract":"<p><p>Injury is a leading cause of disability. Twenty years ago, we knew financial costs of injury were high but little was known about the short, medium and long-term outcomes after injury. In 2006, a Pilot Study and engagement with Māori across the country was undertaken to discuss the planned main study to understand how best to design a study that was meaningful and beneficial to Māori and policy-makers. Between 2007-2009, 2,856 injured New Zealanders (including 20% Māori) with an Accident Compensation Corporation (ACC) entitlement claim were recruited to the Prospective Outcomes of Injury Study (POIS). Participants shared detailed information (at 3, 12 and 24 months, and 12-years post-injury) about a broad range of topics including: the injury, socio-demographics, health, health services access, employment and wellbeing. Administrative data about injury-related hospitalisations, the sentinel injury and subsequent injuries were also collected, as well as in-depth qualitative interviews. This paper focuses on the why, how and impacts of POIS, especially in relation to Māori design and approaches, capability and capacity building, and leadership. Focusing on these aspects for Māori within POIS over time has ensured delivery of findings capable of informing and improving outcomes and policy. In particular, POIS has had considerable impact, influencing ACC's research strategy and outcomes' focus, and has provided disability, health, and wellbeing outcomes knowledge previously unavailable, especially for Māori.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"8 ","pages":"1212827"},"PeriodicalIF":0.0,"publicationDate":"2023-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10562715/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41222030","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Social determinants of health: critical consciousness as the core to collective impact.","authors":"Joy Doll, Julie Malloy, Roger Gonzales","doi":"10.3389/frma.2023.1141051","DOIUrl":"10.3389/frma.2023.1141051","url":null,"abstract":"<p><p>Social determinants of health have become widely recognized as important to overall health. Many areas of social determinants of health are growing from policy to reimbursement to the connecting of health and social care. The efforts around social determinants of health require reflection and awareness of structural issues. The work of Paulo Freire in critical consciousness provides guidance for how to engage in social determinants of health efforts. This manuscript offers a summary of the social determinants of health under the guidance of critical consciousness to build skills and interactions to promote social care to build toward health equity.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"8 ","pages":"1141051"},"PeriodicalIF":0.0,"publicationDate":"2023-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10562696/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41222031","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Self-referencing rates in biological disciplines.","authors":"Sean M Cascarina","doi":"10.3389/frma.2023.1215401","DOIUrl":"10.3389/frma.2023.1215401","url":null,"abstract":"<p><p>The use of citation counts (among other bibliometrics) as a facet of academic research evaluation can influence citation behavior in scientific publications. One possible unintended consequence of this bibliometric is excessive self-referencing, where an author favors referencing their own publications over related publications from different research groups. Peer reviewers are often prompted by journals to determine whether references listed in the manuscript under review are unbiased, but there is no consensus on what is considered \"excessive\" self-referencing. Here, self-referencing rates are examined across multiple journals in the fields of biology, genetics, computational biology, medicine, pathology, and cell biology. Median self-referencing rates are between 8-13% across a range of journals within these disciplines. However, self-referencing rates vary as a function of total number of references, number of authors, author status/rank, author position, and total number of publications for each author. Importantly, these relationships exhibit interdisciplinary and journal-dependent differences that are not captured by examining broader fields in aggregate (e.g., Biology, Chemistry, Physics, etc.). These results provide useful statistical guidelines for authors, editors, reviewers, and journals when considering referencing practices for individual publications, and highlight the effects of additional factors influencing self-referencing rates.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"8 ","pages":"1215401"},"PeriodicalIF":0.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10556682/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41164722","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sustainable collaboration on complex problems: a \"who\" not a \"what\" challenge.","authors":"Josie Gibson","doi":"10.3389/frma.2023.1224030","DOIUrl":"10.3389/frma.2023.1224030","url":null,"abstract":"<p><p>Despite decades of collective efforts and millions of dollars of cross-sector investment, collaborations created to address wicked problems-complex issues that span industries and sectors whose root causes are unclear-have had mixed success. The wicked problems terrain is tribal and competitive. It is contested by proponents of competing collective change and innovation tools and methodologies, advocates of different leadership approaches and, in recent years, big business champions who claim private enterprise is the most effective driver of solutions. This perspective article argues that while all these elements deserve attention, the primary focus of many collaborations reflects a Western scientific bias toward \"what\" and \"how\" questions-governance, processes, activities, metrics and outcomes-at the expense of the \"who\" component: the human relationships, or relational infrastructure, required to build and sustain effective collective efforts. This is crucial given the grueling realities of complex multi-year initiatives. This article explores the tension between this bias and the need to develop robust relational networks through skilful collective leadership, as reflected in numerous First Nations knowledge practices. We discuss leadership as a both an individual and a collective capability and highlight the need for better understanding of its significant role in anchoring, shaping and guiding effective system-based efforts that achieve positive impact.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"8 ","pages":"1224030"},"PeriodicalIF":0.0,"publicationDate":"2023-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10552851/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41158115","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Role-based responsibilities in securing research integrity: increasing support for multi-level implementers.","authors":"Kristi Lõuk","doi":"10.3389/frma.2023.1256426","DOIUrl":"https://doi.org/10.3389/frma.2023.1256426","url":null,"abstract":"<p><p>This perspective article focuses on how researchers help to secure the research integrity-related responsibilities of various institutions in their various roles, as same researcher can fulfill the tasks of different stakeholders, be in different roles, and wear multiple hats simultaneously while performing duties at different levels. Institutions whose research integrity-related responsibilities are carried out by researchers should support the multi-level implementers more in carrying out these roles and responsibilities and consider their input when setting up tasks. In addition to having necessary policies and procedures, these should be actionable and supported by responsible research culture and environment. Furthermore, policies and action plans should be created in consideration of and in co-creation with the actual implementers. Realizing that the multiple-level role of researchers also helps to secure research integrity at the institutional and system level of science should go hand in hand with creating responsible research culture and environment where that input is taken into account. This in turn will help researchers deal with various current pressures, e.g., having not enough time or being subject to unfair evaluations.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"8 ","pages":"1256426"},"PeriodicalIF":0.0,"publicationDate":"2023-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10539606/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41144038","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Evgenios Vlachos, Regine Ejstrup, Thea Marie Drachen, Bertil Fabricius Dorch
{"title":"Development and preliminary validation of an open access, open data and open outreach indicator.","authors":"Evgenios Vlachos, Regine Ejstrup, Thea Marie Drachen, Bertil Fabricius Dorch","doi":"10.3389/frma.2023.1218213","DOIUrl":"https://doi.org/10.3389/frma.2023.1218213","url":null,"abstract":"<p><p>We present the development and preliminary validation of a new person-centered indicator that we propose is named \"OADO\" after its target concepts: Open Access (OA), Open Data (OD) and Open Outreach (OO). The indicator is comprised of two factors: the research factor indicating the degree of OA articles and OD in research; and the communication factor indicating the degree of OO in communication activities in which a researcher has participated. We stipulate that the weighted version of this new indicator, the Weighted-OADO, can be used to assess the openness of researchers in relation to their peers from their own discipline, department, or even group/center. The OADO is developed and customized to the needs of Elsevier's Research Information Management System (RIMS) environment, Pure. This offers the advantage of more accurate interpretations and recommendations for action, as well as the possibility to be implemented (and further validated) by multiple institutions, allowing disciplinary comparisons of the open practices across multiple institutes. Therefore, the OADO provides recommendations for action, and enables institutes to make informed decisions based on the indicator's outcome. To test the validity of the OADO, we retrieved the Pure publication records from two departments for each of the five faculties of the University of Southern Denmark and calculated the OADO of 995 researchers in total. We checked for definition validity, actionability, transferability, possibility of unexpected discontinuities of the indicator, factor independence, normality of the indicator's distributions across the departments, and indicator reliability. Our findings reveal that the OADO is a reliable indicator for departments with normally distributed values with regards to their Weighted-OADO. Unfortunately, only two departments displayed normal distributions, one from the health sciences and one from engineering. For departments where the normality assumption is not satisfied, the OADO can still be useful as it can indicate the need for making a greater effort toward openness, and/or act as an incentive for detailed registration of research outputs and datasets.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"8 ","pages":"1218213"},"PeriodicalIF":0.0,"publicationDate":"2023-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10512940/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41144037","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}