Caitlin C Farrell, William R Penuel, Paula Arce-Trigatti, James Soland, Corinne Singleton, Alison Fox Resnick, Kristina Stamatis, Robbin Riedy, Erin Henrick, Stacey Sexton, Sarah Wellberg, Danny Schmidt
{"title":"Designing measures of complex collaborations with participatory, evidence-centered design.","authors":"Caitlin C Farrell, William R Penuel, Paula Arce-Trigatti, James Soland, Corinne Singleton, Alison Fox Resnick, Kristina Stamatis, Robbin Riedy, Erin Henrick, Stacey Sexton, Sarah Wellberg, Danny Schmidt","doi":"10.3389/frma.2024.1210547","DOIUrl":"10.3389/frma.2024.1210547","url":null,"abstract":"<p><p>An increasingly popular form of collaboration involves forming partnerships among researchers, educators, and community members to improve or transform education systems through research inquiry. However, not all partnerships are successful. The field needs valid, reliable, and useful measures to help with assessing progress toward partnership goals. In this community case study, we present a participatory, mixed-methods approach for creating measures to assess the progress of education research-practice partnerships (RPPs). The case illustrates a novel approach to measurement design, driven by perspectives and feedback of over 300 members of 80 partnerships. As a result, the measures align with the values and practices of the very collaborations the measures were intended to assess.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"9 ","pages":"1210547"},"PeriodicalIF":0.0,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11345517/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142074675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Adrian Sven Geissler, Jan Gorodkin, Stefan Ernst Seemann
{"title":"Patent data-driven analysis of literature associations with changing innovation trends.","authors":"Adrian Sven Geissler, Jan Gorodkin, Stefan Ernst Seemann","doi":"10.3389/frma.2024.1432673","DOIUrl":"10.3389/frma.2024.1432673","url":null,"abstract":"<p><p>Patents are essential for transferring scientific discoveries to meaningful products that benefit societies. While the academic community focuses on the number of citations to rank scholarly works according to their \"scientific merit,\" the number of citations is unrelated to the relevance for patentable innovation. To explore associations between patents and scholarly works in publicly available patent data, we propose to utilize statistical methods that are commonly used in biology to determine gene-disease associations. We illustrate their usage on patents related to biotechnological trends of high relevance for food safety and ecology, namely the CRISPR-based gene editing technology (>60,000 patents) and cyanobacterial biotechnology (>33,000 patents). Innovation trends are found through their unexpected large changes of patent numbers in a time-series analysis. From the total set of scholarly works referenced by all investigated patents (~254,000 publications), we identified ~1,000 scholarly works that are statistical significantly over-represented in the references of patents from changing innovation trends that concern immunology, agricultural plant genomics, and biotechnological engineering methods. The detected associations are consistent with the technical requirements of the respective innovations. In summary, the presented data-driven analysis workflow can identify scholarly works that were required for changes in innovation trends, and, therefore, is of interest for researches that would like to evaluate the relevance of publications beyond the number of citations.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"9 ","pages":"1432673"},"PeriodicalIF":0.0,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11324476/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141989692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Igor R. Efimov, Jeffrey S. Flier, Robert P. George, Anna I. Krylov, Luana S. Maroja, Julia Schaletzky, Jay Tanzman, Abigail Thompson
{"title":"Politicizing science funding undermines public trust in science, academic freedom, and the unbiased generation of knowledge","authors":"Igor R. Efimov, Jeffrey S. Flier, Robert P. George, Anna I. Krylov, Luana S. Maroja, Julia Schaletzky, Jay Tanzman, Abigail Thompson","doi":"10.3389/frma.2024.1418065","DOIUrl":"https://doi.org/10.3389/frma.2024.1418065","url":null,"abstract":"This commentary documents how federal funding agencies are changing the criteria by which they distribute taxpayer money intended for scientific research. Increasingly, STEMM (Science, Technology, Engineering, Mathematics, and Medicine) funding agencies are requiring applicants for funding to include a plan to advance DEI (“Diversity, Equity, and Inclusion”) in their proposals and to dedicate a part of the research budget to its implementation. These mandates undermine the academic freedom of researchers and the unbiased generation of knowledge needed for a well-functioning democracy. Maintaining excellence in science is fundamental to the continuation of the U.S. as a global economic leader. Science provides a basis for solving important global challenges such as security, energy, climate, and health. Diverting funding from science into activities unrelated to the production of knowledge undermines science's ability to serve humankind. When funding agencies politicize science by using their power to further a particular ideological agenda, they contribute to public mistrust in science. Hijacking science funding to promote DEI is thus a threat to our society.","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"98 23","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141812455","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The H-index is an unreliable research metric for evaluating the publication impact of experimental scientists","authors":"M. K. Akhtar","doi":"10.3389/frma.2024.1385080","DOIUrl":"https://doi.org/10.3389/frma.2024.1385080","url":null,"abstract":"","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":" 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141822757","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Method of Everything vs. Experimenter Bias of Loophole-Free Bell Experiments","authors":"Manuel S. Morales","doi":"10.3389/frma.2024.1404371","DOIUrl":"https://doi.org/10.3389/frma.2024.1404371","url":null,"abstract":"Experimenter bias compromises the integrity and advancement of science, especially when awarded as such. For example, the 2022 Nobel Prize in Physics awarded for the loophole-free experiments that tested physicist John S. Bell's inequality theorem. These experiments employed the logic of conducting local experiments to obtain local evidence that contradicted local realistic theories of nature, thereby validating quantum mechanics as a fundamental non-local theory. However, there was one loophole that was wittingly not tested by the Nobel laureates. The notable exception was Bell's “super-deterministic” loophole, which was validated (2000) (2001) (2002) (2003) (2004) (2005) (2006) (2007) (2008) (2009) (2010) (2011) (2012) non-locally, thus compromising the subsequent Nobel Prize. More importantly, the discovery of two mutually exclusive and jointly exhaustive non-local hidden variables revealed why local scientific methods obtain false-positive and false-negative results. With knowledge of this fundamental omission, the inclusion of the non-local hidden variables in the local methods used in science can then advance it to be a complete study of nature.","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"40 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141658428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Addressing researcher fraud: retrospective, real-time, and preventive strategies-including legal points and data management that prevents fraud.","authors":"James E Kennedy","doi":"10.3389/frma.2024.1397649","DOIUrl":"10.3389/frma.2024.1397649","url":null,"abstract":"<p><p>Researcher fraud is often easy and enticing in academic research, with little risk of detection. Cases of extensive fraud continue to occur. The amount of fraud that goes undetected is unknown and may be substantial. Three strategies for addressing researcher fraud are (a) retrospective investigations after allegations of fraud have been made, (b) sting operations that provide conclusive evidence of fraud as it occurs, and (c) data management practices that prevent the occurrence of fraud. Institutional and regulatory efforts to address researcher fraud have focused almost exclusively on the retrospective strategy. The retrospective approach is subject to controversy due to the limitations of <i>post-hoc</i> evidence in science, the difficulty in establishing who actually committed the fraud in some cases, the application of a legal standard of evidence that is much lower than the usual standards of evidence in science, and the lack of legal expertise by scientists investigating fraud. The retrospective strategy may be reliably effective primarily in cases of extensive, careless fraud. Sting operations can overcome these limitations and controversies, but are not feasible in many situations. Data management practices that are effective at preventing researcher fraud and unintentional errors are well-established in clinical trials regulated by government agencies, but appear to be largely unknown or unimplemented in most academic research. Established data management practices include: archiving secure copies of the raw data, audit trails, restricted access to the data and data collection processes, software validation, quality control checks, blinding, preregistration of data processing and analysis programs, and research audits that directly address fraud. Current discussions about data management in academic research focus on sharing data with little attention to practices that prevent intentional and unintentional errors. A designation or badge such as <i>error-controlled data management</i> could be established to indicate research that was conducted with data management practices that effectively address intentional and unintentional errors.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"9 ","pages":"1397649"},"PeriodicalIF":0.0,"publicationDate":"2024-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11236558/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141592278","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Nadja Lepsch-Cunha, Vinicius Muraro, Henrique Eduardo Mendonça Nascimento, A. Mazoni, Cecília Verónica Nunez, M. B. Bonacelli
{"title":"Technical-scientific production and knowledge networks about medicinal plants and herbal medicines in the Amazon","authors":"Nadja Lepsch-Cunha, Vinicius Muraro, Henrique Eduardo Mendonça Nascimento, A. Mazoni, Cecília Verónica Nunez, M. B. Bonacelli","doi":"10.3389/frma.2024.1396472","DOIUrl":"https://doi.org/10.3389/frma.2024.1396472","url":null,"abstract":"This paper explores the role of Brazilian research institutions in the global and national context of study of medicinal plants. Most of these plants have ethnopharmacological use and herbal medicines related to the Amazon. It highlights Brazil's position in scientific production and the importance of Amazonian resources in developing phytomedicines. The study aims to provide an overview of the technical-scientific production of medicinal plants and herbal medicines related to the Amazon, focusing on scientific impact, collaboration, Technology Readiness Level (TRL) of scientific production, and innovation system maturity.The study employs a comprehensive methodological approach, including data collection from Scopus covering the period from 2002 to 2022. The data was cleaned and analyzed using bibliometric and network analysis techniques. Advanced natural language processing techniques, such as Latent Dirichlet Allocation and Jaccard distance measure, were used for TRL classification.The findings reveal a predominant contribution from Brazilian institutions and authors, with 1,850 publications analyzed. Key areas identified include Pharmacology, Toxicology, Pharmaceuticals, Medicine, and Biochemistry. The study also uncovers various collaborative networks and technological maturity levels, with a significant focus on early-stage development phases.The research concludes that Brazilian institutions, particularly those in the Amazon region, play a significant role in the scientific exploration and development of medicinal plants and herbal medicines. Despite this, countries like the USA were proportionally more productive in clinical trial research. The study underscores the potential of Brazil's rich biodiversity and traditional knowledge in the pharmaceutical industry, particularly for neglected diseases. It suggests the need for stronger research systems and international collaboration to leverage these resources for global health benefits.","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"95 9","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141352840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Pedagogical implications of pragmatic HRM research","authors":"Dieu Hack‐Polay","doi":"10.3389/frma.2024.1374628","DOIUrl":"https://doi.org/10.3389/frma.2024.1374628","url":null,"abstract":"This chapter examines the interplay between human resource management theory and human resource management practice. It advocates that effective human resource management practice and theory are intrinsically intertwined, and this indispensable link ought to be central to the pedagogy of management research methods. Through greater embeddedness of the institutional and societal context in research method teaching, students can develop as scholars who understand their roles as facilitators of dialogue between researchers and a significant part of their audience (practitioners). The chapter conceptualizes this perspective as a collaborative model in human resource management research, which then must hold centrality in the teaching of research methods in our university and college classrooms.","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"21 12","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141357399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Reina Camacho Toro, Luz M. Cumba Garcia, Laura A. Galvis, L. F. Echeverría-King, B. Pantović, Claudia Alarcón-López, Verónica Rossana Suárez, Pedro Figueroa, Ivonne Torres-Atencio, Claudia Widmaier, Tatiana Rodrigues Fraga, Susan Benavides
{"title":"The needed link between open science and science diplomacy—A Latin American perspective","authors":"Reina Camacho Toro, Luz M. Cumba Garcia, Laura A. Galvis, L. F. Echeverría-King, B. Pantović, Claudia Alarcón-López, Verónica Rossana Suárez, Pedro Figueroa, Ivonne Torres-Atencio, Claudia Widmaier, Tatiana Rodrigues Fraga, Susan Benavides","doi":"10.3389/frma.2024.1355393","DOIUrl":"https://doi.org/10.3389/frma.2024.1355393","url":null,"abstract":"The relevance of science diplomacy and open science in today's world is undeniable. Science diplomacy enables countries to jointly address pressing global challenges, such as climate change, pandemics, and food security. Open science, promoting accessible and transparent research, plays a pivotal role in this context. Nevertheless, the degree of openness is subject to specific circumstances, contingent upon varying factors, including local knowledge and resources. Latin America has not only been at the forefront of pioneering open access strategies, making it an interesting case to study, but it has also shown a tangible interest in using science diplomacy. Our research employs a mixed-methods approach, incorporating a quantitative survey involving 50 organizations and initiatives dedicated to promoting open science in Latin America, along with two qualitative focus group studies. Our primary objective is to assess if and how these entities use science diplomacy to achieve their objectives. Non-policy entities were prioritized due to their institutional stability in the region. We highlight successful strategies and delve into the existing barriers hindering the full implementation of open science principles. Our research aims to enhance collaboration between these organizations and policy and decision-makers by providing a set of recommendations in that direction. By shedding light on the current landscape and dynamics of open science in Latin America, we aspire to focus on science diplomacy, facilitate informed decision-making, and formulate policies that further propel the region along the path of openness, collaboration, and innovation in scientific research.","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"149 8‐10","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141381265","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Santi Kusumaningrum, Shaila Tieken, Andrea Andjaringtyas Adhi, Siti Ainun Nisa, Widi Laras Sari, Annisa R Beta
{"title":"Bringing rigor in contextual objectivity: lessons from applying feminist lens in scoping the evidence on girlhood studies in Indonesia.","authors":"Santi Kusumaningrum, Shaila Tieken, Andrea Andjaringtyas Adhi, Siti Ainun Nisa, Widi Laras Sari, Annisa R Beta","doi":"10.3389/frma.2024.1339651","DOIUrl":"10.3389/frma.2024.1339651","url":null,"abstract":"<p><p>This perspective paper contemplates the nuances of engaging with literature ethically in conducting a scoping review based on the researchers' project on girlhood studies in Indonesia. We assert that the ethical perspective extends beyond conventional primary data collection from human participants, further emphasizing the essence of a feminist methodology in this scholarly investigation. We discuss the interplay between the role of rigor and the dynamics of power relations in research, shedding light on reconciling between the pursuit of facts and acknowledgment of biases in knowledge production. This reflection offers insights into the methodological process and the researcher's role, contributing to the broader discourse on how research can effectively address issues of gender equity and social inclusion. Through this paper, we underscore the necessity of an intentional approach in unifying the domains of science and advocacy because only then can we truly catalyze transformative change. In doing so, we seek to foster a more comprehensive, objective, and empathetic understanding of the researched: in this case, the experiences of girls and young women -and, by extension, marginalized individuals in Indonesia and beyond.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"9 ","pages":"1339651"},"PeriodicalIF":0.0,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11177752/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141332647","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}