Frontiers in research metrics and analytics最新文献

{"title":"Between linkage and return: the engagement strategies of the Knowledge Brazil Program for the scientific diaspora.","authors":"Mariana Luiza Castilho Cavasin, Ana Maria Carneiro","doi":"10.3389/frma.2026.1854887","DOIUrl":"https://doi.org/10.3389/frma.2026.1854887","url":null,"abstract":"<p><p>In recent decades, countries of origin have increasingly sought to develop policies to engage with their scientific diaspora. These policy designs typically vary across models of repatriation, linkage, and circulation, aiming to strengthen national science, technology and innovation (STI) systems. This article analyses the design and early implementation of the Knowledge Brazil Program to identify the strategies prioritized by the Brazilian state in engaging with its scientific diaspora. The study is based on document analysis, program microdata, and media sources, including news reports and opinion articles from widely circulated outlets. The findings are synthesized through a SWOT analysis, identifying strengths in the program's design, which incorporates the three core components of diaspora engagement-repatriation, linkage, and circulation; weaknesses in the asymmetry between the program's axes, with a clear emphasis on repatriation; opportunities in the diaspora's willingness to contribute to the national STI system; and threats related to concerns regarding the absorption of researchers into academia after the program's completion.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"11 ","pages":"1854887"},"PeriodicalIF":3.1,"publicationDate":"2026-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13627378/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149119410","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Evaluating large language models for domain-specific scholarly metadata classification.","authors":"Muhammad Haris, Maryam Badar","doi":"10.3389/frma.2026.1882130","DOIUrl":"https://doi.org/10.3389/frma.2026.1882130","url":null,"abstract":"<p><strong>Introduction: </strong>Large language models (LLMs) have been widely applied to text classification; however, their effectiveness in domain-specific scholarly metadata classification remains insufficiently explored. This study investigates the use of open-source LLMs to classify modeling and simulation research articles across three predefined metadata dimensions: Industry, Application Area, and Modeling Method.</p><p><strong>Methods: </strong>Using a curated dataset of research articles from the AnyLogic research repository, we evaluated models from the Qwen2.5, Llama3.1, Mistral, Ministral, and Gemma3 families. We compared Direct, Few-shot, and Chain-of-Thought prompting using either the article title alone or the title and abstract together. Performance was evaluated using Macro-F1 across the three metadata dimensions.</p><p><strong>Results: </strong>The best overall configuration, Ministral-3-14B with Direct prompting and the title and abstract as input, achieved a Macro-F1 of 53.8%. Performance varied substantially across the metadata dimensions. Modeling Method was the easiest to classify, reaching a maximum Macro-F1 of 69.1% with Ministral-3-14B. The best Macro-F1 scores for Industry and Application Area were 57.6% and 39.4%, respectively. Including abstracts consistently improved classification performance across the evaluated models, whereas differences among the three prompting strategies were relatively small. Categories that were semantically overlapping, broadly defined, highly imbalanced, or not explicitly mentioned in the article text were particularly difficult to classify.</p><p><strong>Discussion: </strong>The findings indicate that open-source LLMs can support domain-specific scholarly metadata classification without task-specific fine-tuning. However, their moderate and dimension-dependent performance limits their suitability for fully automated fine-grained metadata enrichment. Richer contextual information, more clearly defined taxonomies, and human validation are therefore needed to improve the reliability of LLM-assisted scholarly metadata classification.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"11 ","pages":"1882130"},"PeriodicalIF":3.1,"publicationDate":"2026-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13624084/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149119386","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"From brain drain to geopolitical talent competition: scientific diasporas and the future of Global South development.","authors":"Derya Buyuktanir Karacan, Daniel Tapia Takaki","doi":"10.3389/frma.2026.1898634","DOIUrl":"https://doi.org/10.3389/frma.2026.1898634","url":null,"abstract":"<p><p>Scientific diasporas have emerged as increasingly important actors in global science, technology, and innovation (STI) ecosystems. In the context of geopolitical fragmentation, technological competition, and intensifying global inequalities, talent mobility is no longer solely a migration issue but a strategic dimension of development, science diplomacy, and international influence. This policy review argues that Global South countries should move beyond traditional \"brain drain\" narratives and instead adopt long-term strategies that view scientific diasporas as transnational development partners and components of broader \"networks of networks.\" Drawing on literature related to scientific diasporas, global talent competition, science diplomacy, and migration studies, this review analyzes how scientific diasporas contribute to development through knowledge transfer, institutional partnerships, capacity building, innovation ecosystems, and policy engagement. It also examines the implications of recent geopolitical shifts, including the growing global competition for talent, technological nationalism, changes in U.S. science and immigration environments, Europe's strategic talent policies, and the rise of emerging scientific hubs beyond the West. Particular attention is given to the Global South, South-South cooperation, reverse brain drain, and the importance of equitable and inclusive knowledge systems. The paper concludes with policy recommendations aimed at strengthening science, technology, and innovation ecosystems and integrating scientific diasporas into national and international development strategies.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"11 ","pages":"1898634"},"PeriodicalIF":3.1,"publicationDate":"2026-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13624078/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149119419","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Editorial: Linking knowledge across borders: science diasporas and global south development.","authors":"Luisa F Echeverría-King, Kleinsy Bonilla, Branislav Pantović, Efraín Bámaca-López, Ana Maria Carneiro, Derya Buyuktanir Karacan","doi":"10.3389/frma.2026.1979687","DOIUrl":"https://doi.org/10.3389/frma.2026.1979687","url":null,"abstract":"","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"11 ","pages":"1979687"},"PeriodicalIF":3.1,"publicationDate":"2026-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13619833/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149082860","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Conditional validity in LLM-mediated L2 assessment: an argument-based systematic review and meta-analysis.","authors":"Latifah Hamdan Alghamdi, Talal Musaed Alghizzi","doi":"10.3389/frma.2026.1908592","DOIUrl":"10.3389/frma.2026.1908592","url":null,"abstract":"<p><strong>Introduction: </strong>Large language models (LLMs) are increasingly used for scoring and feedback in second-language (L2) assessment, yet the validity of the resulting interpretations remains contested. This review evaluated when LLM-mediated assessment is psychometrically and educationally defensible using an argument-based validity framework focused on construct representation, reliability and reproducibility, fairness, and washback.</p><p><strong>Methods: </strong>Following PRISMA 2020, we systematically searched nine databases and repositories for empirical studies published from January 2022 to December 2025. Fifty-two studies met the inclusion criteria. Quantitative synthesis used REML random-effects models where effects were sufficiently comparable; Pearson correlations, rank correlations, ICC/κ/QWK, and other psychometric indices were otherwise retained on metric-appropriate scales. Washback outcomes were synthesized using Hedges' g.</p><p><strong>Results: </strong>Source-level auditing showed that directly comparable Pearson evidence was sparse. Three source-verified L2 studies yielded moderate human-LLM score correspondence (<i>r</i> = 0.66, 95% CI [0.53, 0.75]) with substantial heterogeneity (<i>I</i> ² = 70.8%). Evidence was strongest in rubric-guided, structurally constrained, and human-supervised contexts, whereas construct representation, fairness, operational reproducibility, and generalizability remained underdeveloped. Across 14 studies, LLM-mediated formative feedback produced a small-to-moderate positive effect on revision quality and short-term writing outcomes (<i>g</i> = 0.42, 95% CI [0.27, 0.57]), although heterogeneity was substantial (<i>I</i> ² = 69.8%) and concerns about cognitive offloading, learner agency, and reproducibility persisted.</p><p><strong>Discussion: </strong>The findings support a context-dependent interpretation of validity rather than a universal claim about LLM assessment capability. Current evidence supports carefully bounded formative and human-supervised applications but does not justify autonomous high-stakes scoring or broad claims of construct validity, fairness, and generalizability.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"11 ","pages":"1908592"},"PeriodicalIF":3.1,"publicationDate":"2026-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13612528/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149066472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Determinants of collaboration dynamics and challenges in North-South data-driven health research in the African context: an epistemic injustice perspective.","authors":"Rahel Bekele, Anne Moen, Merga Belina, Kaija Saranto, Kiros Berhane","doi":"10.3389/frma.2026.1885894","DOIUrl":"10.3389/frma.2026.1885894","url":null,"abstract":"<p><strong>Introduction: </strong>Collaborations between Global North and South institutions are increasingly important for advancing artificial intelligence (AI) and data science in healthcare, offering opportunities to address context-specific challenges and reduce inequities. However, these partnerships often face persistent issues related to sustainability, equity, and long-term impact. Drawing on concepts of epistemic injustice and structural imbalances between partners, this study examines the factors shaping the effectiveness of North-South data-driven health collaborations, with particular attention to which factors exert the strongest statistically significant influence on collaboration effectiveness.</p><p><strong>Methods: </strong>The study conducted a cross-sectional survey of participants from the Data Science Initiative for Africa (DS-I Africa) network, covering the entire continent of Africa, and their partners from the Global North, and applies structural equation modeling to assess key determinants of collaboration outcomes.</p><p><strong>Results: </strong>The analysis focuses on governance and leadership, human capacity, and project and institutional practices. Human capacity is the strongest positive predictor of collaboration effectiveness (β = 0.467, <i>p</i> = 0.008). Project and institutional practices show a significant negative association with collaboration effectiveness (β = -0.464, <i>p</i> = 0.016). Governance and leadership also demonstrate a significant effect on collaboration outcomes.</p><p><strong>Discussion: </strong>The findings demonstrate that sustainable and equitable North-South collaborations depend on the alignment of governance, human capacity, and institutional practices. Moreover, addressing epistemic injustice requires system-level changes that promote shared leadership, ethical data governance, and strengthening human capacity as a reciprocal and inclusive process central to achieving balanced knowledge production and long-term collaboration impact.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"11 ","pages":"1885894"},"PeriodicalIF":3.1,"publicationDate":"2026-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13601277/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149042311","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"From existence checking to semantic auditing: citation verifiability in the age of AI.","authors":"Libor Ansorge","doi":"10.3389/frma.2026.1927189","DOIUrl":"10.3389/frma.2026.1927189","url":null,"abstract":"<p><p>This paper reflects on the current crisis of academic integrity caused by the phenomenon of fabricated and semantically incorrect citations. In the era of 'fast science' and permanent citation inflation, human reviewers face extreme cognitive overload and time pressure, making it impossible to consistently verify literature sources. As a key solution, this paper proposes the deployment of autonomous AI agents (Agentic AI) designed for the deep semantic auditing of manuscripts. This technological shift is complemented by an innovative proposal to introduce mandatory authorial 'citation reports' that operationalize the concepts of citation classification. The resulting synergy between human expertise and machine precision relieves reviewers of their mechanical burden and can help strengthen the rigor, transparency, and credibility of peer review.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"11 ","pages":"1927189"},"PeriodicalIF":3.1,"publicationDate":"2026-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13601301/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149042362","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Epistemic justice in educational assessment: decolonizing measurement through indigenous knowledge systems and Afrocentric paradigms.","authors":"Moses Mhide Kpum, Velisiwe Gasa","doi":"10.3389/frma.2026.1903343","DOIUrl":"10.3389/frma.2026.1903343","url":null,"abstract":"<p><p>Educational assessment in many African contexts continues to be shaped largely by Eurocentric traditions of measurement that emphasize standardization, objectivity, and uniformity. While these approaches have contributed to the development of formal education systems, they have also tended to overlook or marginalize Indigenous Knowledge Systems (IKS), Afrocentric perspectives, and community-based ways of knowing. This raises important questions about whose knowledge is recognized and valued within existing assessment practices. This paper examines the issue of epistemic justice in educational assessment, with particular attention to how dominant assessment models may exclude culturally grounded forms of knowledge. Drawing on decolonial perspectives and Afrocentric scholarship, the study adopts a qualitative, conceptual approach to critically reflect on the assumptions underpinning current assessment frameworks in Anglophone, and predominantly Southern African, higher education systems. It argues that assessment is not merely a technical process but is shaped by broader historical, cultural, and political influences. The paper explores how indigenous ways of knowing, oral traditions, experiential learning, and communal validation are often insufficiently captured within conventional assessment formats. In response, it proposes more inclusive approaches that recognize multiple forms of knowledge and ways of demonstrating competence, including culturally responsive assessment practices and participatory, community-informed methods of evaluation, illustrated with documented institutional cases, and considers the implications of emerging digital and AI-based assessment tools, noting the risk that existing biases may be reproduced and amplified if such technologies are not carefully adapted to local contexts. The study contributes to ongoing discussions on decolonization and knowledge justice by highlighting the need to rethink assessment in ways that are more responsive to African realities and epistemologies, while remaining explicit about the geographic and linguistic boundaries of its own evidence base.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"11 ","pages":"1903343"},"PeriodicalIF":3.1,"publicationDate":"2026-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13597824/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149042312","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Tracking the evolution of tuberculosis research priorities in Africa: a longitudinal bibliometric analysis from 2003-2023.","authors":"Olusesan Adeyemi Adelabu, Peter Ayodeji Idowu, Jolly Musoke","doi":"10.3389/frma.2026.1931249","DOIUrl":"10.3389/frma.2026.1931249","url":null,"abstract":"<p><strong>Background: </strong><i>Mycobacterium tuberculosis</i> is the primary causative agent of pulmonary tuberculosis and remains a major global public health concern, particularly in low- and lower-middle-income countries. Tuberculosis continues to be one of the leading causes of death from infectious diseases and is a significant contributor to mortality among both HIV-positive and HIV-negative populations in Africa. Despite extensive epidemiological research on tuberculosis, bibliometric analyses focusing on African research output remain limited. This study therefore examined trends, patterns, and research gaps in tuberculosis-related publications across African countries.</p><p><strong>Methods: </strong>A bibliometric analysis was conducted using the Scopus database for publications between January 2003 and December 2023. The study selection process followed PRISMA guidelines. A total of 8,797 records were identified, of which 8,181 met the inclusion criteria after screening and eligibility assessment. Data were analyzed using RStudio (Bibliometrix package and Biblioshiny interface) and Microsoft Excel 2023. Analyses included authorship patterns, institutional and country contributions, publication trends, citation analysis, collaboration networks, leading journals, funding organizations, and thematic mapping.</p><p><strong>Results: </strong>Tuberculosis research output in Africa increased consistently over the study period. Articles accounted for most publications (75%), followed by reviews (10%) and conference papers (2%). South Africa was the most productive and most cited country, while the University of Cape Town demonstrated the strongest institutional collaboration network. Highly cited contributions included studies by Hoosen Coovadia et al. (2009) and Abdelkrim Boutayeb (2006). <i>PLOS ONE</i> published the highest number of articles, followed by the <i>South African Medical Journal</i> and the <i>International Journal of Tuberculosis and Lung Disease</i>. Collaboration networks showed strong intra-African and international linkages. Key research themes included HIV/TB co-infection, drug resistance, epidemiology, and public health interventions.</p><p><strong>Conclusion: </strong>Tuberculosis research in Africa has increased substantially over the past two decades, with growing emphasis on epidemiology, drug resistance, and HIV co-infection. South Africa remains the leading contributor, likely reflecting stronger research infrastructure and funding capacity. However, gaps persist in regionally balanced research output and collaboration. Strengthening intra-African and global partnerships, as well as supporting underrepresented regions, will be critical for advancing tuberculosis research and control efforts across the continent.</p><p><strong>Systematic review registration: </strong>https://doi.org/10.5281/zenodo.21672964.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"11 ","pages":"1931249"},"PeriodicalIF":3.1,"publicationDate":"2026-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13597710/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149032089","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"The venezuelan scientific diaspora as a transnational actor: knowledge circulation, STI cooperation, and development.","authors":"Luisa F Echeverría-King, Branislav Pantović, Kleinsy Bonilla, Daniela Moreno Garcia, Estiven González-Sarmiento","doi":"10.3389/frma.2026.1870192","DOIUrl":"10.3389/frma.2026.1870192","url":null,"abstract":"<p><p>This study examines the potential of the Venezuelan scientific diaspora to contribute to the development and strengthening of scientific and technological ecosystems in their countries and regions of residence. This study examines the engagement capacities, interests, collaborative practices, and perceived barriers of the Venezuelan scientific diaspora residing across different world regions. It further considers how these transnational capacities could support STI cooperation involving Venezuela and Latin America and the Caribbean. The methodology combines qualitative and quantitative approaches. Firstly, the article draws on the literature on scientific diasporas, transnational knowledge circulation, and ecosystem resilience to analyze the scientific diaspora as a transnational actor. Secondly, an online survey broadens the empirical base by capturing the experiences and perspectives of Venezuelan scientists abroad beyond formal networks. Thirdly, participatory focus groups with representatives of the Venezuelan scientific diaspora worldwide are used to identify key activities, strategies, and mechanisms of engagement. The findings provide a comprehensive understanding of the barriers to and opportunities for international cooperation and culminate in a set of actionable recommendations to strengthen the role of the Venezuelan scientific diaspora in advancing regional scientific and technological international collaboration.</p>","PeriodicalId":73104,"journal":{"name":"Frontiers in research metrics and analytics","volume":"11 ","pages":"1870192"},"PeriodicalIF":3.1,"publicationDate":"2026-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13590572/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"149018983","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}