{"title":"Exploring the potential of novel research proposals as signals of successful national R&D: A case study on energy and resource sector in South Korea","authors":"Jaemin Chung , Janghyeok Yoon , Jaewoong Choi","doi":"10.1016/j.joi.2025.101722","DOIUrl":null,"url":null,"abstract":"<div><div>The success of national R&D projects plays a vital role in sustaining the long-term growth of the domestic techno-economic system and strengthening the innovation capacity of the national innovation system. While successful R&D projects are often characterized by ex-post (e.g., significant R&D performance) and ex-ante (e.g., novel research content) factors, their empirical relationship remains unclear. This study quantitatively examines whether the novelty of research proposals serves as a potential indicator of successful national R&D. Using a transformer-based language model and a local outlier factor, we measure the semantic novelty of research proposals by measuring their differentiation from existing paradigms. We conduct a statistical analysis to examine how the novelty of research proposals moderates the effects of R&D investment on R&D performance. A case study of 12,243 research proposals in South Korea’s energy and resource sector shows that the proposed novelty indicator exhibits a statistically significant association with both R&D investment and performance levels. We also show that novelty positively moderates the relationship between R&D investment and performance. The empirical results are expected to provide insights into understanding successful national R&D projects by revealing the relationships between novel research proposals, R&D investment, and performance in various contexts. The proposed approach and its systematic process are expected to guide experts in continuously monitoring national R&D trends and evaluating research proposals in the era of open innovation.</div></div>","PeriodicalId":48662,"journal":{"name":"Journal of Informetrics","volume":"19 4","pages":"Article 101722"},"PeriodicalIF":3.5000,"publicationDate":"2025-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Informetrics","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1751157725000859","RegionNum":2,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
The success of national R&D projects plays a vital role in sustaining the long-term growth of the domestic techno-economic system and strengthening the innovation capacity of the national innovation system. While successful R&D projects are often characterized by ex-post (e.g., significant R&D performance) and ex-ante (e.g., novel research content) factors, their empirical relationship remains unclear. This study quantitatively examines whether the novelty of research proposals serves as a potential indicator of successful national R&D. Using a transformer-based language model and a local outlier factor, we measure the semantic novelty of research proposals by measuring their differentiation from existing paradigms. We conduct a statistical analysis to examine how the novelty of research proposals moderates the effects of R&D investment on R&D performance. A case study of 12,243 research proposals in South Korea’s energy and resource sector shows that the proposed novelty indicator exhibits a statistically significant association with both R&D investment and performance levels. We also show that novelty positively moderates the relationship between R&D investment and performance. The empirical results are expected to provide insights into understanding successful national R&D projects by revealing the relationships between novel research proposals, R&D investment, and performance in various contexts. The proposed approach and its systematic process are expected to guide experts in continuously monitoring national R&D trends and evaluating research proposals in the era of open innovation.
期刊介绍:
Journal of Informetrics (JOI) publishes rigorous high-quality research on quantitative aspects of information science. The main focus of the journal is on topics in bibliometrics, scientometrics, webometrics, patentometrics, altmetrics and research evaluation. Contributions studying informetric problems using methods from other quantitative fields, such as mathematics, statistics, computer science, economics and econometrics, and network science, are especially encouraged. JOI publishes both theoretical and empirical work. In general, case studies, for instance a bibliometric analysis focusing on a specific research field or a specific country, are not considered suitable for publication in JOI, unless they contain innovative methodological elements.