Dongbo Dai , Guangjie Zhang , Xiao Wei , Yudian Lin , Mengmeng Dai , Junjie Peng , Na Song , Zheng Tang , Shengzhou Li , Jiwei Liu , Yan Xu , Renchao Che , Huiran Zhang
{"title":"在人工标注数据有限的情况下,从大量电磁波吸收材料文献中提取领域知识的 GPT 辅助迭代法","authors":"Dongbo Dai , Guangjie Zhang , Xiao Wei , Yudian Lin , Mengmeng Dai , Junjie Peng , Na Song , Zheng Tang , Shengzhou Li , Jiwei Liu , Yan Xu , Renchao Che , Huiran Zhang","doi":"10.1016/j.commatsci.2024.113431","DOIUrl":null,"url":null,"abstract":"<div><div>Research on electromagnetic wave absorbing materials is an important part of materials science. Each year, a substantial amount of academic literature is published in this field, containing critical information. Rapid and effective knowledge extraction from these documents is key to accelerating field development, and automated knowledge extraction based on deep learning provides a solution to this challenge. However, deep learning models typically require extensive annotated data for training, which is time-consuming and expensive to obtain in highly specialized subfields. To address this issue, this paper presents a GPT-assisted iterative training method that uses only 30 manually annotated literature abstracts as a training set and ultimately achieves an F1 score of 82.94% for a named entity recognition model (NER). The effectiveness of this model is demonstrated by comparing with other large language models commonly used in materials science on a custom dataset. We constructed a knowledge extraction framework centered around the obtained NER model and collected literature on electromagnetic wave absorbing materials from the last decade. The extraction and application results demonstrate the practicality of our framework.</div></div>","PeriodicalId":10650,"journal":{"name":"Computational Materials Science","volume":"246 ","pages":"Article 113431"},"PeriodicalIF":3.1000,"publicationDate":"2024-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A GPT-assisted iterative method for extracting domain knowledge from a large volume of literature of electromagnetic wave absorbing materials with limited manually annotated data\",\"authors\":\"Dongbo Dai , Guangjie Zhang , Xiao Wei , Yudian Lin , Mengmeng Dai , Junjie Peng , Na Song , Zheng Tang , Shengzhou Li , Jiwei Liu , Yan Xu , Renchao Che , Huiran Zhang\",\"doi\":\"10.1016/j.commatsci.2024.113431\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Research on electromagnetic wave absorbing materials is an important part of materials science. Each year, a substantial amount of academic literature is published in this field, containing critical information. Rapid and effective knowledge extraction from these documents is key to accelerating field development, and automated knowledge extraction based on deep learning provides a solution to this challenge. However, deep learning models typically require extensive annotated data for training, which is time-consuming and expensive to obtain in highly specialized subfields. To address this issue, this paper presents a GPT-assisted iterative training method that uses only 30 manually annotated literature abstracts as a training set and ultimately achieves an F1 score of 82.94% for a named entity recognition model (NER). The effectiveness of this model is demonstrated by comparing with other large language models commonly used in materials science on a custom dataset. We constructed a knowledge extraction framework centered around the obtained NER model and collected literature on electromagnetic wave absorbing materials from the last decade. The extraction and application results demonstrate the practicality of our framework.</div></div>\",\"PeriodicalId\":10650,\"journal\":{\"name\":\"Computational Materials Science\",\"volume\":\"246 \",\"pages\":\"Article 113431\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2024-10-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computational Materials Science\",\"FirstCategoryId\":\"88\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0927025624006529\",\"RegionNum\":3,\"RegionCategory\":\"材料科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATERIALS SCIENCE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computational Materials Science","FirstCategoryId":"88","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0927025624006529","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
摘要
电磁波吸收材料研究是材料科学的重要组成部分。每年,该领域都会发表大量学术文献,其中包含重要信息。从这些文献中快速有效地提取知识是加速领域发展的关键,而基于深度学习的自动知识提取为这一挑战提供了解决方案。然而,深度学习模型通常需要大量带注释的数据进行训练,而在高度专业化的子领域中,获取这些数据既耗时又昂贵。为解决这一问题,本文提出了一种 GPT 辅助迭代训练方法,该方法仅使用 30 篇人工标注的文献摘要作为训练集,最终使命名实体识别模型(NER)的 F1 得分达到 82.94%。通过在定制数据集上与材料科学领域常用的其他大型语言模型进行比较,证明了该模型的有效性。我们以获得的 NER 模型为中心构建了一个知识提取框架,并收集了近十年来有关电磁波吸收材料的文献。提取和应用结果证明了我们框架的实用性。
A GPT-assisted iterative method for extracting domain knowledge from a large volume of literature of electromagnetic wave absorbing materials with limited manually annotated data
Research on electromagnetic wave absorbing materials is an important part of materials science. Each year, a substantial amount of academic literature is published in this field, containing critical information. Rapid and effective knowledge extraction from these documents is key to accelerating field development, and automated knowledge extraction based on deep learning provides a solution to this challenge. However, deep learning models typically require extensive annotated data for training, which is time-consuming and expensive to obtain in highly specialized subfields. To address this issue, this paper presents a GPT-assisted iterative training method that uses only 30 manually annotated literature abstracts as a training set and ultimately achieves an F1 score of 82.94% for a named entity recognition model (NER). The effectiveness of this model is demonstrated by comparing with other large language models commonly used in materials science on a custom dataset. We constructed a knowledge extraction framework centered around the obtained NER model and collected literature on electromagnetic wave absorbing materials from the last decade. The extraction and application results demonstrate the practicality of our framework.
期刊介绍:
The goal of Computational Materials Science is to report on results that provide new or unique insights into, or significantly expand our understanding of, the properties of materials or phenomena associated with their design, synthesis, processing, characterization, and utilization. To be relevant to the journal, the results should be applied or applicable to specific material systems that are discussed within the submission.