Hang He, Chao Ma, Shan Ye, Wenqiang Tang, Yuxuan Zhou, Zhen Yu, Jiaxin Yi, Li Hou, Mingcai Hou
{"title":"基于提示学习的低资源中文地质文本命名实体识别","authors":"Hang He, Chao Ma, Shan Ye, Wenqiang Tang, Yuxuan Zhou, Zhen Yu, Jiaxin Yi, Li Hou, Mingcai Hou","doi":"10.1007/s12583-023-1944-8","DOIUrl":null,"url":null,"abstract":"<p>Geological reports are a significant accomplishment for geologists involved in geological investigations and scientific research as they contain rich data and textual information. With the rapid development of science and technology, a large number of textual reports have accumulated in the field of geology. However, many non-hot topics and non-English speaking regions are neglected in mainstream geoscience databases for geological information mining, making it more challenging for some researchers to extract necessary information from these texts. Natural Language Processing (NLP) has obvious advantages in processing large amounts of textual data. The objective of this paper is to identify geological named entities from Chinese geological texts using NLP techniques. We propose the Ro-BERTa-Prompt-Tuning-NER method, which leverages the concept of Prompt Learning and requires only a small amount of annotated data to train superior models for recognizing geological named entities in low-resource dataset configurations. The RoBERTa layer captures context-based information and longer-distance dependencies through dynamic word vectors. Finally, we conducted experiments on the constructed Geological Named Entity Recognition (GNER) dataset. Our experimental results show that the proposed model achieves the highest F1 score of 80.64% among the four baseline algorithms, demonstrating the reliability and robustness of using the model for Named Entity Recognition of geological texts.</p>","PeriodicalId":15607,"journal":{"name":"Journal of Earth Science","volume":"76 1","pages":""},"PeriodicalIF":4.1000,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Low Resource Chinese Geological Text Named Entity Recognition Based on Prompt Learning\",\"authors\":\"Hang He, Chao Ma, Shan Ye, Wenqiang Tang, Yuxuan Zhou, Zhen Yu, Jiaxin Yi, Li Hou, Mingcai Hou\",\"doi\":\"10.1007/s12583-023-1944-8\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Geological reports are a significant accomplishment for geologists involved in geological investigations and scientific research as they contain rich data and textual information. With the rapid development of science and technology, a large number of textual reports have accumulated in the field of geology. However, many non-hot topics and non-English speaking regions are neglected in mainstream geoscience databases for geological information mining, making it more challenging for some researchers to extract necessary information from these texts. Natural Language Processing (NLP) has obvious advantages in processing large amounts of textual data. The objective of this paper is to identify geological named entities from Chinese geological texts using NLP techniques. We propose the Ro-BERTa-Prompt-Tuning-NER method, which leverages the concept of Prompt Learning and requires only a small amount of annotated data to train superior models for recognizing geological named entities in low-resource dataset configurations. The RoBERTa layer captures context-based information and longer-distance dependencies through dynamic word vectors. Finally, we conducted experiments on the constructed Geological Named Entity Recognition (GNER) dataset. Our experimental results show that the proposed model achieves the highest F1 score of 80.64% among the four baseline algorithms, demonstrating the reliability and robustness of using the model for Named Entity Recognition of geological texts.</p>\",\"PeriodicalId\":15607,\"journal\":{\"name\":\"Journal of Earth Science\",\"volume\":\"76 1\",\"pages\":\"\"},\"PeriodicalIF\":4.1000,\"publicationDate\":\"2024-06-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Earth Science\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://doi.org/10.1007/s12583-023-1944-8\",\"RegionNum\":2,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOSCIENCES, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Earth Science","FirstCategoryId":"89","ListUrlMain":"https://doi.org/10.1007/s12583-023-1944-8","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOSCIENCES, MULTIDISCIPLINARY","Score":null,"Total":0}
Low Resource Chinese Geological Text Named Entity Recognition Based on Prompt Learning
Geological reports are a significant accomplishment for geologists involved in geological investigations and scientific research as they contain rich data and textual information. With the rapid development of science and technology, a large number of textual reports have accumulated in the field of geology. However, many non-hot topics and non-English speaking regions are neglected in mainstream geoscience databases for geological information mining, making it more challenging for some researchers to extract necessary information from these texts. Natural Language Processing (NLP) has obvious advantages in processing large amounts of textual data. The objective of this paper is to identify geological named entities from Chinese geological texts using NLP techniques. We propose the Ro-BERTa-Prompt-Tuning-NER method, which leverages the concept of Prompt Learning and requires only a small amount of annotated data to train superior models for recognizing geological named entities in low-resource dataset configurations. The RoBERTa layer captures context-based information and longer-distance dependencies through dynamic word vectors. Finally, we conducted experiments on the constructed Geological Named Entity Recognition (GNER) dataset. Our experimental results show that the proposed model achieves the highest F1 score of 80.64% among the four baseline algorithms, demonstrating the reliability and robustness of using the model for Named Entity Recognition of geological texts.
期刊介绍:
Journal of Earth Science (previously known as Journal of China University of Geosciences), issued bimonthly through China University of Geosciences, covers all branches of geology and related technology in the exploration and utilization of earth resources. Founded in 1990 as the Journal of China University of Geosciences, this publication is expanding its breadth of coverage to an international scope. Coverage includes such topics as geology, petrology, mineralogy, ore deposit geology, tectonics, paleontology, stratigraphy, sedimentology, geochemistry, geophysics and environmental sciences.
Articles published in recent issues include Tectonics in the Northwestern West Philippine Basin; Creep Damage Characteristics of Soft Rock under Disturbance Loads; Simplicial Indicator Kriging; Tephra Discovered in High Resolution Peat Sediment and Its Indication to Climatic Event.
The journal offers discussion of new theories, methods and discoveries; reports on recent achievements in the geosciences; and timely reviews of selected subjects.