{"title":"一种结合关键词和自关注机制的命名实体识别方法","authors":"Qinwu Wang, Huifang Su, Yongwei Wang, Pengcheng Liu, Yifei Wang, Shengnan Zhou","doi":"10.1109/ISCTIS58954.2023.10213054","DOIUrl":null,"url":null,"abstract":"As the basis of natural language processing tasks such as information extraction and machine question answering, named entity recognition has important research significance. However, traditional models have less consideration for utilizing the feature information of the text. To address this issue, this paper proposes a named entity recognition model that integrates keyword and self attention mechanism based on the HBT model.The model has made two improvements from the perspective of enhancing the utilization of text's own feature information: one is to introduce keyword feature vectors, and the other is to use multi head self attention mechanism for encoding layer vectors. The experimental results show that the improved model achieves an F1 value of 70.74% on the DuIE2.0 dataset, which is significantly improved compared to the benchmark model.","PeriodicalId":334790,"journal":{"name":"2023 3rd International Symposium on Computer Technology and Information Science (ISCTIS)","volume":"72 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Named Entity Recognition Method Combining Keyword and Self attention Mechanism\",\"authors\":\"Qinwu Wang, Huifang Su, Yongwei Wang, Pengcheng Liu, Yifei Wang, Shengnan Zhou\",\"doi\":\"10.1109/ISCTIS58954.2023.10213054\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"As the basis of natural language processing tasks such as information extraction and machine question answering, named entity recognition has important research significance. However, traditional models have less consideration for utilizing the feature information of the text. To address this issue, this paper proposes a named entity recognition model that integrates keyword and self attention mechanism based on the HBT model.The model has made two improvements from the perspective of enhancing the utilization of text's own feature information: one is to introduce keyword feature vectors, and the other is to use multi head self attention mechanism for encoding layer vectors. The experimental results show that the improved model achieves an F1 value of 70.74% on the DuIE2.0 dataset, which is significantly improved compared to the benchmark model.\",\"PeriodicalId\":334790,\"journal\":{\"name\":\"2023 3rd International Symposium on Computer Technology and Information Science (ISCTIS)\",\"volume\":\"72 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-07-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 3rd International Symposium on Computer Technology and Information Science (ISCTIS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISCTIS58954.2023.10213054\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 3rd International Symposium on Computer Technology and Information Science (ISCTIS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISCTIS58954.2023.10213054","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Named Entity Recognition Method Combining Keyword and Self attention Mechanism
As the basis of natural language processing tasks such as information extraction and machine question answering, named entity recognition has important research significance. However, traditional models have less consideration for utilizing the feature information of the text. To address this issue, this paper proposes a named entity recognition model that integrates keyword and self attention mechanism based on the HBT model.The model has made two improvements from the perspective of enhancing the utilization of text's own feature information: one is to introduce keyword feature vectors, and the other is to use multi head self attention mechanism for encoding layer vectors. The experimental results show that the improved model achieves an F1 value of 70.74% on the DuIE2.0 dataset, which is significantly improved compared to the benchmark model.