基于BERT-BiLSTM-CRF的电力安全法规知识图谱实体识别模型

Jianyou Yu, Jian Sun, Yunchang Dong, Dezhi Zhao, Xiaoyu Chen, Xianghong Chen
{"title":"基于BERT-BiLSTM-CRF的电力安全法规知识图谱实体识别模型","authors":"Jianyou Yu, Jian Sun, Yunchang Dong, Dezhi Zhao, Xiaoyu Chen, Xianghong Chen","doi":"10.1109/ICPECA51329.2021.9362652","DOIUrl":null,"url":null,"abstract":"In the process of constructing the knowledge graph of power safety regulations, the traditional named entity recognition method is difficult to effectively identify the key information of the entity because the boundary of the power safety entity is fuzzy and difficult to define. Therefore, this paper proposes a power safety named entity recognition model based on BERT-BiLSTM-CRF. First, the word vector expression layer based on Transformer’s bidirectional encoder (BERT) obtains word-level features; then the bidirectional long-short-term memory neural network (BiLSTM) layer is used to extract contextual features to form a feature matrix, thereby improving the accuracy of text feature extraction; The optimal tag sequence is generated by the conditional random field layer (CRF), and the output result is corrected. Through the analysis of experimental examples, the validity and superiority of the proposed model are verified.","PeriodicalId":119798,"journal":{"name":"2021 IEEE International Conference on Power Electronics, Computer Applications (ICPECA)","volume":"73 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Entity recognition model of power safety regulations knowledge graph based on BERT-BiLSTM-CRF\",\"authors\":\"Jianyou Yu, Jian Sun, Yunchang Dong, Dezhi Zhao, Xiaoyu Chen, Xianghong Chen\",\"doi\":\"10.1109/ICPECA51329.2021.9362652\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the process of constructing the knowledge graph of power safety regulations, the traditional named entity recognition method is difficult to effectively identify the key information of the entity because the boundary of the power safety entity is fuzzy and difficult to define. Therefore, this paper proposes a power safety named entity recognition model based on BERT-BiLSTM-CRF. First, the word vector expression layer based on Transformer’s bidirectional encoder (BERT) obtains word-level features; then the bidirectional long-short-term memory neural network (BiLSTM) layer is used to extract contextual features to form a feature matrix, thereby improving the accuracy of text feature extraction; The optimal tag sequence is generated by the conditional random field layer (CRF), and the output result is corrected. Through the analysis of experimental examples, the validity and superiority of the proposed model are verified.\",\"PeriodicalId\":119798,\"journal\":{\"name\":\"2021 IEEE International Conference on Power Electronics, Computer Applications (ICPECA)\",\"volume\":\"73 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-01-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE International Conference on Power Electronics, Computer Applications (ICPECA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICPECA51329.2021.9362652\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Power Electronics, Computer Applications (ICPECA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICPECA51329.2021.9362652","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

摘要

在构建电力安全法规知识图谱的过程中,由于电力安全实体边界模糊、难以定义,传统的命名实体识别方法难以有效识别实体的关键信息。为此,本文提出了一种基于BERT-BiLSTM-CRF的电力安全命名实体识别模型。首先,基于Transformer双向编码器(BERT)的词向量表达层获得词级特征;然后利用双向长短期记忆神经网络(BiLSTM)层提取上下文特征,形成特征矩阵,从而提高文本特征提取的准确性;由条件随机场层(conditional random field layer, CRF)生成最优标签序列,并对输出结果进行校正。通过实例分析,验证了所提模型的有效性和优越性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Entity recognition model of power safety regulations knowledge graph based on BERT-BiLSTM-CRF
In the process of constructing the knowledge graph of power safety regulations, the traditional named entity recognition method is difficult to effectively identify the key information of the entity because the boundary of the power safety entity is fuzzy and difficult to define. Therefore, this paper proposes a power safety named entity recognition model based on BERT-BiLSTM-CRF. First, the word vector expression layer based on Transformer’s bidirectional encoder (BERT) obtains word-level features; then the bidirectional long-short-term memory neural network (BiLSTM) layer is used to extract contextual features to form a feature matrix, thereby improving the accuracy of text feature extraction; The optimal tag sequence is generated by the conditional random field layer (CRF), and the output result is corrected. Through the analysis of experimental examples, the validity and superiority of the proposed model are verified.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信