Xiaoqi Liao, Yufei Li, Yiwei Lou, Xinliang Ge, Shijie Gao, Pan Sun
{"title":"基于BERT和实体名称嵌入的SG-CIM实体链接方法","authors":"Xiaoqi Liao, Yufei Li, Yiwei Lou, Xinliang Ge, Shijie Gao, Pan Sun","doi":"10.1109/AINIT59027.2023.10212510","DOIUrl":null,"url":null,"abstract":"The current iteration of the SG-CIM (State Grid Common Information Model) requires manual extraction of entity attributes from texts such as design plans and reports. To address the problems of slow update time and the high error rate of manual iteration data, this paper presents an entity linking method combing deep learning and knowledge base. Firstly, the SG-CIM model is used to construct a knowledge base of grid data used as a vector embedding of entities; Secondly, the joint recognition model of BERT-CRF and BERT-ENE(BERT-Entity Name Embeddings) is used for named entity recognition, where the BERT-ENE model can be used for dictionary matching of entity descriptions in the knowledge base; Then BERT-based binary classification model to predict the candidate entities, select the entity with the highest probability as the result, realize the entity disambiguation of alternate entities and new entities; Finally add the found important new entities to the SG-CIM model to realize the automated iteration of SG-CIM model. According to the experimental findings, the Entity Linking approaches have an F1-score of over 80%.","PeriodicalId":276778,"journal":{"name":"2023 4th International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The SG-CIM Entity Linking Method Based on BERT and Entity Name Embeddings\",\"authors\":\"Xiaoqi Liao, Yufei Li, Yiwei Lou, Xinliang Ge, Shijie Gao, Pan Sun\",\"doi\":\"10.1109/AINIT59027.2023.10212510\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The current iteration of the SG-CIM (State Grid Common Information Model) requires manual extraction of entity attributes from texts such as design plans and reports. To address the problems of slow update time and the high error rate of manual iteration data, this paper presents an entity linking method combing deep learning and knowledge base. Firstly, the SG-CIM model is used to construct a knowledge base of grid data used as a vector embedding of entities; Secondly, the joint recognition model of BERT-CRF and BERT-ENE(BERT-Entity Name Embeddings) is used for named entity recognition, where the BERT-ENE model can be used for dictionary matching of entity descriptions in the knowledge base; Then BERT-based binary classification model to predict the candidate entities, select the entity with the highest probability as the result, realize the entity disambiguation of alternate entities and new entities; Finally add the found important new entities to the SG-CIM model to realize the automated iteration of SG-CIM model. According to the experimental findings, the Entity Linking approaches have an F1-score of over 80%.\",\"PeriodicalId\":276778,\"journal\":{\"name\":\"2023 4th International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 4th International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AINIT59027.2023.10212510\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 4th International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AINIT59027.2023.10212510","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
当前迭代的SG-CIM(国家电网公共信息模型)需要从设计计划和报告等文本中手动提取实体属性。针对人工迭代数据更新速度慢、错误率高的问题,提出了一种深度学习与知识库相结合的实体链接方法。首先,利用SG-CIM模型构建网格数据知识库,作为实体向量嵌入;其次,将BERT-CRF和BERT-ENE(BERT-Entity Name Embeddings)联合识别模型用于命名实体识别,其中BERT-ENE模型可用于知识库中实体描述的字典匹配;然后基于bert的二值分类模型对候选实体进行预测,选择概率最高的实体作为结果,实现替代实体和新实体的实体消歧;最后将发现的重要新实体添加到SG-CIM模型中,实现SG-CIM模型的自动迭代。实验结果表明,实体链接方法的f1得分在80%以上。
The SG-CIM Entity Linking Method Based on BERT and Entity Name Embeddings
The current iteration of the SG-CIM (State Grid Common Information Model) requires manual extraction of entity attributes from texts such as design plans and reports. To address the problems of slow update time and the high error rate of manual iteration data, this paper presents an entity linking method combing deep learning and knowledge base. Firstly, the SG-CIM model is used to construct a knowledge base of grid data used as a vector embedding of entities; Secondly, the joint recognition model of BERT-CRF and BERT-ENE(BERT-Entity Name Embeddings) is used for named entity recognition, where the BERT-ENE model can be used for dictionary matching of entity descriptions in the knowledge base; Then BERT-based binary classification model to predict the candidate entities, select the entity with the highest probability as the result, realize the entity disambiguation of alternate entities and new entities; Finally add the found important new entities to the SG-CIM model to realize the automated iteration of SG-CIM model. According to the experimental findings, the Entity Linking approaches have an F1-score of over 80%.