食品安全命名实体识别方法实现研究

Qi Wang, Yuntao Shi, J. Li, Shuqin Li, Meng Zhou
{"title":"食品安全命名实体识别方法实现研究","authors":"Qi Wang, Yuntao Shi, J. Li, Shuqin Li, Meng Zhou","doi":"10.1109/iip57348.2022.00011","DOIUrl":null,"url":null,"abstract":"In order to improve the relevance and efficiency of food safety supervision, a food safety knowledge database and a named entity recognition (NER) model that can extract food safety entities such as poison, disease, and symptom has been constructed. First, the key content of ‘‘Food Safety Accident Determination and Prevention Control’’ was identified, and 8265 valid statements were obtained. It then used data cleaning and sequence marking to obtain the dataset, dividing the dataset into training, validation and test sets in the ratio of 8:1:1. The Chinese food-safety domain NER model was constructed by introducing a bidirectional encoder representation from transformers (BERT) as a vector embedding model based on a bi-directional long short-term memory (BiLSTM) combined with a conditional random field (CRF). The BERT-BiLSTM-CRF model achieved 96.96% accuracy, 83.87% precision, 87.14% recall and an F1 value of 85.48, with low model error and high accuracy, and successfully extracted eight types of entities: poison, disease, host, category, source, symptom, disinfection method and drug. The NER model for food safety based on the BERT-BiLSTM-CRF has high accuracy and can establish an exclusive knowledge base for food safety, which helps improve food safety supervision efficiency.","PeriodicalId":412907,"journal":{"name":"2022 4th International Conference on Intelligent Information Processing (IIP)","volume":"88 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Study on the named entity recognition method implementation for food safety\",\"authors\":\"Qi Wang, Yuntao Shi, J. Li, Shuqin Li, Meng Zhou\",\"doi\":\"10.1109/iip57348.2022.00011\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In order to improve the relevance and efficiency of food safety supervision, a food safety knowledge database and a named entity recognition (NER) model that can extract food safety entities such as poison, disease, and symptom has been constructed. First, the key content of ‘‘Food Safety Accident Determination and Prevention Control’’ was identified, and 8265 valid statements were obtained. It then used data cleaning and sequence marking to obtain the dataset, dividing the dataset into training, validation and test sets in the ratio of 8:1:1. The Chinese food-safety domain NER model was constructed by introducing a bidirectional encoder representation from transformers (BERT) as a vector embedding model based on a bi-directional long short-term memory (BiLSTM) combined with a conditional random field (CRF). The BERT-BiLSTM-CRF model achieved 96.96% accuracy, 83.87% precision, 87.14% recall and an F1 value of 85.48, with low model error and high accuracy, and successfully extracted eight types of entities: poison, disease, host, category, source, symptom, disinfection method and drug. The NER model for food safety based on the BERT-BiLSTM-CRF has high accuracy and can establish an exclusive knowledge base for food safety, which helps improve food safety supervision efficiency.\",\"PeriodicalId\":412907,\"journal\":{\"name\":\"2022 4th International Conference on Intelligent Information Processing (IIP)\",\"volume\":\"88 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 4th International Conference on Intelligent Information Processing (IIP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/iip57348.2022.00011\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 4th International Conference on Intelligent Information Processing (IIP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/iip57348.2022.00011","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

为了提高食品安全监管的相关性和效率,构建了食品安全知识库和命名实体识别(NER)模型,可以提取出毒物、疾病、症状等食品安全实体。首先,确定了《食品安全事故认定与防控》的重点内容,获得有效陈述8265条。然后使用数据清洗和序列标记得到数据集,将数据集按8:1:1的比例划分为训练集、验证集和测试集。基于双向长短期记忆(BiLSTM)和条件随机场(CRF)的向量嵌入模型,引入变压器双向编码器表示(BERT),构建了中国食品安全领域NER模型。BERT-BiLSTM-CRF模型准确率为96.96%,精密度为83.87%,召回率为87.14%,F1值为85.48,模型误差低,准确率高,成功提取了毒物、疾病、宿主、类别、来源、症状、消毒方法和药物8类实体。基于BERT-BiLSTM-CRF的食品安全NER模型准确率高,可以建立食品安全专有知识库,有助于提高食品安全监管效率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Study on the named entity recognition method implementation for food safety
In order to improve the relevance and efficiency of food safety supervision, a food safety knowledge database and a named entity recognition (NER) model that can extract food safety entities such as poison, disease, and symptom has been constructed. First, the key content of ‘‘Food Safety Accident Determination and Prevention Control’’ was identified, and 8265 valid statements were obtained. It then used data cleaning and sequence marking to obtain the dataset, dividing the dataset into training, validation and test sets in the ratio of 8:1:1. The Chinese food-safety domain NER model was constructed by introducing a bidirectional encoder representation from transformers (BERT) as a vector embedding model based on a bi-directional long short-term memory (BiLSTM) combined with a conditional random field (CRF). The BERT-BiLSTM-CRF model achieved 96.96% accuracy, 83.87% precision, 87.14% recall and an F1 value of 85.48, with low model error and high accuracy, and successfully extracted eight types of entities: poison, disease, host, category, source, symptom, disinfection method and drug. The NER model for food safety based on the BERT-BiLSTM-CRF has high accuracy and can establish an exclusive knowledge base for food safety, which helps improve food safety supervision efficiency.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信