A Multi-Task Information Extraction Framework for Bridge Inspection Based on Joint Neural Networks

Jianxi Yang, Xiaoxia Yang, Ren Li, Mengting Luo
{"title":"A Multi-Task Information Extraction Framework for Bridge Inspection Based on Joint Neural Networks","authors":"Jianxi Yang, Xiaoxia Yang, Ren Li, Mengting Luo","doi":"10.1109/icsai53574.2021.9664111","DOIUrl":null,"url":null,"abstract":"Focused on the issue that insufficient information extraction and knowledge services in the bridge management and maintenance domain, a multi-task information extraction framework for bridge inspection based on joint neural networks is proposed. Firstly, a multi-task information extraction training dataset for bridge inspection is constructed and a distributed representation of the text is obtained using BERT as the embedding layer. Secondly, the subtasks of topic word detection and other bridge inspection information extraction are jointly learned by sharing BERT weights and fine-tuning, and the context features are further extracted in depth. Finally, the bridge inspection knowledge service is used as application examples to verify the effectiveness of the bridge inspection information extraction model in actual application scenarios such as bridge domain question answering. In the comparison experiments with mainstream models, the proposed method outperforms the mainstream models with F1-score of 85.27%, 72.73%, and 90.76% for the NER, RE, and topic word detection respectively. The experimental results show that the model can meet the requirements of a variety of practical tasks for information extraction of bridge inspection.","PeriodicalId":131284,"journal":{"name":"2021 7th International Conference on Systems and Informatics (ICSAI)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 7th International Conference on Systems and Informatics (ICSAI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/icsai53574.2021.9664111","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

Focused on the issue that insufficient information extraction and knowledge services in the bridge management and maintenance domain, a multi-task information extraction framework for bridge inspection based on joint neural networks is proposed. Firstly, a multi-task information extraction training dataset for bridge inspection is constructed and a distributed representation of the text is obtained using BERT as the embedding layer. Secondly, the subtasks of topic word detection and other bridge inspection information extraction are jointly learned by sharing BERT weights and fine-tuning, and the context features are further extracted in depth. Finally, the bridge inspection knowledge service is used as application examples to verify the effectiveness of the bridge inspection information extraction model in actual application scenarios such as bridge domain question answering. In the comparison experiments with mainstream models, the proposed method outperforms the mainstream models with F1-score of 85.27%, 72.73%, and 90.76% for the NER, RE, and topic word detection respectively. The experimental results show that the model can meet the requirements of a variety of practical tasks for information extraction of bridge inspection.
基于联合神经网络的桥梁检测多任务信息提取框架
针对桥梁管理维修领域信息提取和知识服务不足的问题,提出了一种基于联合神经网络的桥梁检测多任务信息提取框架。首先,构建桥梁检测多任务信息提取训练数据集,利用BERT作为嵌入层得到文本的分布式表示;其次,通过共享BERT权值和微调,共同学习主题词检测和其他桥梁检测信息提取的子任务,并进一步深入提取上下文特征;最后,以桥梁检测知识服务为应用实例,验证了桥梁检测信息提取模型在桥梁领域问答等实际应用场景中的有效性。在与主流模型的对比实验中,本文方法在NER、RE和主题词检测上的f1得分分别为85.27%、72.73%和90.76%,优于主流模型。实验结果表明,该模型能够满足各种实际任务对桥梁检测信息提取的要求。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信