Yiwei Lu, Ruopeng Yang, Xuping Jiang, Changsheng Yin, Xiaoyu Song, Bo Liu
{"title":"基于BERT-BiGRU-Attention的军事事件检测方法研究","authors":"Yiwei Lu, Ruopeng Yang, Xuping Jiang, Changsheng Yin, Xiaoyu Song, Bo Liu","doi":"10.1109/ICCECE51280.2021.9342214","DOIUrl":null,"url":null,"abstract":"Military event detection is one of the main tasks of military information extraction, which aims to identify event information in unstructured military text. Event detection is the first step of military event detection. Traditional military event detection methods are difficult to solve the problems of insufficient artificial features, inaccurate Chinese word segmentation in military field, and insufficient utilization of entity relationship features between sentences. Therefore, based on the pre-trained model (BERT), this paper proposes a military event detection method which combines BiGRU and attention mechanism. The language model is trained to construct a vector representation method combining word vector and position vector. BiGRU neural network is used to learn the above semantic features, and the attention mechanism is integrated to improve the expression ability of semantic features of sentences. This paper constructs a certain number of military text corpus. The experimental results show that our model improves the efficiency of military event detection compared with the traditional non attention model.","PeriodicalId":229425,"journal":{"name":"2021 IEEE International Conference on Consumer Electronics and Computer Engineering (ICCECE)","volume":"170 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Research on Military Event Detection Method Based on BERT-BiGRU-Attention\",\"authors\":\"Yiwei Lu, Ruopeng Yang, Xuping Jiang, Changsheng Yin, Xiaoyu Song, Bo Liu\",\"doi\":\"10.1109/ICCECE51280.2021.9342214\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Military event detection is one of the main tasks of military information extraction, which aims to identify event information in unstructured military text. Event detection is the first step of military event detection. Traditional military event detection methods are difficult to solve the problems of insufficient artificial features, inaccurate Chinese word segmentation in military field, and insufficient utilization of entity relationship features between sentences. Therefore, based on the pre-trained model (BERT), this paper proposes a military event detection method which combines BiGRU and attention mechanism. The language model is trained to construct a vector representation method combining word vector and position vector. BiGRU neural network is used to learn the above semantic features, and the attention mechanism is integrated to improve the expression ability of semantic features of sentences. This paper constructs a certain number of military text corpus. The experimental results show that our model improves the efficiency of military event detection compared with the traditional non attention model.\",\"PeriodicalId\":229425,\"journal\":{\"name\":\"2021 IEEE International Conference on Consumer Electronics and Computer Engineering (ICCECE)\",\"volume\":\"170 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-01-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE International Conference on Consumer Electronics and Computer Engineering (ICCECE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCECE51280.2021.9342214\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Consumer Electronics and Computer Engineering (ICCECE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCECE51280.2021.9342214","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Research on Military Event Detection Method Based on BERT-BiGRU-Attention
Military event detection is one of the main tasks of military information extraction, which aims to identify event information in unstructured military text. Event detection is the first step of military event detection. Traditional military event detection methods are difficult to solve the problems of insufficient artificial features, inaccurate Chinese word segmentation in military field, and insufficient utilization of entity relationship features between sentences. Therefore, based on the pre-trained model (BERT), this paper proposes a military event detection method which combines BiGRU and attention mechanism. The language model is trained to construct a vector representation method combining word vector and position vector. BiGRU neural network is used to learn the above semantic features, and the attention mechanism is integrated to improve the expression ability of semantic features of sentences. This paper constructs a certain number of military text corpus. The experimental results show that our model improves the efficiency of military event detection compared with the traditional non attention model.