基于自关注机制和特征融合的法律推荐

Lei Liu, Dezhi An
{"title":"基于自关注机制和特征融合的法律推荐","authors":"Lei Liu, Dezhi An","doi":"10.1145/3520084.3520101","DOIUrl":null,"url":null,"abstract":"Aiming at the problem of insufficient understanding of features and time-consuming calculation of long short-term memory networks in convolutional neural networks when extracting features, and the problem that both of them cannot reflect the importance of each word in the whole when extracting features, a method of law recommendation based on self-attention mechanism and feature fusion is proposed. Firstly, the text is preprocessed and Word2vec is used for word vectorization. Then the BIGRU model is used to extract the context features of the text, and the self-attention mechanism is added to extract the weighted information after the BIGRU features are extracted. CNN model is used to extract local features of text; finally, the characteristics of attention mechanism and CNN are fused to effectively solve the problems existing in a single model. The experimental results of the data set from the Judiciary Artificial Intelligence Challenge of China Law Research Cup show that the proposed model is better than the single model and its improved model.","PeriodicalId":444957,"journal":{"name":"Proceedings of the 2022 5th International Conference on Software Engineering and Information Management","volume":"18 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-01-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Law Recommendation Based on Self - Attention Mechanism and Feature Fusion\",\"authors\":\"Lei Liu, Dezhi An\",\"doi\":\"10.1145/3520084.3520101\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Aiming at the problem of insufficient understanding of features and time-consuming calculation of long short-term memory networks in convolutional neural networks when extracting features, and the problem that both of them cannot reflect the importance of each word in the whole when extracting features, a method of law recommendation based on self-attention mechanism and feature fusion is proposed. Firstly, the text is preprocessed and Word2vec is used for word vectorization. Then the BIGRU model is used to extract the context features of the text, and the self-attention mechanism is added to extract the weighted information after the BIGRU features are extracted. CNN model is used to extract local features of text; finally, the characteristics of attention mechanism and CNN are fused to effectively solve the problems existing in a single model. The experimental results of the data set from the Judiciary Artificial Intelligence Challenge of China Law Research Cup show that the proposed model is better than the single model and its improved model.\",\"PeriodicalId\":444957,\"journal\":{\"name\":\"Proceedings of the 2022 5th International Conference on Software Engineering and Information Management\",\"volume\":\"18 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-01-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2022 5th International Conference on Software Engineering and Information Management\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3520084.3520101\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2022 5th International Conference on Software Engineering and Information Management","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3520084.3520101","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

针对卷积神经网络中长短期记忆网络在提取特征时对特征的理解不足、计算耗时,以及两者在提取特征时都不能反映整体中每个词的重要性的问题,提出了一种基于自注意机制和特征融合的规律推荐方法。首先对文本进行预处理,使用Word2vec进行词矢量化;然后利用BIGRU模型提取文本的上下文特征,在提取BIGRU特征后加入自关注机制提取权重信息。采用CNN模型提取文本的局部特征;最后,将注意机制的特点与CNN相融合,有效解决了单一模型存在的问题。中国法律研究杯司法人工智能挑战赛数据集的实验结果表明,该模型优于单一模型及其改进模型。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Law Recommendation Based on Self - Attention Mechanism and Feature Fusion
Aiming at the problem of insufficient understanding of features and time-consuming calculation of long short-term memory networks in convolutional neural networks when extracting features, and the problem that both of them cannot reflect the importance of each word in the whole when extracting features, a method of law recommendation based on self-attention mechanism and feature fusion is proposed. Firstly, the text is preprocessed and Word2vec is used for word vectorization. Then the BIGRU model is used to extract the context features of the text, and the self-attention mechanism is added to extract the weighted information after the BIGRU features are extracted. CNN model is used to extract local features of text; finally, the characteristics of attention mechanism and CNN are fused to effectively solve the problems existing in a single model. The experimental results of the data set from the Judiciary Artificial Intelligence Challenge of China Law Research Cup show that the proposed model is better than the single model and its improved model.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信