基于协同关注的动态路由少射关系分类模型

Chun-Yuan Huang, Yuliang Wei, Bailing Wang, Guodong Xin, Wei Wang, Qinggang He
{"title":"基于协同关注的动态路由少射关系分类模型","authors":"Chun-Yuan Huang, Yuliang Wei, Bailing Wang, Guodong Xin, Wei Wang, Qinggang He","doi":"10.1109/ICISCAE51034.2020.9236846","DOIUrl":null,"url":null,"abstract":"With the development of natural neural networks, supervised methods are usually confronted with the problem of lacking labeled data. Few-shot learning methods are now a mainstream research method that allows models to classify relation base on a small amount of data. Relation classification is a basic task in natural language processing and it is the most critical step in the construction of a knowledge graph. This paper focus on few-shot relation classification and we propose a co-attention based few-shot relation classification model with dynamic routing. This model is divided into three parts: encoder layer, aggregation layer and matching layer. The encoder layer is used to extract the important features from support set and query set and convert it into vectors. Aggregation layer is to aggregate the vectors of instances in the same class. The matching layer is to compute the score between the query instances which is extracted form encoder layer and the class vector which is output by aggregation layer. We apply this model on FewRel dataset and the experiment result shows that our method is better than other methods.","PeriodicalId":355473,"journal":{"name":"2020 IEEE 3rd International Conference on Information Systems and Computer Aided Education (ICISCAE)","volume":"50 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Co-Attention Based Few-Shot Relation Classification Model with Dynamic Routing\",\"authors\":\"Chun-Yuan Huang, Yuliang Wei, Bailing Wang, Guodong Xin, Wei Wang, Qinggang He\",\"doi\":\"10.1109/ICISCAE51034.2020.9236846\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the development of natural neural networks, supervised methods are usually confronted with the problem of lacking labeled data. Few-shot learning methods are now a mainstream research method that allows models to classify relation base on a small amount of data. Relation classification is a basic task in natural language processing and it is the most critical step in the construction of a knowledge graph. This paper focus on few-shot relation classification and we propose a co-attention based few-shot relation classification model with dynamic routing. This model is divided into three parts: encoder layer, aggregation layer and matching layer. The encoder layer is used to extract the important features from support set and query set and convert it into vectors. Aggregation layer is to aggregate the vectors of instances in the same class. The matching layer is to compute the score between the query instances which is extracted form encoder layer and the class vector which is output by aggregation layer. We apply this model on FewRel dataset and the experiment result shows that our method is better than other methods.\",\"PeriodicalId\":355473,\"journal\":{\"name\":\"2020 IEEE 3rd International Conference on Information Systems and Computer Aided Education (ICISCAE)\",\"volume\":\"50 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-09-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 IEEE 3rd International Conference on Information Systems and Computer Aided Education (ICISCAE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICISCAE51034.2020.9236846\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE 3rd International Conference on Information Systems and Computer Aided Education (ICISCAE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICISCAE51034.2020.9236846","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

随着自然神经网络的发展,监督方法经常面临缺乏标记数据的问题。Few-shot学习方法是目前主流的研究方法,它允许模型基于少量数据对关系进行分类。关系分类是自然语言处理中的一项基本任务,是构建知识图的关键步骤。本文以少镜头关系分类为研究对象,提出了一种基于协同关注的动态路由少镜头关系分类模型。该模型分为三部分:编码器层、聚合层和匹配层。编码器层用于从支持集和查询集中提取重要特征并将其转换为向量。聚合层是对同一类中的实例向量进行聚合。匹配层是计算从编码器层提取的查询实例与聚合层输出的类向量之间的分数。将该模型应用于FewRel数据集,实验结果表明该方法优于其他方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Co-Attention Based Few-Shot Relation Classification Model with Dynamic Routing
With the development of natural neural networks, supervised methods are usually confronted with the problem of lacking labeled data. Few-shot learning methods are now a mainstream research method that allows models to classify relation base on a small amount of data. Relation classification is a basic task in natural language processing and it is the most critical step in the construction of a knowledge graph. This paper focus on few-shot relation classification and we propose a co-attention based few-shot relation classification model with dynamic routing. This model is divided into three parts: encoder layer, aggregation layer and matching layer. The encoder layer is used to extract the important features from support set and query set and convert it into vectors. Aggregation layer is to aggregate the vectors of instances in the same class. The matching layer is to compute the score between the query instances which is extracted form encoder layer and the class vector which is output by aggregation layer. We apply this model on FewRel dataset and the experiment result shows that our method is better than other methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信