Deyuan Zhang, Hongwei Gao, Hailong Dai, Xiangbin Shi
{"title":"用于视频动作识别的人体骨架图注意卷积","authors":"Deyuan Zhang, Hongwei Gao, Hailong Dai, Xiangbin Shi","doi":"10.1109/ISCTT51595.2020.00040","DOIUrl":null,"url":null,"abstract":"Action recognition based on human skeleton information is a hot topic in the field of computer vision, how to represent the human skeleton graph structure is the key of the method. Graph convolutional network is widely used to extract spatial features of human skeleton. However, the graph convolutional network shares the same weight for neighborhood of each node. In this paper, we propose Human Skeleton Graph Attention Convolutional Neural Network, which introduces graph attention convolution mechanism to extract the spatial features of human skeleton. The model improves the spatial feature extraction of skeleton graph based on the feature relationship of node neighborhood. The experimental results on Kinetics and NTU-RGB+D datasets show that the model can obtain better representation of spatial features, and can achieve better accuracy.","PeriodicalId":178054,"journal":{"name":"2020 5th International Conference on Information Science, Computer Technology and Transportation (ISCTT)","volume":"18 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Human Skeleton Graph Attention Convolutional for Video Action Recognition\",\"authors\":\"Deyuan Zhang, Hongwei Gao, Hailong Dai, Xiangbin Shi\",\"doi\":\"10.1109/ISCTT51595.2020.00040\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Action recognition based on human skeleton information is a hot topic in the field of computer vision, how to represent the human skeleton graph structure is the key of the method. Graph convolutional network is widely used to extract spatial features of human skeleton. However, the graph convolutional network shares the same weight for neighborhood of each node. In this paper, we propose Human Skeleton Graph Attention Convolutional Neural Network, which introduces graph attention convolution mechanism to extract the spatial features of human skeleton. The model improves the spatial feature extraction of skeleton graph based on the feature relationship of node neighborhood. The experimental results on Kinetics and NTU-RGB+D datasets show that the model can obtain better representation of spatial features, and can achieve better accuracy.\",\"PeriodicalId\":178054,\"journal\":{\"name\":\"2020 5th International Conference on Information Science, Computer Technology and Transportation (ISCTT)\",\"volume\":\"18 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 5th International Conference on Information Science, Computer Technology and Transportation (ISCTT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISCTT51595.2020.00040\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 5th International Conference on Information Science, Computer Technology and Transportation (ISCTT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISCTT51595.2020.00040","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Human Skeleton Graph Attention Convolutional for Video Action Recognition
Action recognition based on human skeleton information is a hot topic in the field of computer vision, how to represent the human skeleton graph structure is the key of the method. Graph convolutional network is widely used to extract spatial features of human skeleton. However, the graph convolutional network shares the same weight for neighborhood of each node. In this paper, we propose Human Skeleton Graph Attention Convolutional Neural Network, which introduces graph attention convolution mechanism to extract the spatial features of human skeleton. The model improves the spatial feature extraction of skeleton graph based on the feature relationship of node neighborhood. The experimental results on Kinetics and NTU-RGB+D datasets show that the model can obtain better representation of spatial features, and can achieve better accuracy.