X. Ji, Zhuangzhuang Jin, Jiangtao Cao, Yangyang Wang
{"title":"基于多源信息融合算法的两人交互动作识别","authors":"X. Ji, Zhuangzhuang Jin, Jiangtao Cao, Yangyang Wang","doi":"10.1109/ICIST.2018.8426081","DOIUrl":null,"url":null,"abstract":"The existing methods of two-person interaction action recognition based on RGB image is greatly affected by illumination change, object occlusion and environmental change. Considering the respective advantages of the RGB image and the depth image, and the characteristics of information complementarity, this paper proposed a multi - source information fusion algorithm. In our proposed method, the recognition probability of the RGB image and the depth image are weighted fused for the two-person interaction action recognition. Firstly, the frame difference method and ViBe algorithm are respectively used for moving object detection and segmentation. Secondly, histogram of oriented gradient (HOG) features are respectively extracted from the moving regions of the RGB image and the depth image. Thirdly, the nearest neighbor classifier algorithm is used to recognize the actions of the RGB image and the depth image. Finally, the recognition results of the RGB image and the depth image are weighted fused. Experimental results show that the method achieves the better recognition rate.","PeriodicalId":331555,"journal":{"name":"2018 Eighth International Conference on Information Science and Technology (ICIST)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2018-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Two-Person Interaction Action Recognition Based on Multi-Source Information Fusion Algorithm\",\"authors\":\"X. Ji, Zhuangzhuang Jin, Jiangtao Cao, Yangyang Wang\",\"doi\":\"10.1109/ICIST.2018.8426081\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The existing methods of two-person interaction action recognition based on RGB image is greatly affected by illumination change, object occlusion and environmental change. Considering the respective advantages of the RGB image and the depth image, and the characteristics of information complementarity, this paper proposed a multi - source information fusion algorithm. In our proposed method, the recognition probability of the RGB image and the depth image are weighted fused for the two-person interaction action recognition. Firstly, the frame difference method and ViBe algorithm are respectively used for moving object detection and segmentation. Secondly, histogram of oriented gradient (HOG) features are respectively extracted from the moving regions of the RGB image and the depth image. Thirdly, the nearest neighbor classifier algorithm is used to recognize the actions of the RGB image and the depth image. Finally, the recognition results of the RGB image and the depth image are weighted fused. Experimental results show that the method achieves the better recognition rate.\",\"PeriodicalId\":331555,\"journal\":{\"name\":\"2018 Eighth International Conference on Information Science and Technology (ICIST)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 Eighth International Conference on Information Science and Technology (ICIST)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICIST.2018.8426081\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 Eighth International Conference on Information Science and Technology (ICIST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICIST.2018.8426081","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Two-Person Interaction Action Recognition Based on Multi-Source Information Fusion Algorithm
The existing methods of two-person interaction action recognition based on RGB image is greatly affected by illumination change, object occlusion and environmental change. Considering the respective advantages of the RGB image and the depth image, and the characteristics of information complementarity, this paper proposed a multi - source information fusion algorithm. In our proposed method, the recognition probability of the RGB image and the depth image are weighted fused for the two-person interaction action recognition. Firstly, the frame difference method and ViBe algorithm are respectively used for moving object detection and segmentation. Secondly, histogram of oriented gradient (HOG) features are respectively extracted from the moving regions of the RGB image and the depth image. Thirdly, the nearest neighbor classifier algorithm is used to recognize the actions of the RGB image and the depth image. Finally, the recognition results of the RGB image and the depth image are weighted fused. Experimental results show that the method achieves the better recognition rate.