Sheilla Wesonga, Nusrat Jahan Tahira, Jangsik Park
{"title":"无人零售中人类活动识别的性能比较","authors":"Sheilla Wesonga, Nusrat Jahan Tahira, Jangsik Park","doi":"10.23919/ICCAS55662.2022.10003872","DOIUrl":null,"url":null,"abstract":"Lately, the broad usage of technology in almost all aspects of life has led to the increase in research supporting technology advancement. One of these research topics is Human Activity Recognition (HAR) with diverse applicability which include and not limited to video surveillance, healthcare and education. In this paper, we present a study based on human activity recognition while employing the Kinect RGB and Depth sensor camera to recognize seven different human activities (7 classes). The joint angles extracted from the Kinect depth sensor each has 3 axes (X, Y, Z) for the 8 limbs employed in our experiment as the feature vectors. For the purpose of classifying the human activities, we train and test with 3 different state of the art recurrent neural network models (GRU, LSTM, Bi-LSTM). The comparison of the 3 recurrent neural network models shows that LSTM has a higher human activity classification accuracy at 96% and using the confusion matrix as the performance metric for all the models, we show classification per activity.","PeriodicalId":129856,"journal":{"name":"2022 22nd International Conference on Control, Automation and Systems (ICCAS)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Performance Comparison of Human Activity Recognition for Unmanned Retails\",\"authors\":\"Sheilla Wesonga, Nusrat Jahan Tahira, Jangsik Park\",\"doi\":\"10.23919/ICCAS55662.2022.10003872\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Lately, the broad usage of technology in almost all aspects of life has led to the increase in research supporting technology advancement. One of these research topics is Human Activity Recognition (HAR) with diverse applicability which include and not limited to video surveillance, healthcare and education. In this paper, we present a study based on human activity recognition while employing the Kinect RGB and Depth sensor camera to recognize seven different human activities (7 classes). The joint angles extracted from the Kinect depth sensor each has 3 axes (X, Y, Z) for the 8 limbs employed in our experiment as the feature vectors. For the purpose of classifying the human activities, we train and test with 3 different state of the art recurrent neural network models (GRU, LSTM, Bi-LSTM). The comparison of the 3 recurrent neural network models shows that LSTM has a higher human activity classification accuracy at 96% and using the confusion matrix as the performance metric for all the models, we show classification per activity.\",\"PeriodicalId\":129856,\"journal\":{\"name\":\"2022 22nd International Conference on Control, Automation and Systems (ICCAS)\",\"volume\":\"4 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 22nd International Conference on Control, Automation and Systems (ICCAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.23919/ICCAS55662.2022.10003872\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 22nd International Conference on Control, Automation and Systems (ICCAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23919/ICCAS55662.2022.10003872","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
最近,技术在生活的几乎所有方面的广泛应用导致了支持技术进步的研究的增加。其中一个研究课题是人类活动识别(HAR),它具有广泛的适用性,包括但不限于视频监控、医疗保健和教育。在本文中,我们提出了一项基于人体活动识别的研究,使用Kinect RGB和深度传感器相机来识别七种不同的人体活动(7类)。从Kinect深度传感器中提取的关节角度分别有3个轴(X, Y, Z)作为我们实验中使用的8个肢体的特征向量。为了对人类活动进行分类,我们使用了3种不同的最先进的递归神经网络模型(GRU, LSTM, Bi-LSTM)进行训练和测试。3种递归神经网络模型的比较表明,LSTM具有较高的人类活动分类准确率,达到96%,并且使用混淆矩阵作为所有模型的性能指标,我们显示了每个活动的分类。
Performance Comparison of Human Activity Recognition for Unmanned Retails
Lately, the broad usage of technology in almost all aspects of life has led to the increase in research supporting technology advancement. One of these research topics is Human Activity Recognition (HAR) with diverse applicability which include and not limited to video surveillance, healthcare and education. In this paper, we present a study based on human activity recognition while employing the Kinect RGB and Depth sensor camera to recognize seven different human activities (7 classes). The joint angles extracted from the Kinect depth sensor each has 3 axes (X, Y, Z) for the 8 limbs employed in our experiment as the feature vectors. For the purpose of classifying the human activities, we train and test with 3 different state of the art recurrent neural network models (GRU, LSTM, Bi-LSTM). The comparison of the 3 recurrent neural network models shows that LSTM has a higher human activity classification accuracy at 96% and using the confusion matrix as the performance metric for all the models, we show classification per activity.