{"title":"基于深度学习和知识图谱的室内人行为识别","authors":"Lihong Cheng, Xiantai Gou, Cen Tang, Yuan Li, Xiaofeng Jiang, Hongyu Zuo","doi":"10.1117/12.2673563","DOIUrl":null,"url":null,"abstract":"At present, indoor human behavior recognition technology is widely used in the fields of video intelligent monitoring, intelligence elderly care and intelligent medical care, etc. The existing research methods are more focused on classifying human behavior and ignore the connection between objects in the scene and human behavior. In order to make full use of the association between the objects in the scene and indoor human behavior, this paper proposes an indoor human behavior recognition model based on deep learning and knowledge graph. Firstly, we use YOLOv5 target detection network to identify the objects in the scene, and also use human keypoint detection algorithm to locate the skeletal keypoints of human body, extract and analyze the spatial features of objects and keypoints to obtain the human behavior feature triad, construct the behavior detection knowledge graph and perform search and inference to realize human behavior recognition. The experimental results show that the recognition accuracy of the model is 94.9% on the homemade test set.","PeriodicalId":176918,"journal":{"name":"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Indoor person behavior recognition based on deep learning and knowledge graph\",\"authors\":\"Lihong Cheng, Xiantai Gou, Cen Tang, Yuan Li, Xiaofeng Jiang, Hongyu Zuo\",\"doi\":\"10.1117/12.2673563\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"At present, indoor human behavior recognition technology is widely used in the fields of video intelligent monitoring, intelligence elderly care and intelligent medical care, etc. The existing research methods are more focused on classifying human behavior and ignore the connection between objects in the scene and human behavior. In order to make full use of the association between the objects in the scene and indoor human behavior, this paper proposes an indoor human behavior recognition model based on deep learning and knowledge graph. Firstly, we use YOLOv5 target detection network to identify the objects in the scene, and also use human keypoint detection algorithm to locate the skeletal keypoints of human body, extract and analyze the spatial features of objects and keypoints to obtain the human behavior feature triad, construct the behavior detection knowledge graph and perform search and inference to realize human behavior recognition. The experimental results show that the recognition accuracy of the model is 94.9% on the homemade test set.\",\"PeriodicalId\":176918,\"journal\":{\"name\":\"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)\",\"volume\":\"14 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2673563\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2673563","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Indoor person behavior recognition based on deep learning and knowledge graph
At present, indoor human behavior recognition technology is widely used in the fields of video intelligent monitoring, intelligence elderly care and intelligent medical care, etc. The existing research methods are more focused on classifying human behavior and ignore the connection between objects in the scene and human behavior. In order to make full use of the association between the objects in the scene and indoor human behavior, this paper proposes an indoor human behavior recognition model based on deep learning and knowledge graph. Firstly, we use YOLOv5 target detection network to identify the objects in the scene, and also use human keypoint detection algorithm to locate the skeletal keypoints of human body, extract and analyze the spatial features of objects and keypoints to obtain the human behavior feature triad, construct the behavior detection knowledge graph and perform search and inference to realize human behavior recognition. The experimental results show that the recognition accuracy of the model is 94.9% on the homemade test set.