基于深度学习和知识图谱的室内人行为识别

Lihong Cheng, Xiantai Gou, Cen Tang, Yuan Li, Xiaofeng Jiang, Hongyu Zuo
{"title":"基于深度学习和知识图谱的室内人行为识别","authors":"Lihong Cheng, Xiantai Gou, Cen Tang, Yuan Li, Xiaofeng Jiang, Hongyu Zuo","doi":"10.1117/12.2673563","DOIUrl":null,"url":null,"abstract":"At present, indoor human behavior recognition technology is widely used in the fields of video intelligent monitoring, intelligence elderly care and intelligent medical care, etc. The existing research methods are more focused on classifying human behavior and ignore the connection between objects in the scene and human behavior. In order to make full use of the association between the objects in the scene and indoor human behavior, this paper proposes an indoor human behavior recognition model based on deep learning and knowledge graph. Firstly, we use YOLOv5 target detection network to identify the objects in the scene, and also use human keypoint detection algorithm to locate the skeletal keypoints of human body, extract and analyze the spatial features of objects and keypoints to obtain the human behavior feature triad, construct the behavior detection knowledge graph and perform search and inference to realize human behavior recognition. The experimental results show that the recognition accuracy of the model is 94.9% on the homemade test set.","PeriodicalId":176918,"journal":{"name":"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Indoor person behavior recognition based on deep learning and knowledge graph\",\"authors\":\"Lihong Cheng, Xiantai Gou, Cen Tang, Yuan Li, Xiaofeng Jiang, Hongyu Zuo\",\"doi\":\"10.1117/12.2673563\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"At present, indoor human behavior recognition technology is widely used in the fields of video intelligent monitoring, intelligence elderly care and intelligent medical care, etc. The existing research methods are more focused on classifying human behavior and ignore the connection between objects in the scene and human behavior. In order to make full use of the association between the objects in the scene and indoor human behavior, this paper proposes an indoor human behavior recognition model based on deep learning and knowledge graph. Firstly, we use YOLOv5 target detection network to identify the objects in the scene, and also use human keypoint detection algorithm to locate the skeletal keypoints of human body, extract and analyze the spatial features of objects and keypoints to obtain the human behavior feature triad, construct the behavior detection knowledge graph and perform search and inference to realize human behavior recognition. The experimental results show that the recognition accuracy of the model is 94.9% on the homemade test set.\",\"PeriodicalId\":176918,\"journal\":{\"name\":\"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)\",\"volume\":\"14 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2673563\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2nd International Conference on Digital Society and Intelligent Systems (DSInS 2022)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2673563","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

目前,室内人体行为识别技术广泛应用于视频智能监控、智能养老、智能医疗等领域。现有的研究方法更侧重于对人的行为进行分类,而忽略了场景中物体与人的行为之间的联系。为了充分利用场景中物体与室内人的行为之间的关联,本文提出了一种基于深度学习和知识图的室内人的行为识别模型。首先,我们使用YOLOv5目标检测网络对场景中的物体进行识别,并使用人体关键点检测算法对人体骨骼关键点进行定位,提取并分析物体和关键点的空间特征,得到人体行为特征三联体,构建行为检测知识图并进行搜索和推理,实现人体行为识别。实验结果表明,在自制的测试集上,该模型的识别准确率达到94.9%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Indoor person behavior recognition based on deep learning and knowledge graph
At present, indoor human behavior recognition technology is widely used in the fields of video intelligent monitoring, intelligence elderly care and intelligent medical care, etc. The existing research methods are more focused on classifying human behavior and ignore the connection between objects in the scene and human behavior. In order to make full use of the association between the objects in the scene and indoor human behavior, this paper proposes an indoor human behavior recognition model based on deep learning and knowledge graph. Firstly, we use YOLOv5 target detection network to identify the objects in the scene, and also use human keypoint detection algorithm to locate the skeletal keypoints of human body, extract and analyze the spatial features of objects and keypoints to obtain the human behavior feature triad, construct the behavior detection knowledge graph and perform search and inference to realize human behavior recognition. The experimental results show that the recognition accuracy of the model is 94.9% on the homemade test set.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信