移动传感器网络中的人体全身运动手势图像特征捕捉

Zhaolin Yang, Loknath Sai Ambati
{"title":"移动传感器网络中的人体全身运动手势图像特征捕捉","authors":"Zhaolin Yang, Loknath Sai Ambati","doi":"10.1007/s11036-024-02361-5","DOIUrl":null,"url":null,"abstract":"<p>To solve the problems of poor estimation of full-body shape and inaccurate capture results in human motion capture in mobile sensor networks, a method of capturing image features of human full-body motion posture in mobile sensor networks is studied. The method uses Markov random fields to cooperate with sensors to extract human full-body motion foreground images and combines guided filtering to enhance the extraction effect of foreground images. Based on the foreground images, a human tree-structured model is established to simulate the actions of human movements. The extracted foreground images are used as input to the convolutional neural network to extract edge features and spatio-temporal features of human motion posture. After fusion, a human motion posture feature matrix is constructed. Based on the least squares method, a strong regression mapping model is constructed. According to the structure of the human tree model, multi-dimensional iterative mapping is performed from top to bottom between the human motion posture feature matrix and the human tree model. The joint positions corresponding to the human motion posture feature matrix in the human tree model are calculated, and the two-dimensional position information of all joint points of the moving human body is obtained. The capture of human full-body motion posture in mobile networks is completed. Experimental data show that the method has clear foreground image extraction, can effectively obtain human motion features, and has accurate capture results of human full-body motion posture.</p>","PeriodicalId":501103,"journal":{"name":"Mobile Networks and Applications","volume":"25 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Human Body Full-body Motion Gesture Image Feature Capture in Mobile Sensor Networks\",\"authors\":\"Zhaolin Yang, Loknath Sai Ambati\",\"doi\":\"10.1007/s11036-024-02361-5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>To solve the problems of poor estimation of full-body shape and inaccurate capture results in human motion capture in mobile sensor networks, a method of capturing image features of human full-body motion posture in mobile sensor networks is studied. The method uses Markov random fields to cooperate with sensors to extract human full-body motion foreground images and combines guided filtering to enhance the extraction effect of foreground images. Based on the foreground images, a human tree-structured model is established to simulate the actions of human movements. The extracted foreground images are used as input to the convolutional neural network to extract edge features and spatio-temporal features of human motion posture. After fusion, a human motion posture feature matrix is constructed. Based on the least squares method, a strong regression mapping model is constructed. According to the structure of the human tree model, multi-dimensional iterative mapping is performed from top to bottom between the human motion posture feature matrix and the human tree model. The joint positions corresponding to the human motion posture feature matrix in the human tree model are calculated, and the two-dimensional position information of all joint points of the moving human body is obtained. The capture of human full-body motion posture in mobile networks is completed. Experimental data show that the method has clear foreground image extraction, can effectively obtain human motion features, and has accurate capture results of human full-body motion posture.</p>\",\"PeriodicalId\":501103,\"journal\":{\"name\":\"Mobile Networks and Applications\",\"volume\":\"25 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Mobile Networks and Applications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/s11036-024-02361-5\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Mobile Networks and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s11036-024-02361-5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

为解决移动传感器网络中人体运动捕捉存在的全身形态估计不准确、捕捉结果不准确等问题,研究了一种移动传感器网络中人体全身运动姿态图像特征的捕捉方法。该方法利用马尔可夫随机场配合传感器提取人体全身运动前景图像,并结合引导滤波增强前景图像的提取效果。在前景图像的基础上,建立人体树状结构模型,模拟人体运动动作。提取的前景图像作为卷积神经网络的输入,用于提取人体运动姿势的边缘特征和时空特征。融合后,构建出人体运动姿态特征矩阵。基于最小二乘法,构建强回归映射模型。根据人体树形模型的结构,在人体运动姿势特征矩阵和人体树形模型之间自上而下进行多维迭代映射。计算人体树模型中与人体运动姿势特征矩阵相对应的关节位置,得到运动人体所有关节点的二维位置信息。完成了移动网络中人体全身运动姿态的捕捉。实验数据表明,该方法前景图像提取清晰,能有效获取人体运动特征,对人体全身运动姿态的捕捉结果准确。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Human Body Full-body Motion Gesture Image Feature Capture in Mobile Sensor Networks

Human Body Full-body Motion Gesture Image Feature Capture in Mobile Sensor Networks

To solve the problems of poor estimation of full-body shape and inaccurate capture results in human motion capture in mobile sensor networks, a method of capturing image features of human full-body motion posture in mobile sensor networks is studied. The method uses Markov random fields to cooperate with sensors to extract human full-body motion foreground images and combines guided filtering to enhance the extraction effect of foreground images. Based on the foreground images, a human tree-structured model is established to simulate the actions of human movements. The extracted foreground images are used as input to the convolutional neural network to extract edge features and spatio-temporal features of human motion posture. After fusion, a human motion posture feature matrix is constructed. Based on the least squares method, a strong regression mapping model is constructed. According to the structure of the human tree model, multi-dimensional iterative mapping is performed from top to bottom between the human motion posture feature matrix and the human tree model. The joint positions corresponding to the human motion posture feature matrix in the human tree model are calculated, and the two-dimensional position information of all joint points of the moving human body is obtained. The capture of human full-body motion posture in mobile networks is completed. Experimental data show that the method has clear foreground image extraction, can effectively obtain human motion features, and has accurate capture results of human full-body motion posture.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信