{"title":"基于深度学习的机器人行人实时跟踪算法","authors":"Ziheng Qu","doi":"10.62051/vw8a4124","DOIUrl":null,"url":null,"abstract":"In recent years, deep learning models have greatly improved the performance of pedestrian detection and tracking. Although the accuracy of neural network-based modeling methods is high, they often require large computational and storage resource overheads, which makes them difficult to apply to robots with high resource requirements. Pedestrian tracking for robots still faces great challenges in the problems of occlusion, multi-target, and target loss. In this thesis, we focus on solving the problem of real-time pedestrian tracking by lightweight fusion of deep learning target detection models for robots, firstly, through the lightweight YOLO network, we perform pedestrian detection and feature extraction, and then we propose a Gaussian mixture model based feature matching method to construct the target pedestrian tracker, and finally, we use the PID-based control algorithm for real-time control of the robot's motion, and finally realize the real-time pedestrian Tracking. In this thesis, we validate the feature matching method based on the Gaussian mixture model on the ETH dataset, and at the same time, combined with the motion control algorithm, we carry out the actual validation, and the experimental results show that our proposed method can realize the real-time pedestrian tracking.","PeriodicalId":509968,"journal":{"name":"Transactions on Computer Science and Intelligent Systems Research","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Robot Real-time Pedestrian Tracking Algorithm based on Deep Learning\",\"authors\":\"Ziheng Qu\",\"doi\":\"10.62051/vw8a4124\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In recent years, deep learning models have greatly improved the performance of pedestrian detection and tracking. Although the accuracy of neural network-based modeling methods is high, they often require large computational and storage resource overheads, which makes them difficult to apply to robots with high resource requirements. Pedestrian tracking for robots still faces great challenges in the problems of occlusion, multi-target, and target loss. In this thesis, we focus on solving the problem of real-time pedestrian tracking by lightweight fusion of deep learning target detection models for robots, firstly, through the lightweight YOLO network, we perform pedestrian detection and feature extraction, and then we propose a Gaussian mixture model based feature matching method to construct the target pedestrian tracker, and finally, we use the PID-based control algorithm for real-time control of the robot's motion, and finally realize the real-time pedestrian Tracking. In this thesis, we validate the feature matching method based on the Gaussian mixture model on the ETH dataset, and at the same time, combined with the motion control algorithm, we carry out the actual validation, and the experimental results show that our proposed method can realize the real-time pedestrian tracking.\",\"PeriodicalId\":509968,\"journal\":{\"name\":\"Transactions on Computer Science and Intelligent Systems Research\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-12-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Transactions on Computer Science and Intelligent Systems Research\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.62051/vw8a4124\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transactions on Computer Science and Intelligent Systems Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.62051/vw8a4124","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
近年来,深度学习模型大大提高了行人检测和跟踪的性能。基于神经网络的建模方法虽然精度高,但往往需要大量的计算和存储资源开销,因此很难应用于对资源要求较高的机器人。机器人的行人跟踪仍然面临着遮挡、多目标和目标丢失等问题的巨大挑战。在本论文中,我们重点通过轻量级融合机器人深度学习目标检测模型来解决行人实时跟踪问题,首先通过轻量级YOLO网络进行行人检测和特征提取,然后提出基于高斯混合模型的特征匹配方法构建目标行人跟踪器,最后利用基于PID的控制算法对机器人的运动进行实时控制,最终实现行人实时跟踪。在本论文中,我们在 ETH 数据集上验证了基于高斯混合模型的特征匹配方法,同时结合运动控制算法进行了实际验证,实验结果表明我们提出的方法可以实现行人的实时跟踪。
Robot Real-time Pedestrian Tracking Algorithm based on Deep Learning
In recent years, deep learning models have greatly improved the performance of pedestrian detection and tracking. Although the accuracy of neural network-based modeling methods is high, they often require large computational and storage resource overheads, which makes them difficult to apply to robots with high resource requirements. Pedestrian tracking for robots still faces great challenges in the problems of occlusion, multi-target, and target loss. In this thesis, we focus on solving the problem of real-time pedestrian tracking by lightweight fusion of deep learning target detection models for robots, firstly, through the lightweight YOLO network, we perform pedestrian detection and feature extraction, and then we propose a Gaussian mixture model based feature matching method to construct the target pedestrian tracker, and finally, we use the PID-based control algorithm for real-time control of the robot's motion, and finally realize the real-time pedestrian Tracking. In this thesis, we validate the feature matching method based on the Gaussian mixture model on the ETH dataset, and at the same time, combined with the motion control algorithm, we carry out the actual validation, and the experimental results show that our proposed method can realize the real-time pedestrian tracking.