Yimo Zong, Jianzhong Huang, Jiahan Bao, Deshang Sun, Y. Cen
{"title":"拆除机器人视觉自主定位的目标跟踪方法","authors":"Yimo Zong, Jianzhong Huang, Jiahan Bao, Deshang Sun, Y. Cen","doi":"10.1109/WCMEIM56910.2022.10021468","DOIUrl":null,"url":null,"abstract":"To solve the problem of autonomous and precise positioning of the robot arm in the non-structural environment of the demolition robot, binocular vision is used for the measurement of the target point for robot arm positioning, and the real-time tracking and measurement of the end of the robot arm during the positioning process. For demolition robots operating in non-structural environments, their tracking process will have the problems of randomly appearing tracking targets being obscured and a complex background environment. The paper solves this problem by extending the Camshift algorithm to 3D space, using depth information to separate occluders and targets in space. Through experiments, it is proved that this method can effectively solve the problem that the tracking of the end of the robotic arm is lost due to random occlusions during the positioning and tracking of the end of the robotic arm, so as to provide the feedback information of the spatial position of the end of the robotic arm for the autonomous positioning of the robotic arm in a real-time and stable manner.","PeriodicalId":202270,"journal":{"name":"2022 5th World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Target Tracking Method for Visual Autonomous Localization of Demolition Robot\",\"authors\":\"Yimo Zong, Jianzhong Huang, Jiahan Bao, Deshang Sun, Y. Cen\",\"doi\":\"10.1109/WCMEIM56910.2022.10021468\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"To solve the problem of autonomous and precise positioning of the robot arm in the non-structural environment of the demolition robot, binocular vision is used for the measurement of the target point for robot arm positioning, and the real-time tracking and measurement of the end of the robot arm during the positioning process. For demolition robots operating in non-structural environments, their tracking process will have the problems of randomly appearing tracking targets being obscured and a complex background environment. The paper solves this problem by extending the Camshift algorithm to 3D space, using depth information to separate occluders and targets in space. Through experiments, it is proved that this method can effectively solve the problem that the tracking of the end of the robotic arm is lost due to random occlusions during the positioning and tracking of the end of the robotic arm, so as to provide the feedback information of the spatial position of the end of the robotic arm for the autonomous positioning of the robotic arm in a real-time and stable manner.\",\"PeriodicalId\":202270,\"journal\":{\"name\":\"2022 5th World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM)\",\"volume\":\"24 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 5th World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/WCMEIM56910.2022.10021468\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 5th World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/WCMEIM56910.2022.10021468","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Target Tracking Method for Visual Autonomous Localization of Demolition Robot
To solve the problem of autonomous and precise positioning of the robot arm in the non-structural environment of the demolition robot, binocular vision is used for the measurement of the target point for robot arm positioning, and the real-time tracking and measurement of the end of the robot arm during the positioning process. For demolition robots operating in non-structural environments, their tracking process will have the problems of randomly appearing tracking targets being obscured and a complex background environment. The paper solves this problem by extending the Camshift algorithm to 3D space, using depth information to separate occluders and targets in space. Through experiments, it is proved that this method can effectively solve the problem that the tracking of the end of the robotic arm is lost due to random occlusions during the positioning and tracking of the end of the robotic arm, so as to provide the feedback information of the spatial position of the end of the robotic arm for the autonomous positioning of the robotic arm in a real-time and stable manner.