拆除机器人视觉自主定位的目标跟踪方法

Yimo Zong, Jianzhong Huang, Jiahan Bao, Deshang Sun, Y. Cen
{"title":"拆除机器人视觉自主定位的目标跟踪方法","authors":"Yimo Zong, Jianzhong Huang, Jiahan Bao, Deshang Sun, Y. Cen","doi":"10.1109/WCMEIM56910.2022.10021468","DOIUrl":null,"url":null,"abstract":"To solve the problem of autonomous and precise positioning of the robot arm in the non-structural environment of the demolition robot, binocular vision is used for the measurement of the target point for robot arm positioning, and the real-time tracking and measurement of the end of the robot arm during the positioning process. For demolition robots operating in non-structural environments, their tracking process will have the problems of randomly appearing tracking targets being obscured and a complex background environment. The paper solves this problem by extending the Camshift algorithm to 3D space, using depth information to separate occluders and targets in space. Through experiments, it is proved that this method can effectively solve the problem that the tracking of the end of the robotic arm is lost due to random occlusions during the positioning and tracking of the end of the robotic arm, so as to provide the feedback information of the spatial position of the end of the robotic arm for the autonomous positioning of the robotic arm in a real-time and stable manner.","PeriodicalId":202270,"journal":{"name":"2022 5th World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2022-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Target Tracking Method for Visual Autonomous Localization of Demolition Robot\",\"authors\":\"Yimo Zong, Jianzhong Huang, Jiahan Bao, Deshang Sun, Y. Cen\",\"doi\":\"10.1109/WCMEIM56910.2022.10021468\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"To solve the problem of autonomous and precise positioning of the robot arm in the non-structural environment of the demolition robot, binocular vision is used for the measurement of the target point for robot arm positioning, and the real-time tracking and measurement of the end of the robot arm during the positioning process. For demolition robots operating in non-structural environments, their tracking process will have the problems of randomly appearing tracking targets being obscured and a complex background environment. The paper solves this problem by extending the Camshift algorithm to 3D space, using depth information to separate occluders and targets in space. Through experiments, it is proved that this method can effectively solve the problem that the tracking of the end of the robotic arm is lost due to random occlusions during the positioning and tracking of the end of the robotic arm, so as to provide the feedback information of the spatial position of the end of the robotic arm for the autonomous positioning of the robotic arm in a real-time and stable manner.\",\"PeriodicalId\":202270,\"journal\":{\"name\":\"2022 5th World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 5th World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/WCMEIM56910.2022.10021468\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 5th World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/WCMEIM56910.2022.10021468","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

为解决拆除机器人在非结构环境中机械臂的自主精确定位问题,采用双目视觉对机械臂定位的目标点进行测量,并在定位过程中对机械臂末端进行实时跟踪和测量。对于在非结构环境中作业的拆除机器人,其跟踪过程中会存在随机出现的跟踪目标被遮挡、背景环境复杂等问题。本文将Camshift算法扩展到三维空间,利用深度信息分离空间中的遮挡物和目标,从而解决了这一问题。通过实验证明,该方法能有效解决机械臂末端定位跟踪过程中因随机遮挡导致机械臂末端跟踪丢失的问题,为机械臂的自主定位实时、稳定地提供机械臂末端空间位置的反馈信息。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Target Tracking Method for Visual Autonomous Localization of Demolition Robot
To solve the problem of autonomous and precise positioning of the robot arm in the non-structural environment of the demolition robot, binocular vision is used for the measurement of the target point for robot arm positioning, and the real-time tracking and measurement of the end of the robot arm during the positioning process. For demolition robots operating in non-structural environments, their tracking process will have the problems of randomly appearing tracking targets being obscured and a complex background environment. The paper solves this problem by extending the Camshift algorithm to 3D space, using depth information to separate occluders and targets in space. Through experiments, it is proved that this method can effectively solve the problem that the tracking of the end of the robotic arm is lost due to random occlusions during the positioning and tracking of the end of the robotic arm, so as to provide the feedback information of the spatial position of the end of the robotic arm for the autonomous positioning of the robotic arm in a real-time and stable manner.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信