Teleoperation Master-slave Robot Based on Binocular Vision

Xiaoming Mai, Xu Yuwen, Yang Wang, Long Chen
{"title":"Teleoperation Master-slave Robot Based on Binocular Vision","authors":"Xiaoming Mai, Xu Yuwen, Yang Wang, Long Chen","doi":"10.1109/HFR.2018.8633522","DOIUrl":null,"url":null,"abstract":"Teleoperation master-slave robots could be used for a variaty of dangerous work, such as live work in power systems. It is important for the operator to get the information on site since the operator usually stay away from the scene. Vision as the most important way for humans to access outside information, is also the first choice for remote operators to perceive the surroundings of the salve robot. In order to let the operator sense the live scene better, we developed a visual system with fisheye binocular vision and ordinary binocular vision, which enables the operator to sense the wide-scale environment around the robot through the fisheye camera and to sense the details of the objects through the ordinary binocular camera. In order to solve the problem of large distortion of the fisheye camera, we focus on the correction and interpolation of the fisheye image, and propose a cosine similar interpolation algorithm, which can better recover the missing pixels of the fisheye image and realize the depth estimation. In addition, combined with our vision device and master-slave robot arm, we designed a teleoperation device with better human-computer interaction performance.","PeriodicalId":263946,"journal":{"name":"2018 11th International Workshop on Human Friendly Robotics (HFR)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 11th International Workshop on Human Friendly Robotics (HFR)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/HFR.2018.8633522","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Teleoperation master-slave robots could be used for a variaty of dangerous work, such as live work in power systems. It is important for the operator to get the information on site since the operator usually stay away from the scene. Vision as the most important way for humans to access outside information, is also the first choice for remote operators to perceive the surroundings of the salve robot. In order to let the operator sense the live scene better, we developed a visual system with fisheye binocular vision and ordinary binocular vision, which enables the operator to sense the wide-scale environment around the robot through the fisheye camera and to sense the details of the objects through the ordinary binocular camera. In order to solve the problem of large distortion of the fisheye camera, we focus on the correction and interpolation of the fisheye image, and propose a cosine similar interpolation algorithm, which can better recover the missing pixels of the fisheye image and realize the depth estimation. In addition, combined with our vision device and master-slave robot arm, we designed a teleoperation device with better human-computer interaction performance.
基于双目视觉的远程操作主从机器人
远程操作主从机器人可以用于各种危险的工作,如电力系统的带电工作。由于作业人员通常远离现场,因此获得现场信息对作业人员来说非常重要。视觉作为人类获取外界信息最重要的途径,也是远程操作者感知药膏机器人周围环境的首选。为了让操作者更好地感知现场,我们开发了鱼眼双目视觉和普通双目视觉相结合的视觉系统,使操作者通过鱼眼摄像头感知机器人周围的大范围环境,通过普通双目摄像头感知物体的细节。为了解决鱼眼相机畸变大的问题,我们重点研究了鱼眼图像的校正和插值,提出了余弦相似插值算法,该算法可以更好地恢复鱼眼图像缺失的像素,实现深度估计。此外,结合我们的视觉装置和主从机械臂,我们设计了一个具有更好人机交互性能的遥操作装置。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信