Ze Lv, Lecai Cai, Zhiming Wu, Kui Cheng, B. Chen, Keyuan Tang
{"title":"基于双目视觉与激光扫描融合的机器人目标定位","authors":"Ze Lv, Lecai Cai, Zhiming Wu, Kui Cheng, B. Chen, Keyuan Tang","doi":"10.1109/ICCEAI52939.2021.00084","DOIUrl":null,"url":null,"abstract":"The accuracy of target locating for vision-based robots would be affect by environment factors such as light. In order to solve the problem, we proposed a target locating method based on binocular vision locating technology, together with laser scanning positioning technology, considering that laser scanning can obtain three-dimensional environmental information with high definition, and is little influenced by light. In this method, the binocular vision pixel image and the laser scanning point cloud image are first jointly calibrated to map the image pixels with the point cloud data; secondly, the visual image and the laser two-dimensional depth map are detected separately using YOLOv3; then, a decision-level fusion method is utilized to fuse point cloud depth image and the camera image; finally, YOLOv3 is used to detect bound box and confidence of the fused map. The results show that the proposed method has the ability to locate object accurately.","PeriodicalId":331409,"journal":{"name":"2021 International Conference on Computer Engineering and Artificial Intelligence (ICCEAI)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2021-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Target Locating of Robots Based on the Fusion of Binocular Vision and Laser Scanning\",\"authors\":\"Ze Lv, Lecai Cai, Zhiming Wu, Kui Cheng, B. Chen, Keyuan Tang\",\"doi\":\"10.1109/ICCEAI52939.2021.00084\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The accuracy of target locating for vision-based robots would be affect by environment factors such as light. In order to solve the problem, we proposed a target locating method based on binocular vision locating technology, together with laser scanning positioning technology, considering that laser scanning can obtain three-dimensional environmental information with high definition, and is little influenced by light. In this method, the binocular vision pixel image and the laser scanning point cloud image are first jointly calibrated to map the image pixels with the point cloud data; secondly, the visual image and the laser two-dimensional depth map are detected separately using YOLOv3; then, a decision-level fusion method is utilized to fuse point cloud depth image and the camera image; finally, YOLOv3 is used to detect bound box and confidence of the fused map. The results show that the proposed method has the ability to locate object accurately.\",\"PeriodicalId\":331409,\"journal\":{\"name\":\"2021 International Conference on Computer Engineering and Artificial Intelligence (ICCEAI)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 International Conference on Computer Engineering and Artificial Intelligence (ICCEAI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCEAI52939.2021.00084\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 International Conference on Computer Engineering and Artificial Intelligence (ICCEAI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCEAI52939.2021.00084","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Target Locating of Robots Based on the Fusion of Binocular Vision and Laser Scanning
The accuracy of target locating for vision-based robots would be affect by environment factors such as light. In order to solve the problem, we proposed a target locating method based on binocular vision locating technology, together with laser scanning positioning technology, considering that laser scanning can obtain three-dimensional environmental information with high definition, and is little influenced by light. In this method, the binocular vision pixel image and the laser scanning point cloud image are first jointly calibrated to map the image pixels with the point cloud data; secondly, the visual image and the laser two-dimensional depth map are detected separately using YOLOv3; then, a decision-level fusion method is utilized to fuse point cloud depth image and the camera image; finally, YOLOv3 is used to detect bound box and confidence of the fused map. The results show that the proposed method has the ability to locate object accurately.