基于gan的单目视觉里程测量图像增强

Jon Zubieta Ansorregi, Mikel Etxeberria Garcia, Maider Zamalloa Akizu, Nestor Arexolaleiba
{"title":"基于gan的单目视觉里程测量图像增强","authors":"Jon Zubieta Ansorregi, Mikel Etxeberria Garcia, Maider Zamalloa Akizu, Nestor Arexolaleiba","doi":"10.1109/ECMSM51310.2021.9468831","DOIUrl":null,"url":null,"abstract":"Drones, mobile robots, and autonomous vehicles use Visual Odometry (VO) to move around complex environments. ORB-SLAM or deep learning-based approaches like DF-VO are two of the state-of-the-art technics for monocular VO. Those two technics perform correctly in outdoor scenarios but show some limitations in indoor environments. The extreme lighting conditions, non-Lambertian surfaces, or occlusion of indoor environments can disturb the visual information, and so the odometry information. Generative Adversarial Network (GAN) architectures recently proposed in the literature can help to overcome image low-light and blurring limitations. This research study aims to assess image enhancement's impact using GANS on the Visual Odometry algorithm DF-VO. Since DF-VO is also based on visual geometric information, the paper first considers the effect of two different GAN architectures in the camera's calibration. Then, the impact in the odometry information computed by DF-VO is evaluated. The preliminary results show that the reprojection error and the uncertainty of the calibration of a pin-hole-based camera do not increase significantly, and DF-VO's performance is improved.","PeriodicalId":253476,"journal":{"name":"2021 IEEE International Workshop of Electronics, Control, Measurement, Signals and their application to Mechatronics (ECMSM)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Image Enhancement using GANs for Monocular Visual Odometry\",\"authors\":\"Jon Zubieta Ansorregi, Mikel Etxeberria Garcia, Maider Zamalloa Akizu, Nestor Arexolaleiba\",\"doi\":\"10.1109/ECMSM51310.2021.9468831\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Drones, mobile robots, and autonomous vehicles use Visual Odometry (VO) to move around complex environments. ORB-SLAM or deep learning-based approaches like DF-VO are two of the state-of-the-art technics for monocular VO. Those two technics perform correctly in outdoor scenarios but show some limitations in indoor environments. The extreme lighting conditions, non-Lambertian surfaces, or occlusion of indoor environments can disturb the visual information, and so the odometry information. Generative Adversarial Network (GAN) architectures recently proposed in the literature can help to overcome image low-light and blurring limitations. This research study aims to assess image enhancement's impact using GANS on the Visual Odometry algorithm DF-VO. Since DF-VO is also based on visual geometric information, the paper first considers the effect of two different GAN architectures in the camera's calibration. Then, the impact in the odometry information computed by DF-VO is evaluated. The preliminary results show that the reprojection error and the uncertainty of the calibration of a pin-hole-based camera do not increase significantly, and DF-VO's performance is improved.\",\"PeriodicalId\":253476,\"journal\":{\"name\":\"2021 IEEE International Workshop of Electronics, Control, Measurement, Signals and their application to Mechatronics (ECMSM)\",\"volume\":\"42 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-06-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE International Workshop of Electronics, Control, Measurement, Signals and their application to Mechatronics (ECMSM)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ECMSM51310.2021.9468831\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Workshop of Electronics, Control, Measurement, Signals and their application to Mechatronics (ECMSM)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ECMSM51310.2021.9468831","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

无人机、移动机器人和自动驾驶汽车使用视觉里程计(VO)在复杂的环境中移动。ORB-SLAM或基于深度学习的方法(如DF-VO)是单目VO的两种最先进的技术。这两种技术在室外场景中表现良好,但在室内环境中表现出一定的局限性。极端的光照条件、非朗伯曲面或室内环境的遮挡都会干扰视觉信息,从而干扰里程计信息。最近在文献中提出的生成对抗网络(GAN)架构可以帮助克服图像弱光和模糊的限制。本研究旨在评估GANS对视觉里程计算法DF-VO的图像增强影响。由于DF-VO也是基于视觉几何信息,因此本文首先考虑了两种不同GAN架构对相机标定的影响。然后,对DF-VO计算的里程信息中的影响进行了评估。初步结果表明,该方法对针孔相机的重投影误差和标定不确定度没有显著增加,提高了DF-VO的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Image Enhancement using GANs for Monocular Visual Odometry
Drones, mobile robots, and autonomous vehicles use Visual Odometry (VO) to move around complex environments. ORB-SLAM or deep learning-based approaches like DF-VO are two of the state-of-the-art technics for monocular VO. Those two technics perform correctly in outdoor scenarios but show some limitations in indoor environments. The extreme lighting conditions, non-Lambertian surfaces, or occlusion of indoor environments can disturb the visual information, and so the odometry information. Generative Adversarial Network (GAN) architectures recently proposed in the literature can help to overcome image low-light and blurring limitations. This research study aims to assess image enhancement's impact using GANS on the Visual Odometry algorithm DF-VO. Since DF-VO is also based on visual geometric information, the paper first considers the effect of two different GAN architectures in the camera's calibration. Then, the impact in the odometry information computed by DF-VO is evaluated. The preliminary results show that the reprojection error and the uncertainty of the calibration of a pin-hole-based camera do not increase significantly, and DF-VO's performance is improved.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信