Data efficient Deep Reinforcement Learning for robust inertial-based UAV localization

IF 5.2 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Dimitrios Tsiakmakis , Nikolaos Passalis , Anastasios Tefas
{"title":"Data efficient Deep Reinforcement Learning for robust inertial-based UAV localization","authors":"Dimitrios Tsiakmakis ,&nbsp;Nikolaos Passalis ,&nbsp;Anastasios Tefas","doi":"10.1016/j.robot.2025.105139","DOIUrl":null,"url":null,"abstract":"<div><div>Precise localization is a critical task for many UAV-based applications. Inertial Measurement Units (IMUs), which measure acceleration and angular velocity, are commonly used for UAV localization due to their low cost and small size. However, IMU-based localization is prone to accumulating errors over time, which can significantly impact the accuracy of the localization. To address this issue, we propose a data efficient Deep Reinforcement Learning (DRL) method that enables learning how to correct localization errors from IMUs. Our approach utilizes a novel data augmentation method, along with an appropriate “hint” loss that can provide additional supervision during the training process. As a result, the proposed method requires a very small number of real-world examples and can be implemented using widely available low cost RGB sensors, ensuring that it can be readily applied in a wide range of different applications. We demonstrate the effectiveness of the proposed method in both simulation and real-world UAV experiments. In comparison to traditional supervised and DRL approaches, the proposed approach allows for achieving more precise localization with fewer real-world examples, making it a practical tool for adapting DL-based localization models for UAV applications.</div></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"194 ","pages":"Article 105139"},"PeriodicalIF":5.2000,"publicationDate":"2025-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Robotics and Autonomous Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0921889025002362","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Precise localization is a critical task for many UAV-based applications. Inertial Measurement Units (IMUs), which measure acceleration and angular velocity, are commonly used for UAV localization due to their low cost and small size. However, IMU-based localization is prone to accumulating errors over time, which can significantly impact the accuracy of the localization. To address this issue, we propose a data efficient Deep Reinforcement Learning (DRL) method that enables learning how to correct localization errors from IMUs. Our approach utilizes a novel data augmentation method, along with an appropriate “hint” loss that can provide additional supervision during the training process. As a result, the proposed method requires a very small number of real-world examples and can be implemented using widely available low cost RGB sensors, ensuring that it can be readily applied in a wide range of different applications. We demonstrate the effectiveness of the proposed method in both simulation and real-world UAV experiments. In comparison to traditional supervised and DRL approaches, the proposed approach allows for achieving more precise localization with fewer real-world examples, making it a practical tool for adapting DL-based localization models for UAV applications.
基于数据高效深度强化学习的鲁棒惯性无人机定位
精确定位是许多基于无人机的应用的关键任务。惯性测量单元(imu)用于测量加速度和角速度,由于其低成本和小尺寸,通常用于无人机定位。然而,基于imu的定位容易随着时间的推移而累积误差,这可能会严重影响定位的准确性。为了解决这个问题,我们提出了一种数据高效的深度强化学习(DRL)方法,该方法可以学习如何从imu中纠正定位错误。我们的方法利用了一种新颖的数据增强方法,以及适当的“提示”损失,可以在训练过程中提供额外的监督。因此,所提出的方法需要非常少的真实世界的例子,并且可以使用广泛可用的低成本RGB传感器来实现,确保它可以很容易地应用于各种不同的应用。我们在仿真和实际无人机实验中验证了该方法的有效性。与传统的监督和DRL方法相比,所提出的方法允许用更少的现实世界示例实现更精确的定位,使其成为适应无人机应用的基于dl的定位模型的实用工具。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Robotics and Autonomous Systems
Robotics and Autonomous Systems 工程技术-机器人学
CiteScore
9.00
自引率
7.00%
发文量
164
审稿时长
4.5 months
期刊介绍: Robotics and Autonomous Systems will carry articles describing fundamental developments in the field of robotics, with special emphasis on autonomous systems. An important goal of this journal is to extend the state of the art in both symbolic and sensory based robot control and learning in the context of autonomous systems. Robotics and Autonomous Systems will carry articles on the theoretical, computational and experimental aspects of autonomous systems, or modules of such systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信