基于强化学习的地面机器人导航

Sharanya S, Divya Radhakrishna Varma, Ajay Paul
{"title":"基于强化学习的地面机器人导航","authors":"Sharanya S, Divya Radhakrishna Varma, Ajay Paul","doi":"10.1109/ACIRS58671.2023.10240285","DOIUrl":null,"url":null,"abstract":"Reinforcement learning (RL) is a machine learning technique that enables an agent to learn optimal behaviors within an environment through a process of trial and error. This is achieved by the agent receiving rewards or punishments based on its actions. In this study, we compare the performance of two RL algorithms, SARSA and Q-Learning, in a simulated environment using the Gazebo Simulator. The goal of the simulation is to navigate a ground robot towards pre-defined goals. By manipulating various training parameters, we investigate the impact on learning speed and robot behavior. To ensure meaningful comparisons, we vary the navigation goal and the complexity of the simulation environment. Through extensive simulations, our results highlight the effectiveness of RL-based navigation for ground robots and offer insights into the influential parameters that significantly affect optimal navigation performance. It underscores the importance of algorithm selection and parameter optimization in achieving optimal navigation performance.","PeriodicalId":148401,"journal":{"name":"2023 8th Asia-Pacific Conference on Intelligent Robot Systems (ACIRS)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Navigation of Ground Robots with Reinforcement Learning\",\"authors\":\"Sharanya S, Divya Radhakrishna Varma, Ajay Paul\",\"doi\":\"10.1109/ACIRS58671.2023.10240285\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Reinforcement learning (RL) is a machine learning technique that enables an agent to learn optimal behaviors within an environment through a process of trial and error. This is achieved by the agent receiving rewards or punishments based on its actions. In this study, we compare the performance of two RL algorithms, SARSA and Q-Learning, in a simulated environment using the Gazebo Simulator. The goal of the simulation is to navigate a ground robot towards pre-defined goals. By manipulating various training parameters, we investigate the impact on learning speed and robot behavior. To ensure meaningful comparisons, we vary the navigation goal and the complexity of the simulation environment. Through extensive simulations, our results highlight the effectiveness of RL-based navigation for ground robots and offer insights into the influential parameters that significantly affect optimal navigation performance. It underscores the importance of algorithm selection and parameter optimization in achieving optimal navigation performance.\",\"PeriodicalId\":148401,\"journal\":{\"name\":\"2023 8th Asia-Pacific Conference on Intelligent Robot Systems (ACIRS)\",\"volume\":\"17 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-07-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 8th Asia-Pacific Conference on Intelligent Robot Systems (ACIRS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ACIRS58671.2023.10240285\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 8th Asia-Pacific Conference on Intelligent Robot Systems (ACIRS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ACIRS58671.2023.10240285","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

强化学习(RL)是一种机器学习技术,它使智能体能够通过试错过程在环境中学习最佳行为。这是通过代理根据其行为获得奖励或惩罚来实现的。在本研究中,我们使用Gazebo模拟器在模拟环境中比较了SARSA和Q-Learning两种强化学习算法的性能。模拟的目标是引导地面机器人走向预定的目标。通过操纵不同的训练参数,我们研究了对学习速度和机器人行为的影响。为了确保有意义的比较,我们改变了导航目标和仿真环境的复杂性。通过广泛的模拟,我们的研究结果突出了基于rl的地面机器人导航的有效性,并提供了对显著影响最佳导航性能的影响参数的见解。强调了算法选择和参数优化对实现最优导航性能的重要性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Navigation of Ground Robots with Reinforcement Learning
Reinforcement learning (RL) is a machine learning technique that enables an agent to learn optimal behaviors within an environment through a process of trial and error. This is achieved by the agent receiving rewards or punishments based on its actions. In this study, we compare the performance of two RL algorithms, SARSA and Q-Learning, in a simulated environment using the Gazebo Simulator. The goal of the simulation is to navigate a ground robot towards pre-defined goals. By manipulating various training parameters, we investigate the impact on learning speed and robot behavior. To ensure meaningful comparisons, we vary the navigation goal and the complexity of the simulation environment. Through extensive simulations, our results highlight the effectiveness of RL-based navigation for ground robots and offer insights into the influential parameters that significantly affect optimal navigation performance. It underscores the importance of algorithm selection and parameter optimization in achieving optimal navigation performance.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信