基于强化学习的机器人控制

Z. Guliyev, Ali Parsayan
{"title":"基于强化学习的机器人控制","authors":"Z. Guliyev, Ali Parsayan","doi":"10.1109/AICT55583.2022.10013595","DOIUrl":null,"url":null,"abstract":"Reinforcement learning (RL) has been proven to be a feasible method for learning complicated actions autonomously from sensory observations. Even though many of the deep RL studies have been centered on modelled control and computer games, which has nothing to do with the limits of learning in actual surroundings, deep RL has also revealed its potential in allowing robots to acquire complicated abilities in the real-world situations. Real-world robotics, on the other hand, is an intriguing area for testing the algorithms of this kind, because it is directly related to the learning procedure of humans. Deep RL might enable developing movement abilities without a precise modelling of the robot dynamics and with minimum engineering. However, because of hyper-parameter sensitivity and low sampling capability, it is difficult to implement deep RL to robotic tasks involving real-world applications. It is comparable simple to tune hyper-parameters in simulations, while it can be a challenging task when it comes to physical world, for example, biped robots. Acquiring the ability to move and perceive in the actual world involves a variety of difficulties, some are simpler to handle than others that are frequently overlooked in RL studies which are limited to simulated environments. This paper provides approaches to deal with a variety of frequent difficulties in deep RL arising while training a biped robot to walk and follow a specific path.","PeriodicalId":441475,"journal":{"name":"2022 IEEE 16th International Conference on Application of Information and Communication Technologies (AICT)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Reinforcement Learning Based Robot Control\",\"authors\":\"Z. Guliyev, Ali Parsayan\",\"doi\":\"10.1109/AICT55583.2022.10013595\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Reinforcement learning (RL) has been proven to be a feasible method for learning complicated actions autonomously from sensory observations. Even though many of the deep RL studies have been centered on modelled control and computer games, which has nothing to do with the limits of learning in actual surroundings, deep RL has also revealed its potential in allowing robots to acquire complicated abilities in the real-world situations. Real-world robotics, on the other hand, is an intriguing area for testing the algorithms of this kind, because it is directly related to the learning procedure of humans. Deep RL might enable developing movement abilities without a precise modelling of the robot dynamics and with minimum engineering. However, because of hyper-parameter sensitivity and low sampling capability, it is difficult to implement deep RL to robotic tasks involving real-world applications. It is comparable simple to tune hyper-parameters in simulations, while it can be a challenging task when it comes to physical world, for example, biped robots. Acquiring the ability to move and perceive in the actual world involves a variety of difficulties, some are simpler to handle than others that are frequently overlooked in RL studies which are limited to simulated environments. This paper provides approaches to deal with a variety of frequent difficulties in deep RL arising while training a biped robot to walk and follow a specific path.\",\"PeriodicalId\":441475,\"journal\":{\"name\":\"2022 IEEE 16th International Conference on Application of Information and Communication Technologies (AICT)\",\"volume\":\"20 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE 16th International Conference on Application of Information and Communication Technologies (AICT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AICT55583.2022.10013595\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE 16th International Conference on Application of Information and Communication Technologies (AICT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AICT55583.2022.10013595","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

强化学习(RL)已被证明是一种从感官观察中自主学习复杂动作的可行方法。尽管许多深度强化学习研究都集中在建模控制和电脑游戏上,这与实际环境中的学习限制无关,但深度强化学习也显示了它在允许机器人在现实世界中获得复杂能力方面的潜力。另一方面,现实世界的机器人技术是测试这种算法的一个有趣领域,因为它与人类的学习过程直接相关。深度强化学习可以在不需要精确的机器人动力学建模和最少的工程设计的情况下开发运动能力。然而,由于深度强化学习的超参数敏感性和低采样能力,很难将其应用于实际应用的机器人任务。在模拟中调整超参数相当简单,而在物理世界中,例如双足机器人,这可能是一项具有挑战性的任务。获得在现实世界中移动和感知的能力涉及各种各样的困难,其中一些比其他困难更容易处理,而这些困难在仅限于模拟环境的强化学习研究中经常被忽视。本文提供了处理深度强化学习中训练双足机器人在特定路径上行走时出现的各种常见困难的方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Reinforcement Learning Based Robot Control
Reinforcement learning (RL) has been proven to be a feasible method for learning complicated actions autonomously from sensory observations. Even though many of the deep RL studies have been centered on modelled control and computer games, which has nothing to do with the limits of learning in actual surroundings, deep RL has also revealed its potential in allowing robots to acquire complicated abilities in the real-world situations. Real-world robotics, on the other hand, is an intriguing area for testing the algorithms of this kind, because it is directly related to the learning procedure of humans. Deep RL might enable developing movement abilities without a precise modelling of the robot dynamics and with minimum engineering. However, because of hyper-parameter sensitivity and low sampling capability, it is difficult to implement deep RL to robotic tasks involving real-world applications. It is comparable simple to tune hyper-parameters in simulations, while it can be a challenging task when it comes to physical world, for example, biped robots. Acquiring the ability to move and perceive in the actual world involves a variety of difficulties, some are simpler to handle than others that are frequently overlooked in RL studies which are limited to simulated environments. This paper provides approaches to deal with a variety of frequent difficulties in deep RL arising while training a biped robot to walk and follow a specific path.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信