Zvezdan Loncarevic, Rok Pahič, Mihael Simonič, A. Ude, A. Gams
{"title":"利用定性学习奖励学习机器人投掷目标","authors":"Zvezdan Loncarevic, Rok Pahič, Mihael Simonič, A. Ude, A. Gams","doi":"10.1109/EUROCON.2019.8861589","DOIUrl":null,"url":null,"abstract":"Autonomous learning and adaptation of actions is critical for robots to operate in unstructured, everyday environments. Reinforcement learning (RL) methods are often applied for this. However, efficient RL requires the determination of an appropriate reward function, which is a complex problem even for domain experts. In this paper we investigate if a standard robotics reinforcement learning method called PoWER can be effectively utilized with a simple, qualitatively determined reward, instead of with a complex reward function. Our use-case example is robotic throwing at a target. However, for increased complexity, we perform throwing with a 7 degree of freedom arm of a humanoid robot, and a two-dimensional target space, i.e., the target is placed arbitrarily on the plain in front of the robot, which needs to learn the direction and the distance. Results show that learning with a simplified reward function that practically assigns a qualitative reward, just as a person would, can still be effectively used for RL using PoWER.","PeriodicalId":232097,"journal":{"name":"IEEE EUROCON 2019 -18th International Conference on Smart Technologies","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Learning of Robotic Throwing at a Target using a Qualitative Learning Reward\",\"authors\":\"Zvezdan Loncarevic, Rok Pahič, Mihael Simonič, A. Ude, A. Gams\",\"doi\":\"10.1109/EUROCON.2019.8861589\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Autonomous learning and adaptation of actions is critical for robots to operate in unstructured, everyday environments. Reinforcement learning (RL) methods are often applied for this. However, efficient RL requires the determination of an appropriate reward function, which is a complex problem even for domain experts. In this paper we investigate if a standard robotics reinforcement learning method called PoWER can be effectively utilized with a simple, qualitatively determined reward, instead of with a complex reward function. Our use-case example is robotic throwing at a target. However, for increased complexity, we perform throwing with a 7 degree of freedom arm of a humanoid robot, and a two-dimensional target space, i.e., the target is placed arbitrarily on the plain in front of the robot, which needs to learn the direction and the distance. Results show that learning with a simplified reward function that practically assigns a qualitative reward, just as a person would, can still be effectively used for RL using PoWER.\",\"PeriodicalId\":232097,\"journal\":{\"name\":\"IEEE EUROCON 2019 -18th International Conference on Smart Technologies\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE EUROCON 2019 -18th International Conference on Smart Technologies\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/EUROCON.2019.8861589\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE EUROCON 2019 -18th International Conference on Smart Technologies","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/EUROCON.2019.8861589","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Learning of Robotic Throwing at a Target using a Qualitative Learning Reward
Autonomous learning and adaptation of actions is critical for robots to operate in unstructured, everyday environments. Reinforcement learning (RL) methods are often applied for this. However, efficient RL requires the determination of an appropriate reward function, which is a complex problem even for domain experts. In this paper we investigate if a standard robotics reinforcement learning method called PoWER can be effectively utilized with a simple, qualitatively determined reward, instead of with a complex reward function. Our use-case example is robotic throwing at a target. However, for increased complexity, we perform throwing with a 7 degree of freedom arm of a humanoid robot, and a two-dimensional target space, i.e., the target is placed arbitrarily on the plain in front of the robot, which needs to learn the direction and the distance. Results show that learning with a simplified reward function that practically assigns a qualitative reward, just as a person would, can still be effectively used for RL using PoWER.