{"title":"基于强化学习的双臂机器人单板安装技能获取","authors":"Dong Liu, Jianfu Cao, X. Lei","doi":"10.1109/ROBIO49542.2019.8961805","DOIUrl":null,"url":null,"abstract":"Slabstone installation is so widely used in the construction industry that it is very significant to use the robot to finish this process, making the process more automatic, effective and safer. Because of the uncertain factors in environments and filling material, it is difficult to finish the final step of slabstone installation that pressing the slabstone into good contact with filling material. There is currently no mature theory and method to achieve control of the process. In this paper, we use a dual-arm robot to accomplish the final step. First, we use the spring-damping elements to model and simulate the filling material. Then, based on deep reinforcement learning, a skill acquisition method is proposed to solve the problems of uncertain factors in the final step of slabstone installation process. Finally, we use a simulation-platform to train and evaluate our algorithm. The results have shown that our method is capable and effective in accomplishing the installation process.","PeriodicalId":121822,"journal":{"name":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"40 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Slabstone Installation Skill Acquisition for Dual-Arm Robot based on Reinforcement Learning\",\"authors\":\"Dong Liu, Jianfu Cao, X. Lei\",\"doi\":\"10.1109/ROBIO49542.2019.8961805\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Slabstone installation is so widely used in the construction industry that it is very significant to use the robot to finish this process, making the process more automatic, effective and safer. Because of the uncertain factors in environments and filling material, it is difficult to finish the final step of slabstone installation that pressing the slabstone into good contact with filling material. There is currently no mature theory and method to achieve control of the process. In this paper, we use a dual-arm robot to accomplish the final step. First, we use the spring-damping elements to model and simulate the filling material. Then, based on deep reinforcement learning, a skill acquisition method is proposed to solve the problems of uncertain factors in the final step of slabstone installation process. Finally, we use a simulation-platform to train and evaluate our algorithm. The results have shown that our method is capable and effective in accomplishing the installation process.\",\"PeriodicalId\":121822,\"journal\":{\"name\":\"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)\",\"volume\":\"40 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ROBIO49542.2019.8961805\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ROBIO49542.2019.8961805","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Slabstone Installation Skill Acquisition for Dual-Arm Robot based on Reinforcement Learning
Slabstone installation is so widely used in the construction industry that it is very significant to use the robot to finish this process, making the process more automatic, effective and safer. Because of the uncertain factors in environments and filling material, it is difficult to finish the final step of slabstone installation that pressing the slabstone into good contact with filling material. There is currently no mature theory and method to achieve control of the process. In this paper, we use a dual-arm robot to accomplish the final step. First, we use the spring-damping elements to model and simulate the filling material. Then, based on deep reinforcement learning, a skill acquisition method is proposed to solve the problems of uncertain factors in the final step of slabstone installation process. Finally, we use a simulation-platform to train and evaluate our algorithm. The results have shown that our method is capable and effective in accomplishing the installation process.