Jun Yang, Zhenbo Cheng, Gang Xiao, Xuesong Xu, Yaming Wang, Haonan Ding, Diting Zhou
{"title":"使用情景控制器的强化学习进行工程设计优化","authors":"Jun Yang, Zhenbo Cheng, Gang Xiao, Xuesong Xu, Yaming Wang, Haonan Ding, Diting Zhou","doi":"10.1049/ccs2.12063","DOIUrl":null,"url":null,"abstract":"<p>Engineers solving engineering design problems can be regarded as a gradual optimisation process that involves strategising. The process can be modelled as a reinforcement learning (RL) framework. This article presents an RL model with episodic controllers to solve engineering problems. Episodic controllers provide a mechanism for using the short-term and long-term memories to improve the efficiency of searching for engineering problem solutions. This work demonstrates that the two kinds of models of memories can be incorporated into the existing RL framework. Finally, an optimised design problem of a crane girder is illustrated by RL with episodic controllers. The work presented in this study leverages the RL model that has been shown to mimic human problem solving in engineering optimised design problems.</p>","PeriodicalId":33652,"journal":{"name":"Cognitive Computation and Systems","volume":"4 4","pages":"340-350"},"PeriodicalIF":1.2000,"publicationDate":"2022-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/ccs2.12063","citationCount":"1","resultStr":"{\"title\":\"Engineering design optimisation using reinforcement learning with episodic controllers\",\"authors\":\"Jun Yang, Zhenbo Cheng, Gang Xiao, Xuesong Xu, Yaming Wang, Haonan Ding, Diting Zhou\",\"doi\":\"10.1049/ccs2.12063\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Engineers solving engineering design problems can be regarded as a gradual optimisation process that involves strategising. The process can be modelled as a reinforcement learning (RL) framework. This article presents an RL model with episodic controllers to solve engineering problems. Episodic controllers provide a mechanism for using the short-term and long-term memories to improve the efficiency of searching for engineering problem solutions. This work demonstrates that the two kinds of models of memories can be incorporated into the existing RL framework. Finally, an optimised design problem of a crane girder is illustrated by RL with episodic controllers. The work presented in this study leverages the RL model that has been shown to mimic human problem solving in engineering optimised design problems.</p>\",\"PeriodicalId\":33652,\"journal\":{\"name\":\"Cognitive Computation and Systems\",\"volume\":\"4 4\",\"pages\":\"340-350\"},\"PeriodicalIF\":1.2000,\"publicationDate\":\"2022-06-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/ccs2.12063\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Cognitive Computation and Systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1049/ccs2.12063\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cognitive Computation and Systems","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/ccs2.12063","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Engineering design optimisation using reinforcement learning with episodic controllers
Engineers solving engineering design problems can be regarded as a gradual optimisation process that involves strategising. The process can be modelled as a reinforcement learning (RL) framework. This article presents an RL model with episodic controllers to solve engineering problems. Episodic controllers provide a mechanism for using the short-term and long-term memories to improve the efficiency of searching for engineering problem solutions. This work demonstrates that the two kinds of models of memories can be incorporated into the existing RL framework. Finally, an optimised design problem of a crane girder is illustrated by RL with episodic controllers. The work presented in this study leverages the RL model that has been shown to mimic human problem solving in engineering optimised design problems.