{"title":"连续直流电动机控制器的强化学习","authors":"Bucur Cosmin, Tasu Sorin","doi":"10.1109/ECAI58194.2023.10193912","DOIUrl":null,"url":null,"abstract":"Electric motors control is a very knows topic in research and most of the activities are drawn towards classic PI or model predictive control methods. Implementing reinforcement learning techniques in the field of motor control depends on fidelity environments, types of considered motors and modeled power electronics used for control. Training an RL speed controller means finding an optimal control policy by offline training using an environment, before implementing it in a real-world scenario. Different environments and techniques have been developed for training RL controllers, most of them being extensions of Open AI gym environments. This paper presents a trained RL speed controller, developed through Reinforcement learning techniques, specifically TD3 RL algorithm, applied to permanently excited dc motors. In this work, the open-source Python package gym-electric-motor (GEM) [1] is used for environment setup, and pytorch framework for developing the controller.","PeriodicalId":391483,"journal":{"name":"2023 15th International Conference on Electronics, Computers and Artificial Intelligence (ECAI)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Reinforcement Learning for a Continuous DC Motor Controller\",\"authors\":\"Bucur Cosmin, Tasu Sorin\",\"doi\":\"10.1109/ECAI58194.2023.10193912\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Electric motors control is a very knows topic in research and most of the activities are drawn towards classic PI or model predictive control methods. Implementing reinforcement learning techniques in the field of motor control depends on fidelity environments, types of considered motors and modeled power electronics used for control. Training an RL speed controller means finding an optimal control policy by offline training using an environment, before implementing it in a real-world scenario. Different environments and techniques have been developed for training RL controllers, most of them being extensions of Open AI gym environments. This paper presents a trained RL speed controller, developed through Reinforcement learning techniques, specifically TD3 RL algorithm, applied to permanently excited dc motors. In this work, the open-source Python package gym-electric-motor (GEM) [1] is used for environment setup, and pytorch framework for developing the controller.\",\"PeriodicalId\":391483,\"journal\":{\"name\":\"2023 15th International Conference on Electronics, Computers and Artificial Intelligence (ECAI)\",\"volume\":\"13 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 15th International Conference on Electronics, Computers and Artificial Intelligence (ECAI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ECAI58194.2023.10193912\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 15th International Conference on Electronics, Computers and Artificial Intelligence (ECAI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ECAI58194.2023.10193912","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Reinforcement Learning for a Continuous DC Motor Controller
Electric motors control is a very knows topic in research and most of the activities are drawn towards classic PI or model predictive control methods. Implementing reinforcement learning techniques in the field of motor control depends on fidelity environments, types of considered motors and modeled power electronics used for control. Training an RL speed controller means finding an optimal control policy by offline training using an environment, before implementing it in a real-world scenario. Different environments and techniques have been developed for training RL controllers, most of them being extensions of Open AI gym environments. This paper presents a trained RL speed controller, developed through Reinforcement learning techniques, specifically TD3 RL algorithm, applied to permanently excited dc motors. In this work, the open-source Python package gym-electric-motor (GEM) [1] is used for environment setup, and pytorch framework for developing the controller.