{"title":"基于深度强化学习的智能结构自适应振动控制","authors":"S. Honda, Yuta Imura, K. Sasaki, Ryo Takeda","doi":"10.25042/epi-ije.082022.03","DOIUrl":null,"url":null,"abstract":"In this research, the authors developed an adaptive control method using deep reinforcement learning which is a kind of machine learning to suppress the vibration of smart structures. This method just requires information about the control response and input, and don’t require numerical models for the controlled object to design the controller. We experimented to verify the effectiveness of this method. In this experiment, a smart structure fabricated by an aluminum plate and a piezoelectric actuator was used as a controlled object. Three kinds of reinforcement learning algorithms are employed, Deep Q Network (DQN), Deep Deterministic Policy Gradient (DDPG), and Twin Delayed DDPG (TD3), and the control performance is compared. As a result, we succeeded in reducing the norm of the frequency response to impulse disturbance by up to about 40 dB compared to the uncontrolled case. This demonstrates the applicability of the control method using deep reinforcement learning to adaptive vibration control.","PeriodicalId":387754,"journal":{"name":"EPI International Journal of Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adaptive Vibration Control of Smart Structure Using Deep Reinforcement Learning\",\"authors\":\"S. Honda, Yuta Imura, K. Sasaki, Ryo Takeda\",\"doi\":\"10.25042/epi-ije.082022.03\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this research, the authors developed an adaptive control method using deep reinforcement learning which is a kind of machine learning to suppress the vibration of smart structures. This method just requires information about the control response and input, and don’t require numerical models for the controlled object to design the controller. We experimented to verify the effectiveness of this method. In this experiment, a smart structure fabricated by an aluminum plate and a piezoelectric actuator was used as a controlled object. Three kinds of reinforcement learning algorithms are employed, Deep Q Network (DQN), Deep Deterministic Policy Gradient (DDPG), and Twin Delayed DDPG (TD3), and the control performance is compared. As a result, we succeeded in reducing the norm of the frequency response to impulse disturbance by up to about 40 dB compared to the uncontrolled case. This demonstrates the applicability of the control method using deep reinforcement learning to adaptive vibration control.\",\"PeriodicalId\":387754,\"journal\":{\"name\":\"EPI International Journal of Engineering\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-08-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"EPI International Journal of Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.25042/epi-ije.082022.03\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"EPI International Journal of Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.25042/epi-ije.082022.03","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Adaptive Vibration Control of Smart Structure Using Deep Reinforcement Learning
In this research, the authors developed an adaptive control method using deep reinforcement learning which is a kind of machine learning to suppress the vibration of smart structures. This method just requires information about the control response and input, and don’t require numerical models for the controlled object to design the controller. We experimented to verify the effectiveness of this method. In this experiment, a smart structure fabricated by an aluminum plate and a piezoelectric actuator was used as a controlled object. Three kinds of reinforcement learning algorithms are employed, Deep Q Network (DQN), Deep Deterministic Policy Gradient (DDPG), and Twin Delayed DDPG (TD3), and the control performance is compared. As a result, we succeeded in reducing the norm of the frequency response to impulse disturbance by up to about 40 dB compared to the uncontrolled case. This demonstrates the applicability of the control method using deep reinforcement learning to adaptive vibration control.