{"title":"通过强化学习为欺骗攻击下的非线性系统提供一种新的最优自适应反步进控制方法","authors":"Wendi Chen , Qinglai Wei","doi":"10.1016/j.jai.2023.11.001","DOIUrl":null,"url":null,"abstract":"<div><p>In this paper, a new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning is presented in this paper. The existence of nonlinear terms in the studied system makes it very difficult to design the optimal controller using traditional methods. To achieve optimal control, RL algorithm based on critic–actor architecture is considered for the nonlinear system. Due to the significant security risks of network transmission, the system is vulnerable to deception attacks, which can make all the system state unavailable. By using the attacked states to design coordinate transformation, the harm brought by unknown deception attacks has been overcome. The presented control strategy can ensure that all signals in the closed-loop system are semi-globally ultimately bounded. Finally, the simulation experiment is shown to prove the effectiveness of the strategy.</p></div>","PeriodicalId":100755,"journal":{"name":"Journal of Automation and Intelligence","volume":"3 1","pages":"Pages 34-39"},"PeriodicalIF":0.0000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949855423000461/pdfft?md5=f1d39b9fda2a82a6aab8a2a790f387cb&pid=1-s2.0-S2949855423000461-main.pdf","citationCount":"0","resultStr":"{\"title\":\"A new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning\",\"authors\":\"Wendi Chen , Qinglai Wei\",\"doi\":\"10.1016/j.jai.2023.11.001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In this paper, a new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning is presented in this paper. The existence of nonlinear terms in the studied system makes it very difficult to design the optimal controller using traditional methods. To achieve optimal control, RL algorithm based on critic–actor architecture is considered for the nonlinear system. Due to the significant security risks of network transmission, the system is vulnerable to deception attacks, which can make all the system state unavailable. By using the attacked states to design coordinate transformation, the harm brought by unknown deception attacks has been overcome. The presented control strategy can ensure that all signals in the closed-loop system are semi-globally ultimately bounded. Finally, the simulation experiment is shown to prove the effectiveness of the strategy.</p></div>\",\"PeriodicalId\":100755,\"journal\":{\"name\":\"Journal of Automation and Intelligence\",\"volume\":\"3 1\",\"pages\":\"Pages 34-39\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-03-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2949855423000461/pdfft?md5=f1d39b9fda2a82a6aab8a2a790f387cb&pid=1-s2.0-S2949855423000461-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Automation and Intelligence\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2949855423000461\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Automation and Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2949855423000461","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning
In this paper, a new optimal adaptive backstepping control approach for nonlinear systems under deception attacks via reinforcement learning is presented in this paper. The existence of nonlinear terms in the studied system makes it very difficult to design the optimal controller using traditional methods. To achieve optimal control, RL algorithm based on critic–actor architecture is considered for the nonlinear system. Due to the significant security risks of network transmission, the system is vulnerable to deception attacks, which can make all the system state unavailable. By using the attacked states to design coordinate transformation, the harm brought by unknown deception attacks has been overcome. The presented control strategy can ensure that all signals in the closed-loop system are semi-globally ultimately bounded. Finally, the simulation experiment is shown to prove the effectiveness of the strategy.