Yang Cheng, Z. Shui, Cheng Xu, Tianyu Feng, Yiyang Jiang
{"title":"基于强化学习的跨周期迭代无人机再入制导","authors":"Yang Cheng, Z. Shui, Cheng Xu, Tianyu Feng, Yiyang Jiang","doi":"10.1109/ICUS48101.2019.8996086","DOIUrl":null,"url":null,"abstract":"The traditional predictive correction algorithm requires a large number of iterative calculations for the predicted trajectory, which greatly occupies a large amount of computing resources, so that the real-time solution of the guidance command can not be guaranteed, and the guidance accuracy will have a large impact. And the prediction correction guidance requires the algorithm to have the ability of selfadaptation and intelligent learning. Therefore, this paper proposes a cross-cycle iterative hypersonic UAV predictive correction guidance method based on reinforcement learning. The parametric control variable (CVP) method is used to construct the parametric model of the guidance command. The actor-critic-based reinforcement learning method is used to solve the guidance command in real time, and the guidance information is effectively transmitted in the adjacent guidance solution cycle. The guidance error converges to within the allowable accuracy range during the cross-cycle iteration. Monte Carlo simulation shows that the proposed method has good adaptability to initial conditions and flight parameter uncertainty, and can guarantee the real-time performance of the guidance command while achieving high-precision guidance.","PeriodicalId":344181,"journal":{"name":"2019 IEEE International Conference on Unmanned Systems (ICUS)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Cross-cycle iterative unmanned aerial vehicle reentry guidance based on reinforcement learning\",\"authors\":\"Yang Cheng, Z. Shui, Cheng Xu, Tianyu Feng, Yiyang Jiang\",\"doi\":\"10.1109/ICUS48101.2019.8996086\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The traditional predictive correction algorithm requires a large number of iterative calculations for the predicted trajectory, which greatly occupies a large amount of computing resources, so that the real-time solution of the guidance command can not be guaranteed, and the guidance accuracy will have a large impact. And the prediction correction guidance requires the algorithm to have the ability of selfadaptation and intelligent learning. Therefore, this paper proposes a cross-cycle iterative hypersonic UAV predictive correction guidance method based on reinforcement learning. The parametric control variable (CVP) method is used to construct the parametric model of the guidance command. The actor-critic-based reinforcement learning method is used to solve the guidance command in real time, and the guidance information is effectively transmitted in the adjacent guidance solution cycle. The guidance error converges to within the allowable accuracy range during the cross-cycle iteration. Monte Carlo simulation shows that the proposed method has good adaptability to initial conditions and flight parameter uncertainty, and can guarantee the real-time performance of the guidance command while achieving high-precision guidance.\",\"PeriodicalId\":344181,\"journal\":{\"name\":\"2019 IEEE International Conference on Unmanned Systems (ICUS)\",\"volume\":\"2 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 IEEE International Conference on Unmanned Systems (ICUS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICUS48101.2019.8996086\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE International Conference on Unmanned Systems (ICUS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICUS48101.2019.8996086","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Cross-cycle iterative unmanned aerial vehicle reentry guidance based on reinforcement learning
The traditional predictive correction algorithm requires a large number of iterative calculations for the predicted trajectory, which greatly occupies a large amount of computing resources, so that the real-time solution of the guidance command can not be guaranteed, and the guidance accuracy will have a large impact. And the prediction correction guidance requires the algorithm to have the ability of selfadaptation and intelligent learning. Therefore, this paper proposes a cross-cycle iterative hypersonic UAV predictive correction guidance method based on reinforcement learning. The parametric control variable (CVP) method is used to construct the parametric model of the guidance command. The actor-critic-based reinforcement learning method is used to solve the guidance command in real time, and the guidance information is effectively transmitted in the adjacent guidance solution cycle. The guidance error converges to within the allowable accuracy range during the cross-cycle iteration. Monte Carlo simulation shows that the proposed method has good adaptability to initial conditions and flight parameter uncertainty, and can guarantee the real-time performance of the guidance command while achieving high-precision guidance.