Sen Zhan, Yu Huang, Fei Li, Yanli Yin, Chunsheng Liu
{"title":"基于 Q-learning 算法的纯电动汽车低温热管理系统多目标控制策略研究","authors":"Sen Zhan, Yu Huang, Fei Li, Yanli Yin, Chunsheng Liu","doi":"10.1177/09544070241265984","DOIUrl":null,"url":null,"abstract":"In low-temperature conditions, a reasonable control strategy for thermal management systems can effectively alleviate range anxiety in pure electric vehicles and improve their adaptability to various working conditions. To further enhance the adaptability of thermal management system control strategies in different working conditions, this paper proposes a multi-objective control strategy based on Q-learning algorithm. Firstly, a pure electric vehicle model based on power-thermal coupling is established. The accuracy of the model is validated by comparing the simulation results from combined Amesim and Matlab/Simulink simulations with experimental data. Secondly, taking into consideration the factors such as vehicle economy, powertrain performance, and cabin comfort, a novel control strategy utilizing the Q-learning algorithm for the thermal management system of pure electric vehicle is developed. Finally, the efficacy of Q-learning control strategy is analyzed by simulations conducted under NEDC and WLTC conditions, with an initial temperature of −20°C. The results showed that, compared to the rule-based control strategy in WLTC and NEDC working conditions, the comprehensive improvement effect of Q-learning control strategy is 9.35% and 10.76% respectively. Moreover, the Q-learning control strategy achieves 94.25% and 90.19% of the global optimal control effect obtained through DP. The results indicate that the proposed control strategy has good adaptability to different working conditions.","PeriodicalId":54568,"journal":{"name":"Proceedings of the Institution of Mechanical Engineers Part D-Journal of Automobile Engineering","volume":"23 1","pages":""},"PeriodicalIF":1.5000,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Research on multi-objective control strategy of thermal management system of pure electric vehicle at low temperature based on Q-learning algorithm\",\"authors\":\"Sen Zhan, Yu Huang, Fei Li, Yanli Yin, Chunsheng Liu\",\"doi\":\"10.1177/09544070241265984\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In low-temperature conditions, a reasonable control strategy for thermal management systems can effectively alleviate range anxiety in pure electric vehicles and improve their adaptability to various working conditions. To further enhance the adaptability of thermal management system control strategies in different working conditions, this paper proposes a multi-objective control strategy based on Q-learning algorithm. Firstly, a pure electric vehicle model based on power-thermal coupling is established. The accuracy of the model is validated by comparing the simulation results from combined Amesim and Matlab/Simulink simulations with experimental data. Secondly, taking into consideration the factors such as vehicle economy, powertrain performance, and cabin comfort, a novel control strategy utilizing the Q-learning algorithm for the thermal management system of pure electric vehicle is developed. Finally, the efficacy of Q-learning control strategy is analyzed by simulations conducted under NEDC and WLTC conditions, with an initial temperature of −20°C. The results showed that, compared to the rule-based control strategy in WLTC and NEDC working conditions, the comprehensive improvement effect of Q-learning control strategy is 9.35% and 10.76% respectively. Moreover, the Q-learning control strategy achieves 94.25% and 90.19% of the global optimal control effect obtained through DP. The results indicate that the proposed control strategy has good adaptability to different working conditions.\",\"PeriodicalId\":54568,\"journal\":{\"name\":\"Proceedings of the Institution of Mechanical Engineers Part D-Journal of Automobile Engineering\",\"volume\":\"23 1\",\"pages\":\"\"},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2024-07-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the Institution of Mechanical Engineers Part D-Journal of Automobile Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1177/09544070241265984\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, MECHANICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Institution of Mechanical Engineers Part D-Journal of Automobile Engineering","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1177/09544070241265984","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, MECHANICAL","Score":null,"Total":0}
Research on multi-objective control strategy of thermal management system of pure electric vehicle at low temperature based on Q-learning algorithm
In low-temperature conditions, a reasonable control strategy for thermal management systems can effectively alleviate range anxiety in pure electric vehicles and improve their adaptability to various working conditions. To further enhance the adaptability of thermal management system control strategies in different working conditions, this paper proposes a multi-objective control strategy based on Q-learning algorithm. Firstly, a pure electric vehicle model based on power-thermal coupling is established. The accuracy of the model is validated by comparing the simulation results from combined Amesim and Matlab/Simulink simulations with experimental data. Secondly, taking into consideration the factors such as vehicle economy, powertrain performance, and cabin comfort, a novel control strategy utilizing the Q-learning algorithm for the thermal management system of pure electric vehicle is developed. Finally, the efficacy of Q-learning control strategy is analyzed by simulations conducted under NEDC and WLTC conditions, with an initial temperature of −20°C. The results showed that, compared to the rule-based control strategy in WLTC and NEDC working conditions, the comprehensive improvement effect of Q-learning control strategy is 9.35% and 10.76% respectively. Moreover, the Q-learning control strategy achieves 94.25% and 90.19% of the global optimal control effect obtained through DP. The results indicate that the proposed control strategy has good adaptability to different working conditions.
期刊介绍:
The Journal of Automobile Engineering is an established, high quality multi-disciplinary journal which publishes the very best peer-reviewed science and engineering in the field.