基于后退地平线控制和TD3算法的插电式混合动力客车综合能量管理策略

IF 5 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Yi Du , Tianyi Zhang , Wei Cui , Naxin Cui
{"title":"基于后退地平线控制和TD3算法的插电式混合动力客车综合能量管理策略","authors":"Yi Du ,&nbsp;Tianyi Zhang ,&nbsp;Wei Cui ,&nbsp;Naxin Cui","doi":"10.1016/j.ijepes.2025.111103","DOIUrl":null,"url":null,"abstract":"<div><div>Due to its exceptional performance in terms of fuel efficiency, emissions reduction and driving convenience, the plug-in hybrid electric vehicle (PHEV) possesses a broad application market and development potential. However, the utilization of multiple power sources necessitates a rational and efficient energy management strategy (EMS) to coordinate multiple power sources to achieve efficient power output. In this study, an EMS within the receding horizon control (RHC) framework is proposed for the plug-in hybrid electric bus (PHEB), and a strategy based on twin delayed deep deterministic policy gradient (TD3) algorithm is introduced as a complementary strategy to enhance the robustness of the EMS. First, a vehicle velocity prediction model is constructed based on the gated recurrent unit (GRU) neural network with an attention mechanism to enable accurate prediction of future velocity in a finite horizon. Subsequently, a multi-objective RHC framework is established to effectively coordinate the objectives of vehicle fuel economy improvement and battery degradation mitigation. The power allocation problem is formulated as a rolling optimization issues over a finite prediction horizon, and the optimal control sequence is solved by the alternating direction method of multipliers (ADMM) algorithm. Additionally, the real-time monitoring of velocity prediction error enables the control system to timely switch to the TD3-based EMS when the error exceeds the preset range, so as to cope with unexpected situations. The simulation results demonstrate that the proposed EMS ensures reasonable battery charging and discharging under different initial state of charge (SOC) and driving distances, and mitigates battery degradation. Meanwhile, in comparison to the separate RHC strategy and TD3-based strategy, the proposed integrated EMS reduces the total cost of PHEB by 5.50% and 7.03%, respectively, thereby highlighting the superior fuel efficiency and adaptability to different driving conditions of the EMS.</div></div>","PeriodicalId":50326,"journal":{"name":"International Journal of Electrical Power & Energy Systems","volume":"172 ","pages":"Article 111103"},"PeriodicalIF":5.0000,"publicationDate":"2025-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An integrated energy management strategy for plug-in hybrid electric buses based on receding horizon control and TD3 algorithm\",\"authors\":\"Yi Du ,&nbsp;Tianyi Zhang ,&nbsp;Wei Cui ,&nbsp;Naxin Cui\",\"doi\":\"10.1016/j.ijepes.2025.111103\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Due to its exceptional performance in terms of fuel efficiency, emissions reduction and driving convenience, the plug-in hybrid electric vehicle (PHEV) possesses a broad application market and development potential. However, the utilization of multiple power sources necessitates a rational and efficient energy management strategy (EMS) to coordinate multiple power sources to achieve efficient power output. In this study, an EMS within the receding horizon control (RHC) framework is proposed for the plug-in hybrid electric bus (PHEB), and a strategy based on twin delayed deep deterministic policy gradient (TD3) algorithm is introduced as a complementary strategy to enhance the robustness of the EMS. First, a vehicle velocity prediction model is constructed based on the gated recurrent unit (GRU) neural network with an attention mechanism to enable accurate prediction of future velocity in a finite horizon. Subsequently, a multi-objective RHC framework is established to effectively coordinate the objectives of vehicle fuel economy improvement and battery degradation mitigation. The power allocation problem is formulated as a rolling optimization issues over a finite prediction horizon, and the optimal control sequence is solved by the alternating direction method of multipliers (ADMM) algorithm. Additionally, the real-time monitoring of velocity prediction error enables the control system to timely switch to the TD3-based EMS when the error exceeds the preset range, so as to cope with unexpected situations. The simulation results demonstrate that the proposed EMS ensures reasonable battery charging and discharging under different initial state of charge (SOC) and driving distances, and mitigates battery degradation. Meanwhile, in comparison to the separate RHC strategy and TD3-based strategy, the proposed integrated EMS reduces the total cost of PHEB by 5.50% and 7.03%, respectively, thereby highlighting the superior fuel efficiency and adaptability to different driving conditions of the EMS.</div></div>\",\"PeriodicalId\":50326,\"journal\":{\"name\":\"International Journal of Electrical Power & Energy Systems\",\"volume\":\"172 \",\"pages\":\"Article 111103\"},\"PeriodicalIF\":5.0000,\"publicationDate\":\"2025-09-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Electrical Power & Energy Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0142061525006519\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Electrical Power & Energy Systems","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0142061525006519","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

插电式混合动力汽车(PHEV)由于其在燃油效率、减排和驾驶便利性方面的优异性能,具有广阔的应用市场和发展潜力。然而,多电源的利用需要合理高效的能源管理策略(EMS)来协调多个电源,以实现高效的功率输出。本文针对插电式混合动力客车(PHEB)提出了一种后退地平线控制(RHC)框架下的EMS,并引入了一种基于双延迟深度确定性策略梯度(TD3)算法的策略作为补充策略,增强了EMS的鲁棒性。首先,基于门控循环单元(GRU)神经网络构建了车辆速度预测模型,并引入了注意机制,实现了在有限视界内对未来速度的准确预测;随后,建立了多目标RHC框架,以有效协调汽车燃油经济性提高和电池退化缓解的目标。将功率分配问题表述为有限预测范围内的滚动优化问题,采用交替方向乘法器(ADMM)算法求解最优控制序列。同时,通过对速度预测误差的实时监测,使控制系统在速度预测误差超过预设范围时,能够及时切换到基于td3的EMS,以应对突发情况。仿真结果表明,该方法在不同初始充电状态(SOC)和行驶距离下保证了电池合理充放电,减轻了电池劣化。同时,与单独的RHC策略和基于td3的策略相比,所提出的集成EMS将PHEB的总成本分别降低了5.50%和7.03%,从而突出了EMS优越的燃油效率和对不同驾驶条件的适应性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
An integrated energy management strategy for plug-in hybrid electric buses based on receding horizon control and TD3 algorithm
Due to its exceptional performance in terms of fuel efficiency, emissions reduction and driving convenience, the plug-in hybrid electric vehicle (PHEV) possesses a broad application market and development potential. However, the utilization of multiple power sources necessitates a rational and efficient energy management strategy (EMS) to coordinate multiple power sources to achieve efficient power output. In this study, an EMS within the receding horizon control (RHC) framework is proposed for the plug-in hybrid electric bus (PHEB), and a strategy based on twin delayed deep deterministic policy gradient (TD3) algorithm is introduced as a complementary strategy to enhance the robustness of the EMS. First, a vehicle velocity prediction model is constructed based on the gated recurrent unit (GRU) neural network with an attention mechanism to enable accurate prediction of future velocity in a finite horizon. Subsequently, a multi-objective RHC framework is established to effectively coordinate the objectives of vehicle fuel economy improvement and battery degradation mitigation. The power allocation problem is formulated as a rolling optimization issues over a finite prediction horizon, and the optimal control sequence is solved by the alternating direction method of multipliers (ADMM) algorithm. Additionally, the real-time monitoring of velocity prediction error enables the control system to timely switch to the TD3-based EMS when the error exceeds the preset range, so as to cope with unexpected situations. The simulation results demonstrate that the proposed EMS ensures reasonable battery charging and discharging under different initial state of charge (SOC) and driving distances, and mitigates battery degradation. Meanwhile, in comparison to the separate RHC strategy and TD3-based strategy, the proposed integrated EMS reduces the total cost of PHEB by 5.50% and 7.03%, respectively, thereby highlighting the superior fuel efficiency and adaptability to different driving conditions of the EMS.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
International Journal of Electrical Power & Energy Systems
International Journal of Electrical Power & Energy Systems 工程技术-工程:电子与电气
CiteScore
12.10
自引率
17.30%
发文量
1022
审稿时长
51 days
期刊介绍: The journal covers theoretical developments in electrical power and energy systems and their applications. The coverage embraces: generation and network planning; reliability; long and short term operation; expert systems; neural networks; object oriented systems; system control centres; database and information systems; stock and parameter estimation; system security and adequacy; network theory, modelling and computation; small and large system dynamics; dynamic model identification; on-line control including load and switching control; protection; distribution systems; energy economics; impact of non-conventional systems; and man-machine interfaces. As well as original research papers, the journal publishes short contributions, book reviews and conference reports. All papers are peer-reviewed by at least two referees.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信