基于改进DDPG算法的燃料电池汽车能量管理:驾驶意图速度预测与健康感知控制相结合

IF 10.1 1区 工程技术 Q1 ENERGY & FUELS
Chunchun Jia , Wei Liu , Hongwen He , K.T. Chau
{"title":"基于改进DDPG算法的燃料电池汽车能量管理:驾驶意图速度预测与健康感知控制相结合","authors":"Chunchun Jia ,&nbsp;Wei Liu ,&nbsp;Hongwen He ,&nbsp;K.T. Chau","doi":"10.1016/j.apenergy.2025.126195","DOIUrl":null,"url":null,"abstract":"<div><div>Despite the significant advantages of fuel cell (FC) vehicles in reducing urban air pollution and extending driving range, effectively managing their internal energy systems remains a major challenge. To maximize the operational efficiency and lifespan of the FC system without compromising fuel economy, this paper proposes a novel predictive energy management paradigm guided by deep reinforcement learning. This strategy innovatively integrates driving intention speed prediction and health-aware control. Specifically, we developed a multi-input bi-directional long short-term memory (BiLSTM) predictor incorporating driving intentions (DI-BiLSTM) using the fuzzy C-means algorithm to enhance the prediction accuracy of future vehicle state trajectories. Downstream control decisions are executed through an improved deep deterministic policy gradient (DDPG) algorithm, which optimizes action space selection based on the degradation characteristics of the FC system. Additionally, during the training and validation phases of the energy management strategy (EMS), we utilized high-quality driving data collected from real bus routes using a high-performance Beidou integrated navigation system, replacing conventional standard driving cycles to enhance the strategy's generalization ability across different scenarios. The results indicate that, compared with conventional prediction model relying solely on historical speed data, the DI-BiLSTM improves prediction accuracy by at least 7.86 % over 3 s, 5 s, and 8 s prediction horizons. Compared with conventional DDPG-based EMS, the proposed EMS increases the average efficiency of the FC system by 32.18 % and extends its lifespan by 16.50 %. In terms of overall driving costs, the proposed EMS improves driving economy by 9.97 % compared with conventional DDPG-based EMS.</div></div>","PeriodicalId":246,"journal":{"name":"Applied Energy","volume":"394 ","pages":"Article 126195"},"PeriodicalIF":10.1000,"publicationDate":"2025-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Superior energy management for fuel cell vehicles guided by improved DDPG algorithm: Integrating driving intention speed prediction and health-aware control\",\"authors\":\"Chunchun Jia ,&nbsp;Wei Liu ,&nbsp;Hongwen He ,&nbsp;K.T. Chau\",\"doi\":\"10.1016/j.apenergy.2025.126195\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Despite the significant advantages of fuel cell (FC) vehicles in reducing urban air pollution and extending driving range, effectively managing their internal energy systems remains a major challenge. To maximize the operational efficiency and lifespan of the FC system without compromising fuel economy, this paper proposes a novel predictive energy management paradigm guided by deep reinforcement learning. This strategy innovatively integrates driving intention speed prediction and health-aware control. Specifically, we developed a multi-input bi-directional long short-term memory (BiLSTM) predictor incorporating driving intentions (DI-BiLSTM) using the fuzzy C-means algorithm to enhance the prediction accuracy of future vehicle state trajectories. Downstream control decisions are executed through an improved deep deterministic policy gradient (DDPG) algorithm, which optimizes action space selection based on the degradation characteristics of the FC system. Additionally, during the training and validation phases of the energy management strategy (EMS), we utilized high-quality driving data collected from real bus routes using a high-performance Beidou integrated navigation system, replacing conventional standard driving cycles to enhance the strategy's generalization ability across different scenarios. The results indicate that, compared with conventional prediction model relying solely on historical speed data, the DI-BiLSTM improves prediction accuracy by at least 7.86 % over 3 s, 5 s, and 8 s prediction horizons. Compared with conventional DDPG-based EMS, the proposed EMS increases the average efficiency of the FC system by 32.18 % and extends its lifespan by 16.50 %. In terms of overall driving costs, the proposed EMS improves driving economy by 9.97 % compared with conventional DDPG-based EMS.</div></div>\",\"PeriodicalId\":246,\"journal\":{\"name\":\"Applied Energy\",\"volume\":\"394 \",\"pages\":\"Article 126195\"},\"PeriodicalIF\":10.1000,\"publicationDate\":\"2025-05-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Energy\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0306261925009250\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Energy","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306261925009250","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0

摘要

尽管燃料电池(FC)汽车在减少城市空气污染和延长行驶里程方面具有显著优势,但有效管理其内部能源系统仍然是一个重大挑战。为了在不影响燃油经济性的情况下最大限度地提高FC系统的运行效率和寿命,本文提出了一种基于深度强化学习的新型预测能源管理范式。该策略创新性地将驾驶意图速度预测与健康感知控制相结合。具体而言,我们利用模糊c均值算法开发了一个包含驾驶意图的多输入双向长短期记忆(BiLSTM)预测器(DI-BiLSTM),以提高对未来车辆状态轨迹的预测精度。下游控制决策通过改进的深度确定性策略梯度(deep deterministic policy gradient, DDPG)算法执行,该算法基于FC系统的退化特性优化动作空间选择。此外,在能量管理策略(EMS)的训练和验证阶段,我们利用高性能北斗综合导航系统从真实公交路线收集的高质量驾驶数据,取代传统的标准驾驶周期,增强策略在不同场景下的泛化能力。结果表明,与单纯依赖历史航速数据的传统预测模型相比,dii - bilstm在3 s、5 s和8 s预测期内的预测精度至少提高了7.86%。与传统的基于ddpg的EMS相比,该EMS使FC系统的平均效率提高了32.18%,寿命延长了16.50%。在总驾驶成本方面,与传统的基于ddpg的EMS相比,该EMS的驾驶经济性提高了9.97%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Superior energy management for fuel cell vehicles guided by improved DDPG algorithm: Integrating driving intention speed prediction and health-aware control
Despite the significant advantages of fuel cell (FC) vehicles in reducing urban air pollution and extending driving range, effectively managing their internal energy systems remains a major challenge. To maximize the operational efficiency and lifespan of the FC system without compromising fuel economy, this paper proposes a novel predictive energy management paradigm guided by deep reinforcement learning. This strategy innovatively integrates driving intention speed prediction and health-aware control. Specifically, we developed a multi-input bi-directional long short-term memory (BiLSTM) predictor incorporating driving intentions (DI-BiLSTM) using the fuzzy C-means algorithm to enhance the prediction accuracy of future vehicle state trajectories. Downstream control decisions are executed through an improved deep deterministic policy gradient (DDPG) algorithm, which optimizes action space selection based on the degradation characteristics of the FC system. Additionally, during the training and validation phases of the energy management strategy (EMS), we utilized high-quality driving data collected from real bus routes using a high-performance Beidou integrated navigation system, replacing conventional standard driving cycles to enhance the strategy's generalization ability across different scenarios. The results indicate that, compared with conventional prediction model relying solely on historical speed data, the DI-BiLSTM improves prediction accuracy by at least 7.86 % over 3 s, 5 s, and 8 s prediction horizons. Compared with conventional DDPG-based EMS, the proposed EMS increases the average efficiency of the FC system by 32.18 % and extends its lifespan by 16.50 %. In terms of overall driving costs, the proposed EMS improves driving economy by 9.97 % compared with conventional DDPG-based EMS.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Applied Energy
Applied Energy 工程技术-工程:化工
CiteScore
21.20
自引率
10.70%
发文量
1830
审稿时长
41 days
期刊介绍: Applied Energy serves as a platform for sharing innovations, research, development, and demonstrations in energy conversion, conservation, and sustainable energy systems. The journal covers topics such as optimal energy resource use, environmental pollutant mitigation, and energy process analysis. It welcomes original papers, review articles, technical notes, and letters to the editor. Authors are encouraged to submit manuscripts that bridge the gap between research, development, and implementation. The journal addresses a wide spectrum of topics, including fossil and renewable energy technologies, energy economics, and environmental impacts. Applied Energy also explores modeling and forecasting, conservation strategies, and the social and economic implications of energy policies, including climate change mitigation. It is complemented by the open-access journal Advances in Applied Energy.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信