{"title":"基于改进DDPG算法的燃料电池汽车能量管理:驾驶意图速度预测与健康感知控制相结合","authors":"Chunchun Jia , Wei Liu , Hongwen He , K.T. Chau","doi":"10.1016/j.apenergy.2025.126195","DOIUrl":null,"url":null,"abstract":"<div><div>Despite the significant advantages of fuel cell (FC) vehicles in reducing urban air pollution and extending driving range, effectively managing their internal energy systems remains a major challenge. To maximize the operational efficiency and lifespan of the FC system without compromising fuel economy, this paper proposes a novel predictive energy management paradigm guided by deep reinforcement learning. This strategy innovatively integrates driving intention speed prediction and health-aware control. Specifically, we developed a multi-input bi-directional long short-term memory (BiLSTM) predictor incorporating driving intentions (DI-BiLSTM) using the fuzzy C-means algorithm to enhance the prediction accuracy of future vehicle state trajectories. Downstream control decisions are executed through an improved deep deterministic policy gradient (DDPG) algorithm, which optimizes action space selection based on the degradation characteristics of the FC system. Additionally, during the training and validation phases of the energy management strategy (EMS), we utilized high-quality driving data collected from real bus routes using a high-performance Beidou integrated navigation system, replacing conventional standard driving cycles to enhance the strategy's generalization ability across different scenarios. The results indicate that, compared with conventional prediction model relying solely on historical speed data, the DI-BiLSTM improves prediction accuracy by at least 7.86 % over 3 s, 5 s, and 8 s prediction horizons. Compared with conventional DDPG-based EMS, the proposed EMS increases the average efficiency of the FC system by 32.18 % and extends its lifespan by 16.50 %. In terms of overall driving costs, the proposed EMS improves driving economy by 9.97 % compared with conventional DDPG-based EMS.</div></div>","PeriodicalId":246,"journal":{"name":"Applied Energy","volume":"394 ","pages":"Article 126195"},"PeriodicalIF":10.1000,"publicationDate":"2025-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Superior energy management for fuel cell vehicles guided by improved DDPG algorithm: Integrating driving intention speed prediction and health-aware control\",\"authors\":\"Chunchun Jia , Wei Liu , Hongwen He , K.T. Chau\",\"doi\":\"10.1016/j.apenergy.2025.126195\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Despite the significant advantages of fuel cell (FC) vehicles in reducing urban air pollution and extending driving range, effectively managing their internal energy systems remains a major challenge. To maximize the operational efficiency and lifespan of the FC system without compromising fuel economy, this paper proposes a novel predictive energy management paradigm guided by deep reinforcement learning. This strategy innovatively integrates driving intention speed prediction and health-aware control. Specifically, we developed a multi-input bi-directional long short-term memory (BiLSTM) predictor incorporating driving intentions (DI-BiLSTM) using the fuzzy C-means algorithm to enhance the prediction accuracy of future vehicle state trajectories. Downstream control decisions are executed through an improved deep deterministic policy gradient (DDPG) algorithm, which optimizes action space selection based on the degradation characteristics of the FC system. Additionally, during the training and validation phases of the energy management strategy (EMS), we utilized high-quality driving data collected from real bus routes using a high-performance Beidou integrated navigation system, replacing conventional standard driving cycles to enhance the strategy's generalization ability across different scenarios. The results indicate that, compared with conventional prediction model relying solely on historical speed data, the DI-BiLSTM improves prediction accuracy by at least 7.86 % over 3 s, 5 s, and 8 s prediction horizons. Compared with conventional DDPG-based EMS, the proposed EMS increases the average efficiency of the FC system by 32.18 % and extends its lifespan by 16.50 %. In terms of overall driving costs, the proposed EMS improves driving economy by 9.97 % compared with conventional DDPG-based EMS.</div></div>\",\"PeriodicalId\":246,\"journal\":{\"name\":\"Applied Energy\",\"volume\":\"394 \",\"pages\":\"Article 126195\"},\"PeriodicalIF\":10.1000,\"publicationDate\":\"2025-05-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Energy\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0306261925009250\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Energy","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306261925009250","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
Superior energy management for fuel cell vehicles guided by improved DDPG algorithm: Integrating driving intention speed prediction and health-aware control
Despite the significant advantages of fuel cell (FC) vehicles in reducing urban air pollution and extending driving range, effectively managing their internal energy systems remains a major challenge. To maximize the operational efficiency and lifespan of the FC system without compromising fuel economy, this paper proposes a novel predictive energy management paradigm guided by deep reinforcement learning. This strategy innovatively integrates driving intention speed prediction and health-aware control. Specifically, we developed a multi-input bi-directional long short-term memory (BiLSTM) predictor incorporating driving intentions (DI-BiLSTM) using the fuzzy C-means algorithm to enhance the prediction accuracy of future vehicle state trajectories. Downstream control decisions are executed through an improved deep deterministic policy gradient (DDPG) algorithm, which optimizes action space selection based on the degradation characteristics of the FC system. Additionally, during the training and validation phases of the energy management strategy (EMS), we utilized high-quality driving data collected from real bus routes using a high-performance Beidou integrated navigation system, replacing conventional standard driving cycles to enhance the strategy's generalization ability across different scenarios. The results indicate that, compared with conventional prediction model relying solely on historical speed data, the DI-BiLSTM improves prediction accuracy by at least 7.86 % over 3 s, 5 s, and 8 s prediction horizons. Compared with conventional DDPG-based EMS, the proposed EMS increases the average efficiency of the FC system by 32.18 % and extends its lifespan by 16.50 %. In terms of overall driving costs, the proposed EMS improves driving economy by 9.97 % compared with conventional DDPG-based EMS.
期刊介绍:
Applied Energy serves as a platform for sharing innovations, research, development, and demonstrations in energy conversion, conservation, and sustainable energy systems. The journal covers topics such as optimal energy resource use, environmental pollutant mitigation, and energy process analysis. It welcomes original papers, review articles, technical notes, and letters to the editor. Authors are encouraged to submit manuscripts that bridge the gap between research, development, and implementation. The journal addresses a wide spectrum of topics, including fossil and renewable energy technologies, energy economics, and environmental impacts. Applied Energy also explores modeling and forecasting, conservation strategies, and the social and economic implications of energy policies, including climate change mitigation. It is complemented by the open-access journal Advances in Applied Energy.