Deep reinforcement learning-based energy management strategy for fuel cell buses integrating future road information and cabin comfort control

Abstract

Conventional energy management strategy (EMS) for fuel cell vehicles (FCVs) aims to optimize powertrain energy consumption while ignoring the air conditioning regulation, whereby the overall energy efficiency cannot be optimal. To enhance the cabin-powertrain holistic energy utilization without compromising energy storage system degradation and passenger temperature comfort, this paper proposes a novel energy management paradigm. The comprehensive control of cabin comfort and fuel cell/battery durability is achieved by comprehensively utilizing onboard sensors and vehicle-cloud infrastructure. Specifically, the vehicle energy- and thermal-coupled control problem is formulated by considering energy consumption, component ageing, and cabin’s dynamic thermal model. In addition to regular state space in energy management problems, future road information and environmental temperature are innovatively integrated into the energy management framework. A twin delayed deep deterministic policy gradient algorithm is used to solve the problem to enhance the overall energy efficiency. Simulation results indicate that, compared with rule-based EMSs, the proposed strategy achieves cabin comfort while extending the battery life by at least 3.79 % and reducing the overall vehicle operating cost by at least 2.71 %.