Myisha A. Chowdhury, Saif S.S. Al-Wahaibi, Qiugang Lu
{"title":"自适应安全强化学习优化电池快速充电协议","authors":"Myisha A. Chowdhury, Saif S.S. Al-Wahaibi, Qiugang Lu","doi":"10.1002/aic.18605","DOIUrl":null,"url":null,"abstract":"<p>Optimizing charging protocols is critical for reducing battery charging time and decelerating battery degradation in applications such as electric vehicles. Recently, reinforcement learning (RL) methods have been adopted for such purposes. However, RL-based methods may not ensure system (safety) constraints, which can cause irreversible damages to batteries and reduce their lifetime. To this end, this article proposes an adaptive and safe RL framework to optimize fast charging strategies while respecting safety constraints with a high probability. In our method, any unsafe action that the RL agent decides will be projected into a safety region by solving a constrained optimization problem. The safety region is constructed using adaptive Gaussian process (GP) models, consisting of static and dynamic GPs, that learn from online experience to adaptively account for any changes in battery dynamics. Simulation results show that our method can charge the batteries rapidly with constraint satisfaction under varying operating conditions.</p>","PeriodicalId":120,"journal":{"name":"AIChE Journal","volume":"71 1","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2024-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adaptive safe reinforcement learning-enabled optimization of battery fast-charging protocols\",\"authors\":\"Myisha A. Chowdhury, Saif S.S. Al-Wahaibi, Qiugang Lu\",\"doi\":\"10.1002/aic.18605\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Optimizing charging protocols is critical for reducing battery charging time and decelerating battery degradation in applications such as electric vehicles. Recently, reinforcement learning (RL) methods have been adopted for such purposes. However, RL-based methods may not ensure system (safety) constraints, which can cause irreversible damages to batteries and reduce their lifetime. To this end, this article proposes an adaptive and safe RL framework to optimize fast charging strategies while respecting safety constraints with a high probability. In our method, any unsafe action that the RL agent decides will be projected into a safety region by solving a constrained optimization problem. The safety region is constructed using adaptive Gaussian process (GP) models, consisting of static and dynamic GPs, that learn from online experience to adaptively account for any changes in battery dynamics. Simulation results show that our method can charge the batteries rapidly with constraint satisfaction under varying operating conditions.</p>\",\"PeriodicalId\":120,\"journal\":{\"name\":\"AIChE Journal\",\"volume\":\"71 1\",\"pages\":\"\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2024-09-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"AIChE Journal\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/aic.18605\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, CHEMICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"AIChE Journal","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/aic.18605","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, CHEMICAL","Score":null,"Total":0}
引用次数: 0
摘要
在电动汽车等应用中,优化充电协议对于缩短电池充电时间和减缓电池衰减至关重要。最近,强化学习(RL)方法已被用于此类目的。然而,基于 RL 的方法可能无法确保系统(安全)约束,这可能会对电池造成不可逆转的损害,并缩短其使用寿命。为此,本文提出了一种自适应安全 RL 框架,用于优化快速充电策略,同时高概率地遵守安全约束。在我们的方法中,RL 代理决定的任何不安全行为都将通过解决约束优化问题投射到一个安全区域。安全区域使用自适应高斯过程(GP)模型构建,该模型由静态和动态 GP 组成,可从在线经验中学习,自适应地考虑电池动态的任何变化。仿真结果表明,我们的方法可以在不同的运行条件下,在满足约束条件的情况下快速为电池充电。
Adaptive safe reinforcement learning-enabled optimization of battery fast-charging protocols
Optimizing charging protocols is critical for reducing battery charging time and decelerating battery degradation in applications such as electric vehicles. Recently, reinforcement learning (RL) methods have been adopted for such purposes. However, RL-based methods may not ensure system (safety) constraints, which can cause irreversible damages to batteries and reduce their lifetime. To this end, this article proposes an adaptive and safe RL framework to optimize fast charging strategies while respecting safety constraints with a high probability. In our method, any unsafe action that the RL agent decides will be projected into a safety region by solving a constrained optimization problem. The safety region is constructed using adaptive Gaussian process (GP) models, consisting of static and dynamic GPs, that learn from online experience to adaptively account for any changes in battery dynamics. Simulation results show that our method can charge the batteries rapidly with constraint satisfaction under varying operating conditions.
期刊介绍:
The AIChE Journal is the premier research monthly in chemical engineering and related fields. This peer-reviewed and broad-based journal reports on the most important and latest technological advances in core areas of chemical engineering as well as in other relevant engineering disciplines. To keep abreast with the progressive outlook of the profession, the Journal has been expanding the scope of its editorial contents to include such fast developing areas as biotechnology, electrochemical engineering, and environmental engineering.
The AIChE Journal is indeed the global communications vehicle for the world-renowned researchers to exchange top-notch research findings with one another. Subscribing to the AIChE Journal is like having immediate access to nine topical journals in the field.
Articles are categorized according to the following topical areas:
Biomolecular Engineering, Bioengineering, Biochemicals, Biofuels, and Food
Inorganic Materials: Synthesis and Processing
Particle Technology and Fluidization
Process Systems Engineering
Reaction Engineering, Kinetics and Catalysis
Separations: Materials, Devices and Processes
Soft Materials: Synthesis, Processing and Products
Thermodynamics and Molecular-Scale Phenomena
Transport Phenomena and Fluid Mechanics.