Yu Zeng;Ziheng Xiao;Qingxiang Liu;Gaowen Liang;Ezequiel Rodriguez;Guibin Zou;Xin Zhang;Josep Pou
{"title":"电动飞机输入-串联-输出-并联双有源桥式辅助电源模块的物理信息深度迁移强化学习方法","authors":"Yu Zeng;Ziheng Xiao;Qingxiang Liu;Gaowen Liang;Ezequiel Rodriguez;Guibin Zou;Xin Zhang;Josep Pou","doi":"10.1109/TTE.2024.3514657","DOIUrl":null,"url":null,"abstract":"This article proposes a physics-informed deep transfer reinforcement learning (PIDTRL) approach for power balance control and triple phase shift (TPS) modulation method for the input-series output-parallel dual active bridge (ISOP-DAB) converter-based auxiliary power module (APM) in electric aircraft. The approach involves three stages: 1) centralized training of deep reinforcement learning agents to balance power and reduce current stress in the ISOP-DAB converter; 2) effective knowledge transfer from a source simulation system to a target experimental system using minimal experimental data, providing a scalable solution without extensive data reliance; and 3) deployment of multiple agents for online control in the ISOP-DAB converter. The proposed method adaptively determines optimal modulation variables (duty cycles and phase shifts) in stochastic and uncertain environments without requiring accurate model information. The experimental results validate the effectiveness of the proposed PIDTRL algorithm.","PeriodicalId":56269,"journal":{"name":"IEEE Transactions on Transportation Electrification","volume":"11 2","pages":"6629-6639"},"PeriodicalIF":8.3000,"publicationDate":"2024-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Physics-Informed Deep Transfer Reinforcement Learning Method for the Input-Series Output-Parallel Dual Active Bridge-Based Auxiliary Power Modules in Electrical Aircraft\",\"authors\":\"Yu Zeng;Ziheng Xiao;Qingxiang Liu;Gaowen Liang;Ezequiel Rodriguez;Guibin Zou;Xin Zhang;Josep Pou\",\"doi\":\"10.1109/TTE.2024.3514657\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This article proposes a physics-informed deep transfer reinforcement learning (PIDTRL) approach for power balance control and triple phase shift (TPS) modulation method for the input-series output-parallel dual active bridge (ISOP-DAB) converter-based auxiliary power module (APM) in electric aircraft. The approach involves three stages: 1) centralized training of deep reinforcement learning agents to balance power and reduce current stress in the ISOP-DAB converter; 2) effective knowledge transfer from a source simulation system to a target experimental system using minimal experimental data, providing a scalable solution without extensive data reliance; and 3) deployment of multiple agents for online control in the ISOP-DAB converter. The proposed method adaptively determines optimal modulation variables (duty cycles and phase shifts) in stochastic and uncertain environments without requiring accurate model information. The experimental results validate the effectiveness of the proposed PIDTRL algorithm.\",\"PeriodicalId\":56269,\"journal\":{\"name\":\"IEEE Transactions on Transportation Electrification\",\"volume\":\"11 2\",\"pages\":\"6629-6639\"},\"PeriodicalIF\":8.3000,\"publicationDate\":\"2024-12-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Transportation Electrification\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10789227/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Transportation Electrification","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10789227/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Physics-Informed Deep Transfer Reinforcement Learning Method for the Input-Series Output-Parallel Dual Active Bridge-Based Auxiliary Power Modules in Electrical Aircraft
This article proposes a physics-informed deep transfer reinforcement learning (PIDTRL) approach for power balance control and triple phase shift (TPS) modulation method for the input-series output-parallel dual active bridge (ISOP-DAB) converter-based auxiliary power module (APM) in electric aircraft. The approach involves three stages: 1) centralized training of deep reinforcement learning agents to balance power and reduce current stress in the ISOP-DAB converter; 2) effective knowledge transfer from a source simulation system to a target experimental system using minimal experimental data, providing a scalable solution without extensive data reliance; and 3) deployment of multiple agents for online control in the ISOP-DAB converter. The proposed method adaptively determines optimal modulation variables (duty cycles and phase shifts) in stochastic and uncertain environments without requiring accurate model information. The experimental results validate the effectiveness of the proposed PIDTRL algorithm.
期刊介绍:
IEEE Transactions on Transportation Electrification is focused on components, sub-systems, systems, standards, and grid interface technologies related to power and energy conversion, propulsion, and actuation for all types of electrified vehicles including on-road, off-road, off-highway, and rail vehicles, airplanes, and ships.