Improved genetic algorithm based on reinforcement learning for electric vehicle front-end structure optimization design

IF 4.2 2区 工程技术 Q2 ENGINEERING, MANUFACTURING
Feng-Yao Lyu, Zhen-Fei Zhan, Gui-Lin Zhou, Ju Wang, Jie Li, Xin He
{"title":"Improved genetic algorithm based on reinforcement learning for electric vehicle front-end structure optimization design","authors":"Feng-Yao Lyu,&nbsp;Zhen-Fei Zhan,&nbsp;Gui-Lin Zhou,&nbsp;Ju Wang,&nbsp;Jie Li,&nbsp;Xin He","doi":"10.1007/s40436-024-00495-z","DOIUrl":null,"url":null,"abstract":"<div><p>The structural optimization of electric vehicles involves numerous design variables and constraints, making it a complex engineering optimization task over the past decades. Many population-based evolutionary algorithms encounter issues such as converging to local optima and lacking population diversity when tackling such optimization problems. Consequently, the solutions obtained for the optimization may be flawed or suboptimal. To address these problems, an improved genetic algorithm (GA) based on reinforcement learning is proposed in this paper. The proposed method introduces a population delimitation method based on individual fitness ranking. The population is divided into two parts: the excellent population and the ordinary population, and different selection and cross-mutation methods are applied to each part separately. More efficient crossover and mutation methods are then applied to the ordinary population to enhance the generation of excellent individuals. Furthermore, the proposed approach replaces the traditional fixed crossover and mutation rates with a dynamic selection method based on reinforcement learning to enhance optimization efficiency. A markov decision process model is constructed based on GA environment in this context. The population state determination method and reward method are designed for reinforcement learning in the GA environment, dynamically selecting the most appropriate genetic parameters based on the current state of the population. Finally, the uncertainty in the manufacturing process is introduced into the optimization problem and the case study results demonstrate that the proposed reinforcement learning-based GA significantly outperforms other evolutionary algorithms when applied to solving the structural optimization of electric vehicles.</p></div>","PeriodicalId":7342,"journal":{"name":"Advances in Manufacturing","volume":"12 3","pages":"556 - 575"},"PeriodicalIF":4.2000,"publicationDate":"2024-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advances in Manufacturing","FirstCategoryId":"5","ListUrlMain":"https://link.springer.com/article/10.1007/s40436-024-00495-z","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0

Abstract

The structural optimization of electric vehicles involves numerous design variables and constraints, making it a complex engineering optimization task over the past decades. Many population-based evolutionary algorithms encounter issues such as converging to local optima and lacking population diversity when tackling such optimization problems. Consequently, the solutions obtained for the optimization may be flawed or suboptimal. To address these problems, an improved genetic algorithm (GA) based on reinforcement learning is proposed in this paper. The proposed method introduces a population delimitation method based on individual fitness ranking. The population is divided into two parts: the excellent population and the ordinary population, and different selection and cross-mutation methods are applied to each part separately. More efficient crossover and mutation methods are then applied to the ordinary population to enhance the generation of excellent individuals. Furthermore, the proposed approach replaces the traditional fixed crossover and mutation rates with a dynamic selection method based on reinforcement learning to enhance optimization efficiency. A markov decision process model is constructed based on GA environment in this context. The population state determination method and reward method are designed for reinforcement learning in the GA environment, dynamically selecting the most appropriate genetic parameters based on the current state of the population. Finally, the uncertainty in the manufacturing process is introduced into the optimization problem and the case study results demonstrate that the proposed reinforcement learning-based GA significantly outperforms other evolutionary algorithms when applied to solving the structural optimization of electric vehicles.

Abstract Image

Abstract Image

基于强化学习的改进遗传算法在电动汽车前端结构优化设计中的应用
电动汽车的结构优化涉及众多设计变量和约束条件,因此在过去几十年中一直是一项复杂的工程优化任务。许多基于种群的进化算法在处理此类优化问题时会遇到收敛到局部最优和缺乏种群多样性等问题。因此,优化获得的解决方案可能存在缺陷或次优。为了解决这些问题,本文提出了一种基于强化学习的改进遗传算法(GA)。该方法引入了一种基于个体适应度排名的种群划分方法。种群被分为优秀种群和普通种群两部分,每部分分别采用不同的选择和交叉突变方法。然后将更有效的交叉和突变方法应用于普通种群,以提高优秀个体的生成。此外,提出的方法还用基于强化学习的动态选择方法取代了传统的固定交叉率和突变率,以提高优化效率。在此背景下,基于 GA 环境构建了一个马尔可夫决策过程模型。针对 GA 环境下的强化学习,设计了种群状态确定方法和奖励方法,根据种群的当前状态动态选择最合适的遗传参数。最后,在优化问题中引入了制造过程中的不确定性,案例研究结果表明,在应用基于强化学习的 GA 解决电动汽车结构优化问题时,所提出的 GA 明显优于其他进化算法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Advances in Manufacturing
Advances in Manufacturing Materials Science-Polymers and Plastics
CiteScore
9.10
自引率
3.80%
发文量
274
期刊介绍: As an innovative, fundamental and scientific journal, Advances in Manufacturing aims to describe the latest regional and global research results and forefront developments in advanced manufacturing field. As such, it serves as an international platform for academic exchange between experts, scholars and researchers in this field. All articles in Advances in Manufacturing are peer reviewed. Respected scholars from the fields of advanced manufacturing fields will be invited to write some comments. We also encourage and give priority to research papers that have made major breakthroughs or innovations in the fundamental theory. The targeted fields include: manufacturing automation, mechatronics and robotics, precision manufacturing and control, micro-nano-manufacturing, green manufacturing, design in manufacturing, metallic and nonmetallic materials in manufacturing, metallurgical process, etc. The forms of articles include (but not limited to): academic articles, research reports, and general reviews.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信