A reinforcement learning-enhanced multi-objective Co-evolutionary algorithm for distributed group scheduling with preventive maintenance

IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Yanan Wang , Yuyan Han , Yuting Wang , Hongyan Sang , Yuhang Wang
{"title":"A reinforcement learning-enhanced multi-objective Co-evolutionary algorithm for distributed group scheduling with preventive maintenance","authors":"Yanan Wang ,&nbsp;Yuyan Han ,&nbsp;Yuting Wang ,&nbsp;Hongyan Sang ,&nbsp;Yuhang Wang","doi":"10.1016/j.swevo.2025.102066","DOIUrl":null,"url":null,"abstract":"<div><div>In the context of the global impetus towards sustainable development and in response to grow market demands, there is a critical need for multi-regional, multi-objective, and flexible production models. Under this background, this article first formulates a mathematical model of a distributed group scheduling problem with preventive maintenance (DFGSP_PM), in which the machine's maintenance level drops below a preset threshold, preventive maintenance is triggered. Second, a reinforcement learning-enhanced multi-objective co-evolutionary algorithm (QCMOEA) is proposed. It incorporates a collaborative evaluation mechanism tailored to the characteristics of the coupled problems to extensively explore the solution space. To retain a balance between convergence and distribution properties, a solution selection strategy based on double-rank and cosine similarity approaches is utilized. Additionally, a Q-learning mechanism is adopted to dynamically select the optimal strategy during enhancing evolution for the group population. Furthermore, a three-stage increasing efficiency and reducing consumption strategy is designed by dynamically changing the machine speed. Finally, by conducting a comparative analysis with four existing metaheuristic algorithms across 405 test cases, the proposed algorithm demonstrates superior optimization capabilities in addressing this complex DFGSP_PM problem.</div></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":"97 ","pages":"Article 102066"},"PeriodicalIF":8.2000,"publicationDate":"2025-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Swarm and Evolutionary Computation","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S221065022500224X","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

In the context of the global impetus towards sustainable development and in response to grow market demands, there is a critical need for multi-regional, multi-objective, and flexible production models. Under this background, this article first formulates a mathematical model of a distributed group scheduling problem with preventive maintenance (DFGSP_PM), in which the machine's maintenance level drops below a preset threshold, preventive maintenance is triggered. Second, a reinforcement learning-enhanced multi-objective co-evolutionary algorithm (QCMOEA) is proposed. It incorporates a collaborative evaluation mechanism tailored to the characteristics of the coupled problems to extensively explore the solution space. To retain a balance between convergence and distribution properties, a solution selection strategy based on double-rank and cosine similarity approaches is utilized. Additionally, a Q-learning mechanism is adopted to dynamically select the optimal strategy during enhancing evolution for the group population. Furthermore, a three-stage increasing efficiency and reducing consumption strategy is designed by dynamically changing the machine speed. Finally, by conducting a comparative analysis with four existing metaheuristic algorithms across 405 test cases, the proposed algorithm demonstrates superior optimization capabilities in addressing this complex DFGSP_PM problem.
带预防性维护的分布式群调度的强化学习增强多目标协同进化算法
在全球推动可持续发展和响应日益增长的市场需求的背景下,迫切需要多区域、多目标和灵活的生产模式。在此背景下,本文首先建立了具有预防性维护的分布式组调度问题(DFGSP_PM)的数学模型,其中机器的维护水平低于预设阈值时触发预防性维护。其次,提出了一种强化学习增强的多目标协同进化算法(QCMOEA)。它结合了一种针对耦合问题特征的协同评估机制,以广泛地探索解决方案空间。为了保持收敛性和分布性之间的平衡,采用了一种基于双秩和余弦相似度方法的解选择策略。此外,采用q -学习机制,在群体增强进化过程中动态选择最优策略。在此基础上,通过动态改变机床转速,设计了三阶段增效降耗策略。最后,通过与现有的四种元启发式算法在405个测试用例中的比较分析,该算法在解决复杂的DFGSP_PM问题方面表现出了卓越的优化能力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Swarm and Evolutionary Computation
Swarm and Evolutionary Computation COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCEC-COMPUTER SCIENCE, THEORY & METHODS
CiteScore
16.00
自引率
12.00%
发文量
169
期刊介绍: Swarm and Evolutionary Computation is a pioneering peer-reviewed journal focused on the latest research and advancements in nature-inspired intelligent computation using swarm and evolutionary algorithms. It covers theoretical, experimental, and practical aspects of these paradigms and their hybrids, promoting interdisciplinary research. The journal prioritizes the publication of high-quality, original articles that push the boundaries of evolutionary computation and swarm intelligence. Additionally, it welcomes survey papers on current topics and novel applications. Topics of interest include but are not limited to: Genetic Algorithms, and Genetic Programming, Evolution Strategies, and Evolutionary Programming, Differential Evolution, Artificial Immune Systems, Particle Swarms, Ant Colony, Bacterial Foraging, Artificial Bees, Fireflies Algorithm, Harmony Search, Artificial Life, Digital Organisms, Estimation of Distribution Algorithms, Stochastic Diffusion Search, Quantum Computing, Nano Computing, Membrane Computing, Human-centric Computing, Hybridization of Algorithms, Memetic Computing, Autonomic Computing, Self-organizing systems, Combinatorial, Discrete, Binary, Constrained, Multi-objective, Multi-modal, Dynamic, and Large-scale Optimization.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信