Yanan Wang , Yuyan Han , Yuting Wang , Hongyan Sang , Yuhang Wang
{"title":"带预防性维护的分布式群调度的强化学习增强多目标协同进化算法","authors":"Yanan Wang , Yuyan Han , Yuting Wang , Hongyan Sang , Yuhang Wang","doi":"10.1016/j.swevo.2025.102066","DOIUrl":null,"url":null,"abstract":"<div><div>In the context of the global impetus towards sustainable development and in response to grow market demands, there is a critical need for multi-regional, multi-objective, and flexible production models. Under this background, this article first formulates a mathematical model of a distributed group scheduling problem with preventive maintenance (DFGSP_PM), in which the machine's maintenance level drops below a preset threshold, preventive maintenance is triggered. Second, a reinforcement learning-enhanced multi-objective co-evolutionary algorithm (QCMOEA) is proposed. It incorporates a collaborative evaluation mechanism tailored to the characteristics of the coupled problems to extensively explore the solution space. To retain a balance between convergence and distribution properties, a solution selection strategy based on double-rank and cosine similarity approaches is utilized. Additionally, a Q-learning mechanism is adopted to dynamically select the optimal strategy during enhancing evolution for the group population. Furthermore, a three-stage increasing efficiency and reducing consumption strategy is designed by dynamically changing the machine speed. Finally, by conducting a comparative analysis with four existing metaheuristic algorithms across 405 test cases, the proposed algorithm demonstrates superior optimization capabilities in addressing this complex DFGSP_PM problem.</div></div>","PeriodicalId":48682,"journal":{"name":"Swarm and Evolutionary Computation","volume":"97 ","pages":"Article 102066"},"PeriodicalIF":8.2000,"publicationDate":"2025-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A reinforcement learning-enhanced multi-objective Co-evolutionary algorithm for distributed group scheduling with preventive maintenance\",\"authors\":\"Yanan Wang , Yuyan Han , Yuting Wang , Hongyan Sang , Yuhang Wang\",\"doi\":\"10.1016/j.swevo.2025.102066\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In the context of the global impetus towards sustainable development and in response to grow market demands, there is a critical need for multi-regional, multi-objective, and flexible production models. Under this background, this article first formulates a mathematical model of a distributed group scheduling problem with preventive maintenance (DFGSP_PM), in which the machine's maintenance level drops below a preset threshold, preventive maintenance is triggered. Second, a reinforcement learning-enhanced multi-objective co-evolutionary algorithm (QCMOEA) is proposed. It incorporates a collaborative evaluation mechanism tailored to the characteristics of the coupled problems to extensively explore the solution space. To retain a balance between convergence and distribution properties, a solution selection strategy based on double-rank and cosine similarity approaches is utilized. Additionally, a Q-learning mechanism is adopted to dynamically select the optimal strategy during enhancing evolution for the group population. Furthermore, a three-stage increasing efficiency and reducing consumption strategy is designed by dynamically changing the machine speed. Finally, by conducting a comparative analysis with four existing metaheuristic algorithms across 405 test cases, the proposed algorithm demonstrates superior optimization capabilities in addressing this complex DFGSP_PM problem.</div></div>\",\"PeriodicalId\":48682,\"journal\":{\"name\":\"Swarm and Evolutionary Computation\",\"volume\":\"97 \",\"pages\":\"Article 102066\"},\"PeriodicalIF\":8.2000,\"publicationDate\":\"2025-07-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Swarm and Evolutionary Computation\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S221065022500224X\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Swarm and Evolutionary Computation","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S221065022500224X","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
A reinforcement learning-enhanced multi-objective Co-evolutionary algorithm for distributed group scheduling with preventive maintenance
In the context of the global impetus towards sustainable development and in response to grow market demands, there is a critical need for multi-regional, multi-objective, and flexible production models. Under this background, this article first formulates a mathematical model of a distributed group scheduling problem with preventive maintenance (DFGSP_PM), in which the machine's maintenance level drops below a preset threshold, preventive maintenance is triggered. Second, a reinforcement learning-enhanced multi-objective co-evolutionary algorithm (QCMOEA) is proposed. It incorporates a collaborative evaluation mechanism tailored to the characteristics of the coupled problems to extensively explore the solution space. To retain a balance between convergence and distribution properties, a solution selection strategy based on double-rank and cosine similarity approaches is utilized. Additionally, a Q-learning mechanism is adopted to dynamically select the optimal strategy during enhancing evolution for the group population. Furthermore, a three-stage increasing efficiency and reducing consumption strategy is designed by dynamically changing the machine speed. Finally, by conducting a comparative analysis with four existing metaheuristic algorithms across 405 test cases, the proposed algorithm demonstrates superior optimization capabilities in addressing this complex DFGSP_PM problem.
期刊介绍:
Swarm and Evolutionary Computation is a pioneering peer-reviewed journal focused on the latest research and advancements in nature-inspired intelligent computation using swarm and evolutionary algorithms. It covers theoretical, experimental, and practical aspects of these paradigms and their hybrids, promoting interdisciplinary research. The journal prioritizes the publication of high-quality, original articles that push the boundaries of evolutionary computation and swarm intelligence. Additionally, it welcomes survey papers on current topics and novel applications. Topics of interest include but are not limited to: Genetic Algorithms, and Genetic Programming, Evolution Strategies, and Evolutionary Programming, Differential Evolution, Artificial Immune Systems, Particle Swarms, Ant Colony, Bacterial Foraging, Artificial Bees, Fireflies Algorithm, Harmony Search, Artificial Life, Digital Organisms, Estimation of Distribution Algorithms, Stochastic Diffusion Search, Quantum Computing, Nano Computing, Membrane Computing, Human-centric Computing, Hybridization of Algorithms, Memetic Computing, Autonomic Computing, Self-organizing systems, Combinatorial, Discrete, Binary, Constrained, Multi-objective, Multi-modal, Dynamic, and Large-scale Optimization.