Guanzhong Zuo, Zhiyang Jia, Zongyang Wu, Jiawei Shi, Gang Wang
{"title":"针对机器具有模糊处理效率的分布式置换流水车间调度问题,采用q学习引导的对偶种群遗传算法","authors":"Guanzhong Zuo, Zhiyang Jia, Zongyang Wu, Jiawei Shi, Gang Wang","doi":"10.1016/j.eswa.2025.127882","DOIUrl":null,"url":null,"abstract":"<div><div>The emergence of Industry 5.0 has shifted the focus of research towards green manufacturing, flexible and digitalized production, particularly emphasizing human–machine collaboration and distributed manufacturing systems. Such a transition introduces increasingly complex and dynamic challenges for manufacturing enterprises, resulting in heightened uncertainties in production scheduling where traditional scheduling approaches often exhibit limited capability in handling multi-objective trade-offs. To overcome these limitations, a <span><math><mi>Q</mi></math></span>-learning guided dual-population genetic algorithm (QGGA) is proposed in the current study, featuring two key innovations: (1) a cooperation pool with dual-population knowledge sharing that stores non-dominated solutions from both populations while maintaining their evolutionary independence, (2) a state-dependent action adaptation mechanism that dynamically selects actions from nine heuristic rules using <span><math><mi>Q</mi></math></span>-learning. The cooperation pool enables synergistic optimization by storing non-dominated solutions from both populations to enable knowledge exchange while preserving their independent optimization processes. The <span><math><mi>Q</mi></math></span>-learning component continuously optimizes action selection based on solution diversity metric and convergence metric. Experimental results demonstrate that the proposed method achieves 19.1% improvement in Hypervolume (HV) and 65.5% reduction in inverted Generational Distance (IGD) compared to NSGA-II, outperforms PPO by 24.8% HV, and achieves an 90.4%better IGD than MOEA/D, achieving superior balance between solution robustness and computational efficiency. This advancement provides a new methodological framework for addressing Industry 5.0 scheduling challenges under uncertainty.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"285 ","pages":"Article 127882"},"PeriodicalIF":7.5000,"publicationDate":"2025-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Q-learning guided dual population genetic algorithm for distributed permutation flow shop scheduling problem with machine having fuzzy processing efficiency\",\"authors\":\"Guanzhong Zuo, Zhiyang Jia, Zongyang Wu, Jiawei Shi, Gang Wang\",\"doi\":\"10.1016/j.eswa.2025.127882\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The emergence of Industry 5.0 has shifted the focus of research towards green manufacturing, flexible and digitalized production, particularly emphasizing human–machine collaboration and distributed manufacturing systems. Such a transition introduces increasingly complex and dynamic challenges for manufacturing enterprises, resulting in heightened uncertainties in production scheduling where traditional scheduling approaches often exhibit limited capability in handling multi-objective trade-offs. To overcome these limitations, a <span><math><mi>Q</mi></math></span>-learning guided dual-population genetic algorithm (QGGA) is proposed in the current study, featuring two key innovations: (1) a cooperation pool with dual-population knowledge sharing that stores non-dominated solutions from both populations while maintaining their evolutionary independence, (2) a state-dependent action adaptation mechanism that dynamically selects actions from nine heuristic rules using <span><math><mi>Q</mi></math></span>-learning. The cooperation pool enables synergistic optimization by storing non-dominated solutions from both populations to enable knowledge exchange while preserving their independent optimization processes. The <span><math><mi>Q</mi></math></span>-learning component continuously optimizes action selection based on solution diversity metric and convergence metric. Experimental results demonstrate that the proposed method achieves 19.1% improvement in Hypervolume (HV) and 65.5% reduction in inverted Generational Distance (IGD) compared to NSGA-II, outperforms PPO by 24.8% HV, and achieves an 90.4%better IGD than MOEA/D, achieving superior balance between solution robustness and computational efficiency. This advancement provides a new methodological framework for addressing Industry 5.0 scheduling challenges under uncertainty.</div></div>\",\"PeriodicalId\":50461,\"journal\":{\"name\":\"Expert Systems with Applications\",\"volume\":\"285 \",\"pages\":\"Article 127882\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2025-05-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Expert Systems with Applications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0957417425015040\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425015040","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
A Q-learning guided dual population genetic algorithm for distributed permutation flow shop scheduling problem with machine having fuzzy processing efficiency
The emergence of Industry 5.0 has shifted the focus of research towards green manufacturing, flexible and digitalized production, particularly emphasizing human–machine collaboration and distributed manufacturing systems. Such a transition introduces increasingly complex and dynamic challenges for manufacturing enterprises, resulting in heightened uncertainties in production scheduling where traditional scheduling approaches often exhibit limited capability in handling multi-objective trade-offs. To overcome these limitations, a -learning guided dual-population genetic algorithm (QGGA) is proposed in the current study, featuring two key innovations: (1) a cooperation pool with dual-population knowledge sharing that stores non-dominated solutions from both populations while maintaining their evolutionary independence, (2) a state-dependent action adaptation mechanism that dynamically selects actions from nine heuristic rules using -learning. The cooperation pool enables synergistic optimization by storing non-dominated solutions from both populations to enable knowledge exchange while preserving their independent optimization processes. The -learning component continuously optimizes action selection based on solution diversity metric and convergence metric. Experimental results demonstrate that the proposed method achieves 19.1% improvement in Hypervolume (HV) and 65.5% reduction in inverted Generational Distance (IGD) compared to NSGA-II, outperforms PPO by 24.8% HV, and achieves an 90.4%better IGD than MOEA/D, achieving superior balance between solution robustness and computational efficiency. This advancement provides a new methodological framework for addressing Industry 5.0 scheduling challenges under uncertainty.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.