Constantin Waubert de Puiseau , Furkan Ercan , Jannik Peters , Marvin Brune , Hasan Tercan , Christopher Prinz , Tobias Meisen , Bernd Kuhlenkötter
{"title":"机器调度问题中深度强化学习的文献综述","authors":"Constantin Waubert de Puiseau , Furkan Ercan , Jannik Peters , Marvin Brune , Hasan Tercan , Christopher Prinz , Tobias Meisen , Bernd Kuhlenkötter","doi":"10.1016/j.jmsy.2025.12.017","DOIUrl":null,"url":null,"abstract":"<div><div>Machine scheduling represents a core challenge in industrial production systems due to its inherently complex combinatorial nature and its critical role in enhancing operational efficiency. With recent advances in artificial intelligence, deep reinforcement learning (DRL) has gained increasing attention as an innovative tool to address scheduling tasks with a self-adapting, data-driven approach. This survey presents a comprehensive review of 143 publications between 2018 and February 2025 that apply DRL to machine scheduling problems. We develop a structured framework to classify and compare problem settings, algorithmic designs, and evaluation methodologies. Key aspects such as action and observation space design, reward functions, neural network architectures, and experimental benchmarks are systematically analyzed. The review identifies current trends, outlines promising patterns, and highlights open research opportunities for DRL-based scheduling solutions. The goal of this survey is to make the rapidly evolving research landscape more accessible to both academics and practitioners and to identify the next steps in research and application. To facilitate reproducible research and customized analysis, we publish the dataset underpinning this review, which includes 61 annotated features per publication, allowing for customizable filtering and further in-depth exploration of niches within the field. This dataset is publicly accessible <span><span>online</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"85 ","pages":"Pages 96-126"},"PeriodicalIF":14.9000,"publicationDate":"2026-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A literature review on deep reinforcement learning for machine scheduling problems\",\"authors\":\"Constantin Waubert de Puiseau , Furkan Ercan , Jannik Peters , Marvin Brune , Hasan Tercan , Christopher Prinz , Tobias Meisen , Bernd Kuhlenkötter\",\"doi\":\"10.1016/j.jmsy.2025.12.017\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Machine scheduling represents a core challenge in industrial production systems due to its inherently complex combinatorial nature and its critical role in enhancing operational efficiency. With recent advances in artificial intelligence, deep reinforcement learning (DRL) has gained increasing attention as an innovative tool to address scheduling tasks with a self-adapting, data-driven approach. This survey presents a comprehensive review of 143 publications between 2018 and February 2025 that apply DRL to machine scheduling problems. We develop a structured framework to classify and compare problem settings, algorithmic designs, and evaluation methodologies. Key aspects such as action and observation space design, reward functions, neural network architectures, and experimental benchmarks are systematically analyzed. The review identifies current trends, outlines promising patterns, and highlights open research opportunities for DRL-based scheduling solutions. The goal of this survey is to make the rapidly evolving research landscape more accessible to both academics and practitioners and to identify the next steps in research and application. To facilitate reproducible research and customized analysis, we publish the dataset underpinning this review, which includes 61 annotated features per publication, allowing for customizable filtering and further in-depth exploration of niches within the field. This dataset is publicly accessible <span><span>online</span><svg><path></path></svg></span>.</div></div>\",\"PeriodicalId\":16227,\"journal\":{\"name\":\"Journal of Manufacturing Systems\",\"volume\":\"85 \",\"pages\":\"Pages 96-126\"},\"PeriodicalIF\":14.9000,\"publicationDate\":\"2026-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Manufacturing Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0278612525003140\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2026/1/12 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, INDUSTRIAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Systems","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0278612525003140","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/1/12 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
A literature review on deep reinforcement learning for machine scheduling problems
Machine scheduling represents a core challenge in industrial production systems due to its inherently complex combinatorial nature and its critical role in enhancing operational efficiency. With recent advances in artificial intelligence, deep reinforcement learning (DRL) has gained increasing attention as an innovative tool to address scheduling tasks with a self-adapting, data-driven approach. This survey presents a comprehensive review of 143 publications between 2018 and February 2025 that apply DRL to machine scheduling problems. We develop a structured framework to classify and compare problem settings, algorithmic designs, and evaluation methodologies. Key aspects such as action and observation space design, reward functions, neural network architectures, and experimental benchmarks are systematically analyzed. The review identifies current trends, outlines promising patterns, and highlights open research opportunities for DRL-based scheduling solutions. The goal of this survey is to make the rapidly evolving research landscape more accessible to both academics and practitioners and to identify the next steps in research and application. To facilitate reproducible research and customized analysis, we publish the dataset underpinning this review, which includes 61 annotated features per publication, allowing for customizable filtering and further in-depth exploration of niches within the field. This dataset is publicly accessible online.
期刊介绍:
The Journal of Manufacturing Systems is dedicated to showcasing cutting-edge fundamental and applied research in manufacturing at the systems level. Encompassing products, equipment, people, information, control, and support functions, manufacturing systems play a pivotal role in the economical and competitive development, production, delivery, and total lifecycle of products, meeting market and societal needs.
With a commitment to publishing archival scholarly literature, the journal strives to advance the state of the art in manufacturing systems and foster innovation in crafting efficient, robust, and sustainable manufacturing systems. The focus extends from equipment-level considerations to the broader scope of the extended enterprise. The Journal welcomes research addressing challenges across various scales, including nano, micro, and macro-scale manufacturing, and spanning diverse sectors such as aerospace, automotive, energy, and medical device manufacturing.