Yifan Zhang , Wenxu Luo , Ye Hu , Qing Wang , Liang Cheng , Yinglin Ke
{"title":"基于协同多智能体深度强化学习的飞机部件代理模型驱动装配协调框架","authors":"Yifan Zhang , Wenxu Luo , Ye Hu , Qing Wang , Liang Cheng , Yinglin Ke","doi":"10.1016/j.jmsy.2025.08.021","DOIUrl":null,"url":null,"abstract":"<div><div>This study presents a multi-agent reinforcement learning (MARL) approach to address coordination challenges in aircraft component assembly. A machine learning–based surrogate model is developed to approximate component deformation, enabling the construction of a realistic and computationally efficient MARL training environment. Within this environment, multiple agents rapidly learn strategies to optimize both individual component deformations and inter-component coordination. The surrogate model compresses the high-dimensional displacement fields into lower-dimensional representations, significantly reducing the complexity of the state space. The reward function combines both local and coordination rewards, where the local reward evaluates manufacturing accuracy at the component level, and the coordination reward assesses alignment accuracy between components. By exchanging local state information during training, agents enhance cooperation, accelerate convergence, and improve overall assembly performance. The effectiveness of the proposed method is demonstrated through a fuselage panel assembly case study, achieving average reductions of 94.91 % in panel deformation and 95.02 % in inter-panel gaps. This framework offers a promising solution for coordinating deformable structures, substantially enhancing both assembly quality and efficiency.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"83 ","pages":"Pages 46-64"},"PeriodicalIF":14.2000,"publicationDate":"2025-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A surrogate model-driven assembly coordination framework for aircraft components based on cooperative multi-agent deep reinforcement learning\",\"authors\":\"Yifan Zhang , Wenxu Luo , Ye Hu , Qing Wang , Liang Cheng , Yinglin Ke\",\"doi\":\"10.1016/j.jmsy.2025.08.021\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>This study presents a multi-agent reinforcement learning (MARL) approach to address coordination challenges in aircraft component assembly. A machine learning–based surrogate model is developed to approximate component deformation, enabling the construction of a realistic and computationally efficient MARL training environment. Within this environment, multiple agents rapidly learn strategies to optimize both individual component deformations and inter-component coordination. The surrogate model compresses the high-dimensional displacement fields into lower-dimensional representations, significantly reducing the complexity of the state space. The reward function combines both local and coordination rewards, where the local reward evaluates manufacturing accuracy at the component level, and the coordination reward assesses alignment accuracy between components. By exchanging local state information during training, agents enhance cooperation, accelerate convergence, and improve overall assembly performance. The effectiveness of the proposed method is demonstrated through a fuselage panel assembly case study, achieving average reductions of 94.91 % in panel deformation and 95.02 % in inter-panel gaps. This framework offers a promising solution for coordinating deformable structures, substantially enhancing both assembly quality and efficiency.</div></div>\",\"PeriodicalId\":16227,\"journal\":{\"name\":\"Journal of Manufacturing Systems\",\"volume\":\"83 \",\"pages\":\"Pages 46-64\"},\"PeriodicalIF\":14.2000,\"publicationDate\":\"2025-09-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Manufacturing Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0278612525002201\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, INDUSTRIAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Systems","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0278612525002201","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
A surrogate model-driven assembly coordination framework for aircraft components based on cooperative multi-agent deep reinforcement learning
This study presents a multi-agent reinforcement learning (MARL) approach to address coordination challenges in aircraft component assembly. A machine learning–based surrogate model is developed to approximate component deformation, enabling the construction of a realistic and computationally efficient MARL training environment. Within this environment, multiple agents rapidly learn strategies to optimize both individual component deformations and inter-component coordination. The surrogate model compresses the high-dimensional displacement fields into lower-dimensional representations, significantly reducing the complexity of the state space. The reward function combines both local and coordination rewards, where the local reward evaluates manufacturing accuracy at the component level, and the coordination reward assesses alignment accuracy between components. By exchanging local state information during training, agents enhance cooperation, accelerate convergence, and improve overall assembly performance. The effectiveness of the proposed method is demonstrated through a fuselage panel assembly case study, achieving average reductions of 94.91 % in panel deformation and 95.02 % in inter-panel gaps. This framework offers a promising solution for coordinating deformable structures, substantially enhancing both assembly quality and efficiency.
期刊介绍:
The Journal of Manufacturing Systems is dedicated to showcasing cutting-edge fundamental and applied research in manufacturing at the systems level. Encompassing products, equipment, people, information, control, and support functions, manufacturing systems play a pivotal role in the economical and competitive development, production, delivery, and total lifecycle of products, meeting market and societal needs.
With a commitment to publishing archival scholarly literature, the journal strives to advance the state of the art in manufacturing systems and foster innovation in crafting efficient, robust, and sustainable manufacturing systems. The focus extends from equipment-level considerations to the broader scope of the extended enterprise. The Journal welcomes research addressing challenges across various scales, including nano, micro, and macro-scale manufacturing, and spanning diverse sectors such as aerospace, automotive, energy, and medical device manufacturing.