Lin Huo , Jianlin Mao , Hongjun San , Ruiqi Li , Shufan Zhang
{"title":"面向多机器人寻路的群体意识深度强化学习","authors":"Lin Huo , Jianlin Mao , Hongjun San , Ruiqi Li , Shufan Zhang","doi":"10.1016/j.engappai.2025.110978","DOIUrl":null,"url":null,"abstract":"<div><div>Deep Reinforcement Learning (DRL) is highly effective in tackling complex environments through individual decision-making. It offers a novel and powerful approach to multi-robot pathfinding (MRPF). Building on DRL principles, this paper proposes a two-layer collaborative planning framework based on group consciousness (MACCRPF). The framework addresses the unique challenges of MRPF, where robots must not only independently complete their tasks but also coordinate to avoid conflicts during execution. Specifically, the proposed two-layer group consciousness mechanism encompasses: Basic layer group consensus, which emphasizes real-time information sharing and local task scheduling among robots. This layer ensures individual decisions are optimized through dynamic interaction and coordination. Top-layer group consensus, guided by the basic layer consensus, incorporates group strategies and evaluation mechanisms to adaptively adjust pathfinding in complex environments. Additionally, a hierarchical reward mechanism is designed to balance the demands of the two-layer planning framework. This mechanism significantly enhances inter-robot coordination efficiency and task completion rates. Experimental results demonstrate the efficacy of our approach, achieving over 20% improvement in pathfinding success rates compared to state-of-the-art methods. Furthermore, the framework exhibits strong transferability and generalization, maintaining high efficiency across diverse environments. This method provides a technical pathway for efficient collaboration in multi-robot systems.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"155 ","pages":"Article 110978"},"PeriodicalIF":8.0000,"publicationDate":"2025-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Reinforcement Learning of group consciousness for multi-robot pathfinding\",\"authors\":\"Lin Huo , Jianlin Mao , Hongjun San , Ruiqi Li , Shufan Zhang\",\"doi\":\"10.1016/j.engappai.2025.110978\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Deep Reinforcement Learning (DRL) is highly effective in tackling complex environments through individual decision-making. It offers a novel and powerful approach to multi-robot pathfinding (MRPF). Building on DRL principles, this paper proposes a two-layer collaborative planning framework based on group consciousness (MACCRPF). The framework addresses the unique challenges of MRPF, where robots must not only independently complete their tasks but also coordinate to avoid conflicts during execution. Specifically, the proposed two-layer group consciousness mechanism encompasses: Basic layer group consensus, which emphasizes real-time information sharing and local task scheduling among robots. This layer ensures individual decisions are optimized through dynamic interaction and coordination. Top-layer group consensus, guided by the basic layer consensus, incorporates group strategies and evaluation mechanisms to adaptively adjust pathfinding in complex environments. Additionally, a hierarchical reward mechanism is designed to balance the demands of the two-layer planning framework. This mechanism significantly enhances inter-robot coordination efficiency and task completion rates. Experimental results demonstrate the efficacy of our approach, achieving over 20% improvement in pathfinding success rates compared to state-of-the-art methods. Furthermore, the framework exhibits strong transferability and generalization, maintaining high efficiency across diverse environments. This method provides a technical pathway for efficient collaboration in multi-robot systems.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"155 \",\"pages\":\"Article 110978\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2025-05-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197625009789\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625009789","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Deep Reinforcement Learning of group consciousness for multi-robot pathfinding
Deep Reinforcement Learning (DRL) is highly effective in tackling complex environments through individual decision-making. It offers a novel and powerful approach to multi-robot pathfinding (MRPF). Building on DRL principles, this paper proposes a two-layer collaborative planning framework based on group consciousness (MACCRPF). The framework addresses the unique challenges of MRPF, where robots must not only independently complete their tasks but also coordinate to avoid conflicts during execution. Specifically, the proposed two-layer group consciousness mechanism encompasses: Basic layer group consensus, which emphasizes real-time information sharing and local task scheduling among robots. This layer ensures individual decisions are optimized through dynamic interaction and coordination. Top-layer group consensus, guided by the basic layer consensus, incorporates group strategies and evaluation mechanisms to adaptively adjust pathfinding in complex environments. Additionally, a hierarchical reward mechanism is designed to balance the demands of the two-layer planning framework. This mechanism significantly enhances inter-robot coordination efficiency and task completion rates. Experimental results demonstrate the efficacy of our approach, achieving over 20% improvement in pathfinding success rates compared to state-of-the-art methods. Furthermore, the framework exhibits strong transferability and generalization, maintaining high efficiency across diverse environments. This method provides a technical pathway for efficient collaboration in multi-robot systems.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.