面向多机器人寻路的群体意识深度强化学习

IF 8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Lin Huo , Jianlin Mao , Hongjun San , Ruiqi Li , Shufan Zhang
{"title":"面向多机器人寻路的群体意识深度强化学习","authors":"Lin Huo ,&nbsp;Jianlin Mao ,&nbsp;Hongjun San ,&nbsp;Ruiqi Li ,&nbsp;Shufan Zhang","doi":"10.1016/j.engappai.2025.110978","DOIUrl":null,"url":null,"abstract":"<div><div>Deep Reinforcement Learning (DRL) is highly effective in tackling complex environments through individual decision-making. It offers a novel and powerful approach to multi-robot pathfinding (MRPF). Building on DRL principles, this paper proposes a two-layer collaborative planning framework based on group consciousness (MACCRPF). The framework addresses the unique challenges of MRPF, where robots must not only independently complete their tasks but also coordinate to avoid conflicts during execution. Specifically, the proposed two-layer group consciousness mechanism encompasses: Basic layer group consensus, which emphasizes real-time information sharing and local task scheduling among robots. This layer ensures individual decisions are optimized through dynamic interaction and coordination. Top-layer group consensus, guided by the basic layer consensus, incorporates group strategies and evaluation mechanisms to adaptively adjust pathfinding in complex environments. Additionally, a hierarchical reward mechanism is designed to balance the demands of the two-layer planning framework. This mechanism significantly enhances inter-robot coordination efficiency and task completion rates. Experimental results demonstrate the efficacy of our approach, achieving over 20% improvement in pathfinding success rates compared to state-of-the-art methods. Furthermore, the framework exhibits strong transferability and generalization, maintaining high efficiency across diverse environments. This method provides a technical pathway for efficient collaboration in multi-robot systems.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"155 ","pages":"Article 110978"},"PeriodicalIF":8.0000,"publicationDate":"2025-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Reinforcement Learning of group consciousness for multi-robot pathfinding\",\"authors\":\"Lin Huo ,&nbsp;Jianlin Mao ,&nbsp;Hongjun San ,&nbsp;Ruiqi Li ,&nbsp;Shufan Zhang\",\"doi\":\"10.1016/j.engappai.2025.110978\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Deep Reinforcement Learning (DRL) is highly effective in tackling complex environments through individual decision-making. It offers a novel and powerful approach to multi-robot pathfinding (MRPF). Building on DRL principles, this paper proposes a two-layer collaborative planning framework based on group consciousness (MACCRPF). The framework addresses the unique challenges of MRPF, where robots must not only independently complete their tasks but also coordinate to avoid conflicts during execution. Specifically, the proposed two-layer group consciousness mechanism encompasses: Basic layer group consensus, which emphasizes real-time information sharing and local task scheduling among robots. This layer ensures individual decisions are optimized through dynamic interaction and coordination. Top-layer group consensus, guided by the basic layer consensus, incorporates group strategies and evaluation mechanisms to adaptively adjust pathfinding in complex environments. Additionally, a hierarchical reward mechanism is designed to balance the demands of the two-layer planning framework. This mechanism significantly enhances inter-robot coordination efficiency and task completion rates. Experimental results demonstrate the efficacy of our approach, achieving over 20% improvement in pathfinding success rates compared to state-of-the-art methods. Furthermore, the framework exhibits strong transferability and generalization, maintaining high efficiency across diverse environments. This method provides a technical pathway for efficient collaboration in multi-robot systems.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"155 \",\"pages\":\"Article 110978\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2025-05-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197625009789\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625009789","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

深度强化学习(DRL)通过个体决策在处理复杂环境方面非常有效。它为多机器人寻路(MRPF)提供了一种新颖而强大的方法。基于DRL原理,提出了一种基于群体意识的两层协同规划框架(MACCRPF)。该框架解决了MRPF的独特挑战,其中机器人不仅必须独立完成任务,还必须协调以避免执行过程中的冲突。具体而言,提出的两层群体意识机制包括:基础层群体共识,强调机器人之间的实时信息共享和局部任务调度;这一层确保通过动态交互和协调优化个人决策。顶层群体共识以底层共识为指导,结合群体策略和评价机制,对复杂环境下的寻路行为进行自适应调整。此外,设计了分层奖励机制来平衡两层规划框架的需求。该机制显著提高了机器人间的协调效率和任务完成率。实验结果证明了我们的方法的有效性,与最先进的方法相比,寻路成功率提高了20%以上。此外,该框架具有很强的可移植性和泛化性,在不同的环境中保持了较高的效率。该方法为多机器人系统的高效协作提供了技术途径。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Deep Reinforcement Learning of group consciousness for multi-robot pathfinding

Deep Reinforcement Learning of group consciousness for multi-robot pathfinding
Deep Reinforcement Learning (DRL) is highly effective in tackling complex environments through individual decision-making. It offers a novel and powerful approach to multi-robot pathfinding (MRPF). Building on DRL principles, this paper proposes a two-layer collaborative planning framework based on group consciousness (MACCRPF). The framework addresses the unique challenges of MRPF, where robots must not only independently complete their tasks but also coordinate to avoid conflicts during execution. Specifically, the proposed two-layer group consciousness mechanism encompasses: Basic layer group consensus, which emphasizes real-time information sharing and local task scheduling among robots. This layer ensures individual decisions are optimized through dynamic interaction and coordination. Top-layer group consensus, guided by the basic layer consensus, incorporates group strategies and evaluation mechanisms to adaptively adjust pathfinding in complex environments. Additionally, a hierarchical reward mechanism is designed to balance the demands of the two-layer planning framework. This mechanism significantly enhances inter-robot coordination efficiency and task completion rates. Experimental results demonstrate the efficacy of our approach, achieving over 20% improvement in pathfinding success rates compared to state-of-the-art methods. Furthermore, the framework exhibits strong transferability and generalization, maintaining high efficiency across diverse environments. This method provides a technical pathway for efficient collaboration in multi-robot systems.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Engineering Applications of Artificial Intelligence
Engineering Applications of Artificial Intelligence 工程技术-工程:电子与电气
CiteScore
9.60
自引率
10.00%
发文量
505
审稿时长
68 days
期刊介绍: Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信