基于视觉引导的消防机器人灭火决策:一种新颖的注意力和尺度U-Net模型及遗传算法

IF 4.2 2区 计算机科学 Q2 ROBOTICS
Juxian Zhao, Wei Li, Jinsong Zhu, Zhigang Gao, Lu Pan, Zhongguan Liu
{"title":"基于视觉引导的消防机器人灭火决策:一种新颖的注意力和尺度U-Net模型及遗传算法","authors":"Juxian Zhao,&nbsp;Wei Li,&nbsp;Jinsong Zhu,&nbsp;Zhigang Gao,&nbsp;Lu Pan,&nbsp;Zhongguan Liu","doi":"10.1002/rob.22438","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>At present, rescue firefighting relies mainly on firefighting robots, and robots with perception and decision-making functions are the key elements for achieving intelligent firefighting. However, traditional firefighting robots often lack the ability for autonomous perception and decision-making when extinguishing multiple fire sources, leading to low rescue efficiency and increased risk for rescue personnel, especially when making firefighting decisions in extreme fire scenes, which poses a challenge. To effectively handle firefighting tasks and ensure operational efficiency, a robot firefighting decision-making method based on drone visual guidance is proposed. First, we introduce a novel Attention and Scale U-Net (ASUNet) model to accurately capture crucial target information, including fire location and size, in a fire scene. The ASUNet model adopts an effective multiscale fusion strategy and attention mechanism to enhance the model's performance. Subsequently, based on the results of the ASUNet model, through pixel segmentation clustering and a genetic optimization algorithm, we obtain the robot's firefighting decision results, thereby guiding the robot to carry out firefighting operations systematically. Finally, through numerical experiments, it is verified that the proposed ASUNet model is superior and effective, as the model can perceive important information in a fire scene and extract it well. The use of improved genetic optimization can further accelerate algorithm convergence. To our knowledge, this study is the first to use drone-based monocular vision guidance for firefighting decision-making, providing significant engineering value.</p>\n </div>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"42 4","pages":"1103-1124"},"PeriodicalIF":4.2000,"publicationDate":"2024-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Firefighting Robot Extinguishment Decision-Making Based on Visual Guidance: A Novel Attention and Scale U-Net Model and Genetic Algorithm\",\"authors\":\"Juxian Zhao,&nbsp;Wei Li,&nbsp;Jinsong Zhu,&nbsp;Zhigang Gao,&nbsp;Lu Pan,&nbsp;Zhongguan Liu\",\"doi\":\"10.1002/rob.22438\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>At present, rescue firefighting relies mainly on firefighting robots, and robots with perception and decision-making functions are the key elements for achieving intelligent firefighting. However, traditional firefighting robots often lack the ability for autonomous perception and decision-making when extinguishing multiple fire sources, leading to low rescue efficiency and increased risk for rescue personnel, especially when making firefighting decisions in extreme fire scenes, which poses a challenge. To effectively handle firefighting tasks and ensure operational efficiency, a robot firefighting decision-making method based on drone visual guidance is proposed. First, we introduce a novel Attention and Scale U-Net (ASUNet) model to accurately capture crucial target information, including fire location and size, in a fire scene. The ASUNet model adopts an effective multiscale fusion strategy and attention mechanism to enhance the model's performance. Subsequently, based on the results of the ASUNet model, through pixel segmentation clustering and a genetic optimization algorithm, we obtain the robot's firefighting decision results, thereby guiding the robot to carry out firefighting operations systematically. Finally, through numerical experiments, it is verified that the proposed ASUNet model is superior and effective, as the model can perceive important information in a fire scene and extract it well. The use of improved genetic optimization can further accelerate algorithm convergence. To our knowledge, this study is the first to use drone-based monocular vision guidance for firefighting decision-making, providing significant engineering value.</p>\\n </div>\",\"PeriodicalId\":192,\"journal\":{\"name\":\"Journal of Field Robotics\",\"volume\":\"42 4\",\"pages\":\"1103-1124\"},\"PeriodicalIF\":4.2000,\"publicationDate\":\"2024-09-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Field Robotics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/rob.22438\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ROBOTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Field Robotics","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/rob.22438","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

摘要

目前,救援消防主要依靠消防机器人,具有感知和决策功能的机器人是实现智能消防的关键要素。然而,传统的消防机器人在灭火多火源时往往缺乏自主感知和决策能力,导致救援效率低,增加了救援人员的风险,特别是在极端火灾场景下进行消防决策时,这给消防机器人带来了挑战。为了有效处理消防任务,保证作业效率,提出了一种基于无人机视觉引导的机器人消防决策方法。首先,我们引入了一种新颖的注意力和尺度U-Net (ASUNet)模型,以准确捕获火灾场景中的关键目标信息,包括火灾的位置和大小。ASUNet模型采用了有效的多尺度融合策略和注意机制,提高了模型的性能。随后,基于ASUNet模型的结果,通过像素分割聚类和遗传优化算法,得到机器人的灭火决策结果,从而指导机器人系统地进行灭火作业。最后,通过数值实验验证了所提出的ASUNet模型的优越性和有效性,该模型能够很好地感知火灾场景中的重要信息并进行提取。使用改进的遗传优化可以进一步加快算法的收敛速度。据我们所知,本研究首次将基于无人机的单目视觉引导用于消防决策,具有重要的工程价值。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Firefighting Robot Extinguishment Decision-Making Based on Visual Guidance: A Novel Attention and Scale U-Net Model and Genetic Algorithm

At present, rescue firefighting relies mainly on firefighting robots, and robots with perception and decision-making functions are the key elements for achieving intelligent firefighting. However, traditional firefighting robots often lack the ability for autonomous perception and decision-making when extinguishing multiple fire sources, leading to low rescue efficiency and increased risk for rescue personnel, especially when making firefighting decisions in extreme fire scenes, which poses a challenge. To effectively handle firefighting tasks and ensure operational efficiency, a robot firefighting decision-making method based on drone visual guidance is proposed. First, we introduce a novel Attention and Scale U-Net (ASUNet) model to accurately capture crucial target information, including fire location and size, in a fire scene. The ASUNet model adopts an effective multiscale fusion strategy and attention mechanism to enhance the model's performance. Subsequently, based on the results of the ASUNet model, through pixel segmentation clustering and a genetic optimization algorithm, we obtain the robot's firefighting decision results, thereby guiding the robot to carry out firefighting operations systematically. Finally, through numerical experiments, it is verified that the proposed ASUNet model is superior and effective, as the model can perceive important information in a fire scene and extract it well. The use of improved genetic optimization can further accelerate algorithm convergence. To our knowledge, this study is the first to use drone-based monocular vision guidance for firefighting decision-making, providing significant engineering value.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Field Robotics
Journal of Field Robotics 工程技术-机器人学
CiteScore
15.00
自引率
3.60%
发文量
80
审稿时长
6 months
期刊介绍: The Journal of Field Robotics seeks to promote scholarly publications dealing with the fundamentals of robotics in unstructured and dynamic environments. The Journal focuses on experimental robotics and encourages publication of work that has both theoretical and practical significance.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信