Deep reinforcement learning for optimal firebreak placement in forest fire prevention

IF 7.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Lucas Murray , Tatiana Castillo , Isaac Martín de Diego , Richard Weber , José Ramón González-Olabarria , Jordi García-Gonzalo , Andrés Weintraub , Jaime Carrasco-Barra
{"title":"Deep reinforcement learning for optimal firebreak placement in forest fire prevention","authors":"Lucas Murray ,&nbsp;Tatiana Castillo ,&nbsp;Isaac Martín de Diego ,&nbsp;Richard Weber ,&nbsp;José Ramón González-Olabarria ,&nbsp;Jordi García-Gonzalo ,&nbsp;Andrés Weintraub ,&nbsp;Jaime Carrasco-Barra","doi":"10.1016/j.asoc.2025.113043","DOIUrl":null,"url":null,"abstract":"<div><div>The increasing frequency and intensity of large wildfires have become a significant natural hazard, requiring the development of advanced decision-support tools for resilient landscape design. Existing methods, such as Mixed Integer Programming and Stochastic Optimization, while effective, are computationally demanding. In this study, we introduce a novel Deep Reinforcement Learning (DRL) methodology to optimize the strategic placement of firebreaks across diverse landscapes. We employ Deep Q-Learning, Double Deep Q-Learning, and Dueling Double Deep Q-Learning, integrated with the Cell2Fire fire spread simulator and Convolutional Neural Networks. Our DRL agent successfully learns optimal firebreak locations, demonstrating superior performance compared to heuristics, especially after incorporating a pre-training loop. This improvement ranges between 1.59%–1.7% with respect to the heuristic, depending on the size of the instance, and 4.79%–6.81% when compared to a random solution. Our results highlight the potential of DRL for fire prevention, showing convergence with favorable results in cases as large as 40 × 40 cells. This study represents a pioneering application of reinforcement learning to fire prevention and landscape management.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"175 ","pages":"Article 113043"},"PeriodicalIF":7.2000,"publicationDate":"2025-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Soft Computing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1568494625003540","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

The increasing frequency and intensity of large wildfires have become a significant natural hazard, requiring the development of advanced decision-support tools for resilient landscape design. Existing methods, such as Mixed Integer Programming and Stochastic Optimization, while effective, are computationally demanding. In this study, we introduce a novel Deep Reinforcement Learning (DRL) methodology to optimize the strategic placement of firebreaks across diverse landscapes. We employ Deep Q-Learning, Double Deep Q-Learning, and Dueling Double Deep Q-Learning, integrated with the Cell2Fire fire spread simulator and Convolutional Neural Networks. Our DRL agent successfully learns optimal firebreak locations, demonstrating superior performance compared to heuristics, especially after incorporating a pre-training loop. This improvement ranges between 1.59%–1.7% with respect to the heuristic, depending on the size of the instance, and 4.79%–6.81% when compared to a random solution. Our results highlight the potential of DRL for fire prevention, showing convergence with favorable results in cases as large as 40 × 40 cells. This study represents a pioneering application of reinforcement learning to fire prevention and landscape management.
基于深度强化学习的森林防火防火墙布局优化
大型野火发生的频率和强度不断增加,已经成为一种重大的自然灾害,需要开发先进的决策支持工具来进行弹性景观设计。现有的方法,如混合整数规划和随机优化,虽然有效,但计算量很大。在本研究中,我们引入了一种新颖的深度强化学习(DRL)方法来优化不同景观中防火墙的战略布局。我们采用深度q -学习、双深度q -学习和Dueling双深度q -学习,并集成了Cell2Fire火灾蔓延模拟器和卷积神经网络。我们的DRL代理成功地学习了最佳防火线位置,与启发式算法相比,表现出了卓越的性能,特别是在结合了预训练循环之后。根据实例的大小,启发式的改进幅度在1.59%-1.7%之间,与随机解决方案相比,改进幅度在4.79%-6.81%之间。我们的研究结果强调了DRL在防火方面的潜力,在40 × 40单元格的情况下显示出良好的收敛效果。这项研究代表了强化学习在防火和景观管理方面的开创性应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Applied Soft Computing
Applied Soft Computing 工程技术-计算机:跨学科应用
CiteScore
15.80
自引率
6.90%
发文量
874
审稿时长
10.9 months
期刊介绍: Applied Soft Computing is an international journal promoting an integrated view of soft computing to solve real life problems.The focus is to publish the highest quality research in application and convergence of the areas of Fuzzy Logic, Neural Networks, Evolutionary Computing, Rough Sets and other similar techniques to address real world complexities. Applied Soft Computing is a rolling publication: articles are published as soon as the editor-in-chief has accepted them. Therefore, the web site will continuously be updated with new articles and the publication time will be short.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信