面向可靠的灾后损害评估的深度学习:基于xai的评估

IF 4.5 1区 地球科学 Q1 GEOSCIENCES, MULTIDISCIPLINARY
Umut Lagap, Saman Ghaffarian, Sophie Gelinas-Gagne, Jasmin Jilma, Zhiyu Liu, Zhiyuan Luo
{"title":"面向可靠的灾后损害评估的深度学习:基于xai的评估","authors":"Umut Lagap,&nbsp;Saman Ghaffarian,&nbsp;Sophie Gelinas-Gagne,&nbsp;Jasmin Jilma,&nbsp;Zhiyu Liu,&nbsp;Zhiyuan Luo","doi":"10.1016/j.ijdrr.2025.105839","DOIUrl":null,"url":null,"abstract":"<div><div>The increasing frequency and severity of natural hazard-induced disasters necessitate rapid and reliable post-disaster damage detection (PDD) to inform disaster response and recovery. Deep learning (DL) models, when paired with remote sensing (RS) data, have shown potential in this domain, but challenges persist due to limited interpretability and inconsistent reliability, particularly for high-severity damage classes. This study investigates the use of attention mechanisms—Channel Attention (CA), Spatial Attention (SA), and Multihead Attention (MA)—to enhance the accuracy and interpretability of state-of-the-art DL models. Utilizing the xBD dataset, we evaluated eight DL architectures and their attention-augmented configurations, in total 32 model, using explainable AI (XAI) models, i.e., Grad-CAM and Saliency Maps to visualize decision-making processes. Results indicate that models enhanced with MA achieve the highest reliability, with MA_ShallowNetV2 and MA_InceptionV3 achieving accuracies of 81.9 % and 80.0 %, respectively. Grad-CAM analysis demonstrated precise localization of damaged areas, while Saliency Maps revealed well-concentrated pixel-level focus. Specifically, MA generally improved interpretability abd reliability in our evaluation, particularly for identifying high-severity damage levels in post-disaster scenarios. In contrast, models with CA or certain SA configurations struggled with misplaced or diffused attention. These findings underscore the importance of incorporating explainable and interpretable AI approaches in disaster risk management.</div></div>","PeriodicalId":13915,"journal":{"name":"International journal of disaster risk reduction","volume":"130 ","pages":"Article 105839"},"PeriodicalIF":4.5000,"publicationDate":"2025-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Towards reliable deep learning for post-disaster damage Assessment: An XAI-based evaluation\",\"authors\":\"Umut Lagap,&nbsp;Saman Ghaffarian,&nbsp;Sophie Gelinas-Gagne,&nbsp;Jasmin Jilma,&nbsp;Zhiyu Liu,&nbsp;Zhiyuan Luo\",\"doi\":\"10.1016/j.ijdrr.2025.105839\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The increasing frequency and severity of natural hazard-induced disasters necessitate rapid and reliable post-disaster damage detection (PDD) to inform disaster response and recovery. Deep learning (DL) models, when paired with remote sensing (RS) data, have shown potential in this domain, but challenges persist due to limited interpretability and inconsistent reliability, particularly for high-severity damage classes. This study investigates the use of attention mechanisms—Channel Attention (CA), Spatial Attention (SA), and Multihead Attention (MA)—to enhance the accuracy and interpretability of state-of-the-art DL models. Utilizing the xBD dataset, we evaluated eight DL architectures and their attention-augmented configurations, in total 32 model, using explainable AI (XAI) models, i.e., Grad-CAM and Saliency Maps to visualize decision-making processes. Results indicate that models enhanced with MA achieve the highest reliability, with MA_ShallowNetV2 and MA_InceptionV3 achieving accuracies of 81.9 % and 80.0 %, respectively. Grad-CAM analysis demonstrated precise localization of damaged areas, while Saliency Maps revealed well-concentrated pixel-level focus. Specifically, MA generally improved interpretability abd reliability in our evaluation, particularly for identifying high-severity damage levels in post-disaster scenarios. In contrast, models with CA or certain SA configurations struggled with misplaced or diffused attention. These findings underscore the importance of incorporating explainable and interpretable AI approaches in disaster risk management.</div></div>\",\"PeriodicalId\":13915,\"journal\":{\"name\":\"International journal of disaster risk reduction\",\"volume\":\"130 \",\"pages\":\"Article 105839\"},\"PeriodicalIF\":4.5000,\"publicationDate\":\"2025-09-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of disaster risk reduction\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2212420925006636\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOSCIENCES, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of disaster risk reduction","FirstCategoryId":"89","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2212420925006636","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOSCIENCES, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

随着自然灾害发生的频率和严重程度不断增加,需要快速可靠的灾后损害检测(PDD),以便为灾害响应和恢复提供信息。深度学习(DL)模型,当与遥感(RS)数据配对时,在这一领域显示出潜力,但由于有限的可解释性和不一致的可靠性,特别是对于严重的损伤类别,挑战仍然存在。本研究探讨了注意机制——通道注意(CA)、空间注意(SA)和多头注意(MA)的使用,以提高最先进的深度学习模型的准确性和可解释性。利用xBD数据集,我们评估了8个深度学习架构及其注意力增强配置,总共32个模型,使用可解释的AI (XAI)模型,即Grad-CAM和Saliency Maps来可视化决策过程。结果表明,经MA增强的模型可靠性最高,其中MA_ShallowNetV2和MA_InceptionV3的准确率分别达到81.9%和80.0%。Grad-CAM分析显示了受损区域的精确定位,而Saliency Maps显示了高度集中的像素级焦点。具体来说,MA总体上提高了我们评估的可解释性和可靠性,特别是在灾后情景中识别高严重程度的损害水平方面。相比之下,具有CA或某些SA配置的模型与错位或分散的注意力作斗争。这些发现强调了将可解释和可解释的人工智能方法纳入灾害风险管理的重要性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Towards reliable deep learning for post-disaster damage Assessment: An XAI-based evaluation
The increasing frequency and severity of natural hazard-induced disasters necessitate rapid and reliable post-disaster damage detection (PDD) to inform disaster response and recovery. Deep learning (DL) models, when paired with remote sensing (RS) data, have shown potential in this domain, but challenges persist due to limited interpretability and inconsistent reliability, particularly for high-severity damage classes. This study investigates the use of attention mechanisms—Channel Attention (CA), Spatial Attention (SA), and Multihead Attention (MA)—to enhance the accuracy and interpretability of state-of-the-art DL models. Utilizing the xBD dataset, we evaluated eight DL architectures and their attention-augmented configurations, in total 32 model, using explainable AI (XAI) models, i.e., Grad-CAM and Saliency Maps to visualize decision-making processes. Results indicate that models enhanced with MA achieve the highest reliability, with MA_ShallowNetV2 and MA_InceptionV3 achieving accuracies of 81.9 % and 80.0 %, respectively. Grad-CAM analysis demonstrated precise localization of damaged areas, while Saliency Maps revealed well-concentrated pixel-level focus. Specifically, MA generally improved interpretability abd reliability in our evaluation, particularly for identifying high-severity damage levels in post-disaster scenarios. In contrast, models with CA or certain SA configurations struggled with misplaced or diffused attention. These findings underscore the importance of incorporating explainable and interpretable AI approaches in disaster risk management.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
International journal of disaster risk reduction
International journal of disaster risk reduction GEOSCIENCES, MULTIDISCIPLINARYMETEOROLOGY-METEOROLOGY & ATMOSPHERIC SCIENCES
CiteScore
8.70
自引率
18.00%
发文量
688
审稿时长
79 days
期刊介绍: The International Journal of Disaster Risk Reduction (IJDRR) is the journal for researchers, policymakers and practitioners across diverse disciplines: earth sciences and their implications; environmental sciences; engineering; urban studies; geography; and the social sciences. IJDRR publishes fundamental and applied research, critical reviews, policy papers and case studies with a particular focus on multi-disciplinary research that aims to reduce the impact of natural, technological, social and intentional disasters. IJDRR stimulates exchange of ideas and knowledge transfer on disaster research, mitigation, adaptation, prevention and risk reduction at all geographical scales: local, national and international. Key topics:- -multifaceted disaster and cascading disasters -the development of disaster risk reduction strategies and techniques -discussion and development of effective warning and educational systems for risk management at all levels -disasters associated with climate change -vulnerability analysis and vulnerability trends -emerging risks -resilience against disasters. The journal particularly encourages papers that approach risk from a multi-disciplinary perspective.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信