基于不确定性感知的灾后建筑损伤评估多任务学习

IF 8.6 Q1 REMOTE SENSING
Victor Hertel , Omar Wani , Christian Geiß , Marc Wieland , Hannes Taubenböck
{"title":"基于不确定性感知的灾后建筑损伤评估多任务学习","authors":"Victor Hertel ,&nbsp;Omar Wani ,&nbsp;Christian Geiß ,&nbsp;Marc Wieland ,&nbsp;Hannes Taubenböck","doi":"10.1016/j.jag.2025.104759","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate and timely building damage assessment (BDA) is critical for effective disaster response and recovery. However, existing machine learning approaches in this context do mostly not account for uncertainties, which are essential for ensuring trustworthy and transparent results. This study introduces a hybrid Bayesian deep learning framework with integrated uncertainty quantification to enhance BDA, thereby making model predictions more reliable and interpretable. We propose BayeSiamMTL, a novel Bayesian Siamese multitask learning architecture that combines deterministic segmentation of building footprints with probabilistic change detection for damage level classification. By encoding model parameters as probability distributions and utilizing variational inference with Monte Carlo approximation, BayeSiamMTL produces pixelwise posterior predictive distributions, providing detailed insights into both damage predictions and their associated uncertainties. Our analysis explores key aspects of Bayesian modeling and, to our knowledge, is the first to provide quantified insights into the model’s classification dynamics, revealing internal decision-making tendencies and sources of uncertainty. Additionally, we introduce confidence-informed damage maps in the form of stratified probabilities of damage clusters and minimum/maximum damage extents delineated from confidence intervals. Model performance is evaluated across multiple datasets to assess the impact of domain shifts and out-of-distribution samples. Experimental results show that BayeSiamMTL not only achieves a performance advantage over its deterministic counterpart but also exhibits significantly better generalization capabilities under domain shifts with a relative performance improvement of 42 %. While background pixels represent the primary source of confusion across all damage levels, our findings indicate that building destructions are more frequently confused with intact buildings rather than among varying degrees of damage.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"143 ","pages":"Article 104759"},"PeriodicalIF":8.6000,"publicationDate":"2025-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"BayeSiamMTL: Uncertainty-aware multitask learning for post-disaster building damage assessment\",\"authors\":\"Victor Hertel ,&nbsp;Omar Wani ,&nbsp;Christian Geiß ,&nbsp;Marc Wieland ,&nbsp;Hannes Taubenböck\",\"doi\":\"10.1016/j.jag.2025.104759\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Accurate and timely building damage assessment (BDA) is critical for effective disaster response and recovery. However, existing machine learning approaches in this context do mostly not account for uncertainties, which are essential for ensuring trustworthy and transparent results. This study introduces a hybrid Bayesian deep learning framework with integrated uncertainty quantification to enhance BDA, thereby making model predictions more reliable and interpretable. We propose BayeSiamMTL, a novel Bayesian Siamese multitask learning architecture that combines deterministic segmentation of building footprints with probabilistic change detection for damage level classification. By encoding model parameters as probability distributions and utilizing variational inference with Monte Carlo approximation, BayeSiamMTL produces pixelwise posterior predictive distributions, providing detailed insights into both damage predictions and their associated uncertainties. Our analysis explores key aspects of Bayesian modeling and, to our knowledge, is the first to provide quantified insights into the model’s classification dynamics, revealing internal decision-making tendencies and sources of uncertainty. Additionally, we introduce confidence-informed damage maps in the form of stratified probabilities of damage clusters and minimum/maximum damage extents delineated from confidence intervals. Model performance is evaluated across multiple datasets to assess the impact of domain shifts and out-of-distribution samples. Experimental results show that BayeSiamMTL not only achieves a performance advantage over its deterministic counterpart but also exhibits significantly better generalization capabilities under domain shifts with a relative performance improvement of 42 %. While background pixels represent the primary source of confusion across all damage levels, our findings indicate that building destructions are more frequently confused with intact buildings rather than among varying degrees of damage.</div></div>\",\"PeriodicalId\":73423,\"journal\":{\"name\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"volume\":\"143 \",\"pages\":\"Article 104759\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2025-08-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569843225004066\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843225004066","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
引用次数: 0

摘要

准确、及时的建筑损失评估对于有效的灾害响应和恢复至关重要。然而,在这种情况下,现有的机器学习方法大多没有考虑到不确定性,而不确定性对于确保可信和透明的结果至关重要。本研究引入了一种集成不确定性量化的混合贝叶斯深度学习框架来增强BDA,从而使模型预测更加可靠和可解释性。我们提出了BayeSiamMTL,这是一种新颖的贝叶斯暹罗多任务学习架构,它将建筑物足迹的确定性分割与用于损伤级别分类的概率变化检测相结合。通过将模型参数编码为概率分布,并利用蒙特卡罗近似的变分推理,BayeSiamMTL生成像素级后验预测分布,提供对损伤预测及其相关不确定性的详细了解。我们的分析探讨了贝叶斯建模的关键方面,据我们所知,这是第一次对模型的分类动态提供量化的见解,揭示了内部决策倾向和不确定性的来源。此外,我们引入了基于置信度的损伤图,其形式是损伤集群的分层概率和从置信度区间描绘的最小/最大损伤范围。跨多个数据集评估模型性能,以评估域移位和分布外样本的影响。实验结果表明,BayeSiamMTL不仅在性能上优于同类的确定性算法,而且在域移位情况下,BayeSiamMTL的泛化能力显著提高,相对性能提升42%。虽然背景像素代表了所有破坏级别混淆的主要来源,但我们的研究结果表明,建筑物破坏更经常与完整的建筑物混淆,而不是不同程度的破坏。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
BayeSiamMTL: Uncertainty-aware multitask learning for post-disaster building damage assessment
Accurate and timely building damage assessment (BDA) is critical for effective disaster response and recovery. However, existing machine learning approaches in this context do mostly not account for uncertainties, which are essential for ensuring trustworthy and transparent results. This study introduces a hybrid Bayesian deep learning framework with integrated uncertainty quantification to enhance BDA, thereby making model predictions more reliable and interpretable. We propose BayeSiamMTL, a novel Bayesian Siamese multitask learning architecture that combines deterministic segmentation of building footprints with probabilistic change detection for damage level classification. By encoding model parameters as probability distributions and utilizing variational inference with Monte Carlo approximation, BayeSiamMTL produces pixelwise posterior predictive distributions, providing detailed insights into both damage predictions and their associated uncertainties. Our analysis explores key aspects of Bayesian modeling and, to our knowledge, is the first to provide quantified insights into the model’s classification dynamics, revealing internal decision-making tendencies and sources of uncertainty. Additionally, we introduce confidence-informed damage maps in the form of stratified probabilities of damage clusters and minimum/maximum damage extents delineated from confidence intervals. Model performance is evaluated across multiple datasets to assess the impact of domain shifts and out-of-distribution samples. Experimental results show that BayeSiamMTL not only achieves a performance advantage over its deterministic counterpart but also exhibits significantly better generalization capabilities under domain shifts with a relative performance improvement of 42 %. While background pixels represent the primary source of confusion across all damage levels, our findings indicate that building destructions are more frequently confused with intact buildings rather than among varying degrees of damage.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
International journal of applied earth observation and geoinformation : ITC journal
International journal of applied earth observation and geoinformation : ITC journal Global and Planetary Change, Management, Monitoring, Policy and Law, Earth-Surface Processes, Computers in Earth Sciences
CiteScore
12.00
自引率
0.00%
发文量
0
审稿时长
77 days
期刊介绍: The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信