Victor Hertel , Omar Wani , Christian Geiß , Marc Wieland , Hannes Taubenböck
{"title":"基于不确定性感知的灾后建筑损伤评估多任务学习","authors":"Victor Hertel , Omar Wani , Christian Geiß , Marc Wieland , Hannes Taubenböck","doi":"10.1016/j.jag.2025.104759","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate and timely building damage assessment (BDA) is critical for effective disaster response and recovery. However, existing machine learning approaches in this context do mostly not account for uncertainties, which are essential for ensuring trustworthy and transparent results. This study introduces a hybrid Bayesian deep learning framework with integrated uncertainty quantification to enhance BDA, thereby making model predictions more reliable and interpretable. We propose BayeSiamMTL, a novel Bayesian Siamese multitask learning architecture that combines deterministic segmentation of building footprints with probabilistic change detection for damage level classification. By encoding model parameters as probability distributions and utilizing variational inference with Monte Carlo approximation, BayeSiamMTL produces pixelwise posterior predictive distributions, providing detailed insights into both damage predictions and their associated uncertainties. Our analysis explores key aspects of Bayesian modeling and, to our knowledge, is the first to provide quantified insights into the model’s classification dynamics, revealing internal decision-making tendencies and sources of uncertainty. Additionally, we introduce confidence-informed damage maps in the form of stratified probabilities of damage clusters and minimum/maximum damage extents delineated from confidence intervals. Model performance is evaluated across multiple datasets to assess the impact of domain shifts and out-of-distribution samples. Experimental results show that BayeSiamMTL not only achieves a performance advantage over its deterministic counterpart but also exhibits significantly better generalization capabilities under domain shifts with a relative performance improvement of 42 %. While background pixels represent the primary source of confusion across all damage levels, our findings indicate that building destructions are more frequently confused with intact buildings rather than among varying degrees of damage.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"143 ","pages":"Article 104759"},"PeriodicalIF":8.6000,"publicationDate":"2025-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"BayeSiamMTL: Uncertainty-aware multitask learning for post-disaster building damage assessment\",\"authors\":\"Victor Hertel , Omar Wani , Christian Geiß , Marc Wieland , Hannes Taubenböck\",\"doi\":\"10.1016/j.jag.2025.104759\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Accurate and timely building damage assessment (BDA) is critical for effective disaster response and recovery. However, existing machine learning approaches in this context do mostly not account for uncertainties, which are essential for ensuring trustworthy and transparent results. This study introduces a hybrid Bayesian deep learning framework with integrated uncertainty quantification to enhance BDA, thereby making model predictions more reliable and interpretable. We propose BayeSiamMTL, a novel Bayesian Siamese multitask learning architecture that combines deterministic segmentation of building footprints with probabilistic change detection for damage level classification. By encoding model parameters as probability distributions and utilizing variational inference with Monte Carlo approximation, BayeSiamMTL produces pixelwise posterior predictive distributions, providing detailed insights into both damage predictions and their associated uncertainties. Our analysis explores key aspects of Bayesian modeling and, to our knowledge, is the first to provide quantified insights into the model’s classification dynamics, revealing internal decision-making tendencies and sources of uncertainty. Additionally, we introduce confidence-informed damage maps in the form of stratified probabilities of damage clusters and minimum/maximum damage extents delineated from confidence intervals. Model performance is evaluated across multiple datasets to assess the impact of domain shifts and out-of-distribution samples. Experimental results show that BayeSiamMTL not only achieves a performance advantage over its deterministic counterpart but also exhibits significantly better generalization capabilities under domain shifts with a relative performance improvement of 42 %. While background pixels represent the primary source of confusion across all damage levels, our findings indicate that building destructions are more frequently confused with intact buildings rather than among varying degrees of damage.</div></div>\",\"PeriodicalId\":73423,\"journal\":{\"name\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"volume\":\"143 \",\"pages\":\"Article 104759\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2025-08-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569843225004066\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843225004066","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
BayeSiamMTL: Uncertainty-aware multitask learning for post-disaster building damage assessment
Accurate and timely building damage assessment (BDA) is critical for effective disaster response and recovery. However, existing machine learning approaches in this context do mostly not account for uncertainties, which are essential for ensuring trustworthy and transparent results. This study introduces a hybrid Bayesian deep learning framework with integrated uncertainty quantification to enhance BDA, thereby making model predictions more reliable and interpretable. We propose BayeSiamMTL, a novel Bayesian Siamese multitask learning architecture that combines deterministic segmentation of building footprints with probabilistic change detection for damage level classification. By encoding model parameters as probability distributions and utilizing variational inference with Monte Carlo approximation, BayeSiamMTL produces pixelwise posterior predictive distributions, providing detailed insights into both damage predictions and their associated uncertainties. Our analysis explores key aspects of Bayesian modeling and, to our knowledge, is the first to provide quantified insights into the model’s classification dynamics, revealing internal decision-making tendencies and sources of uncertainty. Additionally, we introduce confidence-informed damage maps in the form of stratified probabilities of damage clusters and minimum/maximum damage extents delineated from confidence intervals. Model performance is evaluated across multiple datasets to assess the impact of domain shifts and out-of-distribution samples. Experimental results show that BayeSiamMTL not only achieves a performance advantage over its deterministic counterpart but also exhibits significantly better generalization capabilities under domain shifts with a relative performance improvement of 42 %. While background pixels represent the primary source of confusion across all damage levels, our findings indicate that building destructions are more frequently confused with intact buildings rather than among varying degrees of damage.
期刊介绍:
The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.