ViTConvKAN: a hybrid transformer–KAN modeling for post-earthquake building damage mapping using VHR imagery

IF 4.2 2区 工程技术 Q2 ENGINEERING, GEOLOGICAL
Seyed Ehsan Khankeshizadeh, Ali Mohammadzadeh, Sadegh Jamali
{"title":"ViTConvKAN: a hybrid transformer–KAN modeling for post-earthquake building damage mapping using VHR imagery","authors":"Seyed Ehsan Khankeshizadeh,&nbsp;Ali Mohammadzadeh,&nbsp;Sadegh Jamali","doi":"10.1007/s10518-026-02530-9","DOIUrl":null,"url":null,"abstract":"<div><p>Accurate mapping of earthquake-damaged buildings is essential for rapid post-disaster assessment and urban recovery planning. Very high-resolution (VHR) satellite imagery enables large-scale geospatial damage detection; however, conventional convolutional neural networks (CNNs) often struggle to model complex spatial dependencies and nonlinear damage patterns efficiently. To address these limitations, this study proposes ViTConvKAN, a hybrid architecture that combines vision transformers (ViTs) for long-range spatial modeling with convolutional Kolmogorov–Arnold networks (ConvKANs) for nonlinear feature representation. The framework includes data preprocessing, supervised training, building-level damage classification, and quantitative evaluation. The method is validated on post-event VHR datasets from Haiti-Port-au-Prince and Iran-Bam, including cross-region transfer experiments under zero-shot and few-shot fine-tuning settings. Across both regions, ViTConvKAN achieves an average OA of 88.09% and a KC of 73.07%, outperforming several established CNN-based baselines. The results indicate that integrating transformer-based contextual modeling with nonlinear ConvKAN feature extraction improves building-level damage discrimination while maintaining scalable deployment characteristics. This hybrid approach provides a robust framework for post-earthquake damage mapping using VHR imagery.</p></div>","PeriodicalId":9364,"journal":{"name":"Bulletin of Earthquake Engineering","volume":"24 9","pages":"7267 - 7307"},"PeriodicalIF":4.2000,"publicationDate":"2026-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Bulletin of Earthquake Engineering","FirstCategoryId":"5","ListUrlMain":"https://link.springer.com/article/10.1007/s10518-026-02530-9","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, GEOLOGICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Accurate mapping of earthquake-damaged buildings is essential for rapid post-disaster assessment and urban recovery planning. Very high-resolution (VHR) satellite imagery enables large-scale geospatial damage detection; however, conventional convolutional neural networks (CNNs) often struggle to model complex spatial dependencies and nonlinear damage patterns efficiently. To address these limitations, this study proposes ViTConvKAN, a hybrid architecture that combines vision transformers (ViTs) for long-range spatial modeling with convolutional Kolmogorov–Arnold networks (ConvKANs) for nonlinear feature representation. The framework includes data preprocessing, supervised training, building-level damage classification, and quantitative evaluation. The method is validated on post-event VHR datasets from Haiti-Port-au-Prince and Iran-Bam, including cross-region transfer experiments under zero-shot and few-shot fine-tuning settings. Across both regions, ViTConvKAN achieves an average OA of 88.09% and a KC of 73.07%, outperforming several established CNN-based baselines. The results indicate that integrating transformer-based contextual modeling with nonlinear ConvKAN feature extraction improves building-level damage discrimination while maintaining scalable deployment characteristics. This hybrid approach provides a robust framework for post-earthquake damage mapping using VHR imagery.

ViTConvKAN:一种混合变压器- kan模型,用于利用VHR图像绘制震后建筑损伤图
准确绘制地震受损建筑物的地图对于快速的灾后评估和城市恢复规划至关重要。极高分辨率(VHR)卫星图像可实现大规模地理空间损伤检测;然而,传统的卷积神经网络(cnn)往往难以有效地模拟复杂的空间依赖关系和非线性损伤模式。为了解决这些限制,本研究提出了ViTConvKAN,这是一种混合架构,结合了用于远程空间建模的视觉变压器(ViTs)和用于非线性特征表示的卷积Kolmogorov-Arnold网络(ConvKANs)。该框架包括数据预处理、监督训练、建筑级损伤分类和定量评估。在海地-太子港和伊朗-巴姆的事件后VHR数据集上进行了验证,包括零弹微调和少弹微调设置下的跨区域转移实验。在这两个地区,ViTConvKAN的平均OA为88.09%,KC为73.07%,优于几个基于cnn的既定基线。结果表明,将基于变压器的上下文建模与非线性ConvKAN特征提取相结合,在保持可扩展部署特征的同时,提高了建筑物级损伤识别能力。这种混合方法为利用VHR图像绘制震后震害图提供了一个强大的框架。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Bulletin of Earthquake Engineering
Bulletin of Earthquake Engineering 工程技术-地球科学综合
CiteScore
8.90
自引率
19.60%
发文量
263
审稿时长
7.5 months
期刊介绍: Bulletin of Earthquake Engineering presents original, peer-reviewed papers on research related to the broad spectrum of earthquake engineering. The journal offers a forum for presentation and discussion of such matters as European damaging earthquakes, new developments in earthquake regulations, and national policies applied after major seismic events, including strengthening of existing buildings. Coverage includes seismic hazard studies and methods for mitigation of risk; earthquake source mechanism and strong motion characterization and their use for engineering applications; geological and geotechnical site conditions under earthquake excitations; cyclic behavior of soils; analysis and design of earth structures and foundations under seismic conditions; zonation and microzonation methodologies; earthquake scenarios and vulnerability assessments; earthquake codes and improvements, and much more. This is the Official Publication of the European Association for Earthquake Engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书