Enhanced Landslide Detection Using a Swin Transformer With Multiscale Feature Fusion and Local Information Aggregation Modules

Saied Pirasteh;Muhammad Yasir;Hong Fan;Fernando J. Aguilar;Md Sakaouth Hossain;Huxiong Li
{"title":"Enhanced Landslide Detection Using a Swin Transformer With Multiscale Feature Fusion and Local Information Aggregation Modules","authors":"Saied Pirasteh;Muhammad Yasir;Hong Fan;Fernando J. Aguilar;Md Sakaouth Hossain;Huxiong Li","doi":"10.1109/LGRS.2025.3560990","DOIUrl":null,"url":null,"abstract":"In recent years, detecting and monitoring landslides have become increasingly critical for disaster management and mitigation efforts. Here, we propose a model for landslide detection utilizing a combination of the Swin Transformer architecture with multiscale feature fusion lateral connection and local information aggregation modules (LIAMs). The Swin Transformer, known for its effectiveness in image understanding tasks, serves as the backbone of our detection system. By leveraging its hierarchical self-attention mechanism, the Swin Transformer can effectively capture both local and global contextual information from input images, facilitating accurate feature representation. To increase the performance of the Swin Transformer specifically for landslide detection, we introduce two additional modules: the multiscale feature fusion lateral connection module (MFFLCM) and the LIAM. The former module enables the integration of features across multiple scales, allowing the model to capture both fine-grained details and broader contextual information relevant to landslide characteristics. Meanwhile, the latter module focuses on aggregating local information within regions of interest, further refining the model’s ability to discriminate between landslide and non-landslide areas. Through extensive test and evaluation of benchmark datasets, our proposed method demonstrates promising results in detecting landslides with high mIoU, <inline-formula> <tex-math>$F1$ </tex-math></inline-formula> score, kappa, precision, and recall 84.2%, 90.7%, 82.6%, 89.9%, and 91.9%, respectively. Moreover, its robustness to variations in terrain and environmental conditions suggests its potential for real-world applications in landslide monitoring and early warning systems. Overall, our study highlights the effectiveness of integrating advanced transformer architectures with tailored modules for addressing complex geospatial challenges like landslide detection.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"22 ","pages":"1-5"},"PeriodicalIF":0.0000,"publicationDate":"2025-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10973097/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In recent years, detecting and monitoring landslides have become increasingly critical for disaster management and mitigation efforts. Here, we propose a model for landslide detection utilizing a combination of the Swin Transformer architecture with multiscale feature fusion lateral connection and local information aggregation modules (LIAMs). The Swin Transformer, known for its effectiveness in image understanding tasks, serves as the backbone of our detection system. By leveraging its hierarchical self-attention mechanism, the Swin Transformer can effectively capture both local and global contextual information from input images, facilitating accurate feature representation. To increase the performance of the Swin Transformer specifically for landslide detection, we introduce two additional modules: the multiscale feature fusion lateral connection module (MFFLCM) and the LIAM. The former module enables the integration of features across multiple scales, allowing the model to capture both fine-grained details and broader contextual information relevant to landslide characteristics. Meanwhile, the latter module focuses on aggregating local information within regions of interest, further refining the model’s ability to discriminate between landslide and non-landslide areas. Through extensive test and evaluation of benchmark datasets, our proposed method demonstrates promising results in detecting landslides with high mIoU, $F1$ score, kappa, precision, and recall 84.2%, 90.7%, 82.6%, 89.9%, and 91.9%, respectively. Moreover, its robustness to variations in terrain and environmental conditions suggests its potential for real-world applications in landslide monitoring and early warning systems. Overall, our study highlights the effectiveness of integrating advanced transformer architectures with tailored modules for addressing complex geospatial challenges like landslide detection.
基于多尺度特征融合和局部信息聚合模块的Swin变压器增强滑坡检测
近年来,探测和监测山体滑坡对灾害管理和减灾工作变得越来越重要。在这里,我们提出了一个利用Swin变压器结构与多尺度特征融合横向连接和局部信息聚合模块(LIAMs)相结合的滑坡检测模型。Swin Transformer以其在图像理解任务中的有效性而闻名,是我们检测系统的支柱。通过利用其分层自关注机制,Swin Transformer可以有效地从输入图像中捕获本地和全局上下文信息,从而促进准确的特征表示。为了提高Swin变压器的性能,我们引入了两个额外的模块:多尺度特征融合横向连接模块(MFFLCM)和LIAM。前一个模块可以集成多个尺度的特征,使模型能够捕获与滑坡特征相关的细粒度细节和更广泛的上下文信息。同时,后一个模块侧重于汇总感兴趣区域内的本地信息,进一步改进模型区分滑坡和非滑坡区域的能力。通过对基准数据集的广泛测试和评估,我们提出的方法在检测mIoU、$F1$分数、kappa、精度和召回率分别为84.2%、90.7%、82.6%、89.9%和91.9%的高滑坡方面显示出良好的效果。此外,它对地形和环境条件变化的稳健性表明它在滑坡监测和预警系统中的实际应用潜力。总的来说,我们的研究强调了将先进的变压器架构与定制模块集成在一起以解决复杂的地理空间挑战(如滑坡探测)的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信