基于网格的联合关注和多层次特征融合用于滑坡识别

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Xinran Li;Tao Chen;Gang Liu;Jie Dou;Ruiqing Niu;Antonio Plaza
{"title":"基于网格的联合关注和多层次特征融合用于滑坡识别","authors":"Xinran Li;Tao Chen;Gang Liu;Jie Dou;Ruiqing Niu;Antonio Plaza","doi":"10.1109/JSTARS.2024.3491216","DOIUrl":null,"url":null,"abstract":"Landslide recognition (LR) is a fundamental task for disaster prevention and control. Convolutional neural networks (CNNs) and transformer architectures have been widely used for extracting landslide information. However, CNNs cannot accurately characterize long-distance dependencies and global information, while the transformer may not be as effective as CNNs in capturing local features and spatial information. To address these limitations, we construct a new LR network based on grid-based attention and multilevel feature fusion (GAMTNet). We complement CNNs by adding a transformer-based structure in a layer-by-layer fashion and improving methods for sequence generation and attention weight calculation. As a result, GAMTNet effectively learns global and local information about landslides across various spatial scales. We evaluated our model using landslide data collected from the southwest region of Jiuzhaigou County, Aba Tibetan, and Qiang Autonomous Prefecture, Sichuan Province, China. The results demonstrate that the proposed GAMTNet model achieves an \n<italic>F</i>\n1-score of 0.8951, a Kappa coefficient of 0.8807, and an MIoU of 0.8908, indicating its capability for the accurate landslide identification and its potential application in LR tasks.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"17 ","pages":"19911-19922"},"PeriodicalIF":4.7000,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10742385","citationCount":"0","resultStr":"{\"title\":\"Joint Grid-Based Attention and Multilevel Feature Fusion for Landslide Recognition\",\"authors\":\"Xinran Li;Tao Chen;Gang Liu;Jie Dou;Ruiqing Niu;Antonio Plaza\",\"doi\":\"10.1109/JSTARS.2024.3491216\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Landslide recognition (LR) is a fundamental task for disaster prevention and control. Convolutional neural networks (CNNs) and transformer architectures have been widely used for extracting landslide information. However, CNNs cannot accurately characterize long-distance dependencies and global information, while the transformer may not be as effective as CNNs in capturing local features and spatial information. To address these limitations, we construct a new LR network based on grid-based attention and multilevel feature fusion (GAMTNet). We complement CNNs by adding a transformer-based structure in a layer-by-layer fashion and improving methods for sequence generation and attention weight calculation. As a result, GAMTNet effectively learns global and local information about landslides across various spatial scales. We evaluated our model using landslide data collected from the southwest region of Jiuzhaigou County, Aba Tibetan, and Qiang Autonomous Prefecture, Sichuan Province, China. The results demonstrate that the proposed GAMTNet model achieves an \\n<italic>F</i>\\n1-score of 0.8951, a Kappa coefficient of 0.8807, and an MIoU of 0.8908, indicating its capability for the accurate landslide identification and its potential application in LR tasks.\",\"PeriodicalId\":13116,\"journal\":{\"name\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"volume\":\"17 \",\"pages\":\"19911-19922\"},\"PeriodicalIF\":4.7000,\"publicationDate\":\"2024-11-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10742385\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10742385/\",\"RegionNum\":2,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10742385/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

滑坡识别(LR)是灾害预防和控制的一项基本任务。卷积神经网络(CNN)和变换器架构已被广泛用于提取滑坡信息。然而,卷积神经网络无法准确描述长距离依赖关系和全局信息,而变换器在捕捉局部特征和空间信息方面可能不如卷积神经网络有效。为了解决这些局限性,我们构建了一种基于网格关注和多级特征融合的新型 LR 网络(GAMTNet)。我们通过逐层添加基于变换器的结构,并改进序列生成和注意力权重计算方法,对 CNN 进行了补充。因此,GAMTNet 可有效学习不同空间尺度上滑坡的全局和局部信息。我们使用从中国四川省阿坝藏族羌族自治州九寨沟县西南地区收集到的滑坡数据对我们的模型进行了评估。结果表明,所提出的 GAMTNet 模型的 F1 分数为 0.8951,Kappa 系数为 0.8807,MIoU 为 0.8908,这表明该模型具有准确识别滑坡的能力,并有望应用于 LR 任务中。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Joint Grid-Based Attention and Multilevel Feature Fusion for Landslide Recognition
Landslide recognition (LR) is a fundamental task for disaster prevention and control. Convolutional neural networks (CNNs) and transformer architectures have been widely used for extracting landslide information. However, CNNs cannot accurately characterize long-distance dependencies and global information, while the transformer may not be as effective as CNNs in capturing local features and spatial information. To address these limitations, we construct a new LR network based on grid-based attention and multilevel feature fusion (GAMTNet). We complement CNNs by adding a transformer-based structure in a layer-by-layer fashion and improving methods for sequence generation and attention weight calculation. As a result, GAMTNet effectively learns global and local information about landslides across various spatial scales. We evaluated our model using landslide data collected from the southwest region of Jiuzhaigou County, Aba Tibetan, and Qiang Autonomous Prefecture, Sichuan Province, China. The results demonstrate that the proposed GAMTNet model achieves an F 1-score of 0.8951, a Kappa coefficient of 0.8807, and an MIoU of 0.8908, indicating its capability for the accurate landslide identification and its potential application in LR tasks.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信