基于标签传播算法的半监督深度学习,用于少标签场景下的泥石流易发性评估

IF 3.9 3区 环境科学与生态学 Q1 ENGINEERING, CIVIL
Qingyu Wang, Changming Wang, Haozhe Tang, Di Wu, Fei Wang
{"title":"基于标签传播算法的半监督深度学习,用于少标签场景下的泥石流易发性评估","authors":"Qingyu Wang, Changming Wang, Haozhe Tang, Di Wu, Fei Wang","doi":"10.1007/s00477-024-02719-x","DOIUrl":null,"url":null,"abstract":"<p>Regional debris flow susceptibility assessment is an effective method to prevent debris flow hazards, and deep learning is emerging as a novel approach in this discipline with the development of computers. However, when debris flow samples are insufficient, there will be problems like overfitting or misclassification. To overcome these problems, this paper proposes a semi-supervised deep neural network model (LPA-DNN) combined with label propagation algorithm (LPA), which utilizes high confidence unlabeled samples as pseudo-samples reasonably in few-label scenarios. Xinzhou, Shanxi Province, was selected as the study area, and a dataset containing 292 debris flow samples and 10 types of impact factors was compiled based on watershed units. Using the dataset and pseudo-samples, the LPA-DNN model was built to get debris flow susceptibility map. Meanwhile, DNN and SVM were set up for comparison to demonstrate that the proposed LPA-DNN model has excellent performance and higher accuracy. LPA-DNN alleviates the problem of low accuracy that caused by samples lacking in deep learning to a certain extent, and obtains great classification results, which proves that it is quite potential in regional debris flow susceptibility assessment.</p>","PeriodicalId":21987,"journal":{"name":"Stochastic Environmental Research and Risk Assessment","volume":"18 1","pages":""},"PeriodicalIF":3.9000,"publicationDate":"2024-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Semi-supervised deep learning based on label propagation algorithm for debris flow susceptibility assessment in few-label scenarios\",\"authors\":\"Qingyu Wang, Changming Wang, Haozhe Tang, Di Wu, Fei Wang\",\"doi\":\"10.1007/s00477-024-02719-x\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Regional debris flow susceptibility assessment is an effective method to prevent debris flow hazards, and deep learning is emerging as a novel approach in this discipline with the development of computers. However, when debris flow samples are insufficient, there will be problems like overfitting or misclassification. To overcome these problems, this paper proposes a semi-supervised deep neural network model (LPA-DNN) combined with label propagation algorithm (LPA), which utilizes high confidence unlabeled samples as pseudo-samples reasonably in few-label scenarios. Xinzhou, Shanxi Province, was selected as the study area, and a dataset containing 292 debris flow samples and 10 types of impact factors was compiled based on watershed units. Using the dataset and pseudo-samples, the LPA-DNN model was built to get debris flow susceptibility map. Meanwhile, DNN and SVM were set up for comparison to demonstrate that the proposed LPA-DNN model has excellent performance and higher accuracy. LPA-DNN alleviates the problem of low accuracy that caused by samples lacking in deep learning to a certain extent, and obtains great classification results, which proves that it is quite potential in regional debris flow susceptibility assessment.</p>\",\"PeriodicalId\":21987,\"journal\":{\"name\":\"Stochastic Environmental Research and Risk Assessment\",\"volume\":\"18 1\",\"pages\":\"\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2024-04-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Stochastic Environmental Research and Risk Assessment\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://doi.org/10.1007/s00477-024-02719-x\",\"RegionNum\":3,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CIVIL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Stochastic Environmental Research and Risk Assessment","FirstCategoryId":"93","ListUrlMain":"https://doi.org/10.1007/s00477-024-02719-x","RegionNum":3,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
引用次数: 0

摘要

区域泥石流易发性评估是预防泥石流灾害的有效方法,随着计算机的发展,深度学习正成为该领域的一种新方法。然而,当泥石流样本不足时,就会出现过拟合或误判等问题。为了克服这些问题,本文提出了一种结合标签传播算法(LPA)的半监督深度神经网络模型(LPA-DNN),在少标签场景下合理利用高置信度的非标签样本作为伪样本。研究选取山西省忻州市作为研究区域,以流域为单位建立了包含 292 个泥石流样本和 10 种影响因子的数据集。利用数据集和伪样本,建立了 LPA-DNN 模型,得到泥石流易感性图。同时,还建立了 DNN 和 SVM 模型进行比较,以证明所提出的 LPA-DNN 模型具有出色的性能和更高的精度。LPA-DNN在一定程度上缓解了由于样本缺乏深度学习而导致的准确率低的问题,并取得了很好的分类效果,证明其在区域泥石流易发性评估中具有相当的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Semi-supervised deep learning based on label propagation algorithm for debris flow susceptibility assessment in few-label scenarios

Semi-supervised deep learning based on label propagation algorithm for debris flow susceptibility assessment in few-label scenarios

Regional debris flow susceptibility assessment is an effective method to prevent debris flow hazards, and deep learning is emerging as a novel approach in this discipline with the development of computers. However, when debris flow samples are insufficient, there will be problems like overfitting or misclassification. To overcome these problems, this paper proposes a semi-supervised deep neural network model (LPA-DNN) combined with label propagation algorithm (LPA), which utilizes high confidence unlabeled samples as pseudo-samples reasonably in few-label scenarios. Xinzhou, Shanxi Province, was selected as the study area, and a dataset containing 292 debris flow samples and 10 types of impact factors was compiled based on watershed units. Using the dataset and pseudo-samples, the LPA-DNN model was built to get debris flow susceptibility map. Meanwhile, DNN and SVM were set up for comparison to demonstrate that the proposed LPA-DNN model has excellent performance and higher accuracy. LPA-DNN alleviates the problem of low accuracy that caused by samples lacking in deep learning to a certain extent, and obtains great classification results, which proves that it is quite potential in regional debris flow susceptibility assessment.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
7.10
自引率
9.50%
发文量
189
审稿时长
3.8 months
期刊介绍: Stochastic Environmental Research and Risk Assessment (SERRA) will publish research papers, reviews and technical notes on stochastic and probabilistic approaches to environmental sciences and engineering, including interactions of earth and atmospheric environments with people and ecosystems. The basic idea is to bring together research papers on stochastic modelling in various fields of environmental sciences and to provide an interdisciplinary forum for the exchange of ideas, for communicating on issues that cut across disciplinary barriers, and for the dissemination of stochastic techniques used in different fields to the community of interested researchers. Original contributions will be considered dealing with modelling (theoretical and computational), measurements and instrumentation in one or more of the following topical areas: - Spatiotemporal analysis and mapping of natural processes. - Enviroinformatics. - Environmental risk assessment, reliability analysis and decision making. - Surface and subsurface hydrology and hydraulics. - Multiphase porous media domains and contaminant transport modelling. - Hazardous waste site characterization. - Stochastic turbulence and random hydrodynamic fields. - Chaotic and fractal systems. - Random waves and seafloor morphology. - Stochastic atmospheric and climate processes. - Air pollution and quality assessment research. - Modern geostatistics. - Mechanisms of pollutant formation, emission, exposure and absorption. - Physical, chemical and biological analysis of human exposure from single and multiple media and routes; control and protection. - Bioinformatics. - Probabilistic methods in ecology and population biology. - Epidemiological investigations. - Models using stochastic differential equations stochastic or partial differential equations. - Hazardous waste site characterization.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信