Evaluating gradient descent variations for artificial neural network bathymetry modeling and sensitivity analysis

IF 1.4 4区 地球科学 Q4 ENVIRONMENTAL SCIENCES
Chih-Hung Lee, Min-Kung Hsu, Yu-Min Wang, Jan-Mou Leu, Chung-Ling Chen, Liwei Liu
{"title":"Evaluating gradient descent variations for artificial neural network bathymetry modeling and sensitivity analysis","authors":"Chih-Hung Lee, Min-Kung Hsu, Yu-Min Wang, Jan-Mou Leu, Chung-Ling Chen, Liwei Liu","doi":"10.1117/1.jrs.18.022204","DOIUrl":null,"url":null,"abstract":"Artificial intelligence has been widely applied to water depth retrieval across various environments, deemed essential for habitat modeling, hydraulic structure design, and watershed management. However, most of these models have been developed for deep waters, with the critical impact of the gradient descent algorithm often not evaluated. To address this gap in current research, this study adopted the artificial neural network with seven gradient descent methods, including step, momentum, quick propagation, delta-bar-delta, conjugate gradient, Levenberg–Marquardt, and resilient backpropagation (RProp), for shallow water depth modeling. Shallow water depths in Taiwan’s mountainous rivers were then modeled using multispectral imagery taken by drone and vegetation indices. From our results, it was revealed that methods optimizing weight updates were outperformed by those based on gradient information, such as RProp. The selection of gradient descent algorithm was identified as pivotal; an inappropriate selection might even result in performance inferior to a traditional linear regression model. In the sensitivity analysis, near-infrared and normalized difference water index were classified as highly sensitive. By leveraging multispectral data and vegetation indices with ANN, the optimal gradient descent algorithm and the critical model input for shallow water modeling were successfully identified, offering invaluable insights for future studies.","PeriodicalId":54879,"journal":{"name":"Journal of Applied Remote Sensing","volume":null,"pages":null},"PeriodicalIF":1.4000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Applied Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1117/1.jrs.18.022204","RegionNum":4,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Artificial intelligence has been widely applied to water depth retrieval across various environments, deemed essential for habitat modeling, hydraulic structure design, and watershed management. However, most of these models have been developed for deep waters, with the critical impact of the gradient descent algorithm often not evaluated. To address this gap in current research, this study adopted the artificial neural network with seven gradient descent methods, including step, momentum, quick propagation, delta-bar-delta, conjugate gradient, Levenberg–Marquardt, and resilient backpropagation (RProp), for shallow water depth modeling. Shallow water depths in Taiwan’s mountainous rivers were then modeled using multispectral imagery taken by drone and vegetation indices. From our results, it was revealed that methods optimizing weight updates were outperformed by those based on gradient information, such as RProp. The selection of gradient descent algorithm was identified as pivotal; an inappropriate selection might even result in performance inferior to a traditional linear regression model. In the sensitivity analysis, near-infrared and normalized difference water index were classified as highly sensitive. By leveraging multispectral data and vegetation indices with ANN, the optimal gradient descent algorithm and the critical model input for shallow water modeling were successfully identified, offering invaluable insights for future studies.
评估用于人工神经网络测深建模和敏感性分析的梯度下降变化
人工智能已广泛应用于各种环境下的水深检索,被认为对生境建模、水力结构设计和流域管理至关重要。然而,这些模型大多是针对深水开发的,梯度下降算法的关键影响往往没有得到评估。针对目前研究中的这一不足,本研究采用了人工神经网络的七种梯度下降方法,包括阶跃法、动量法、快速传播法、Δ-bar-Δ法、共轭梯度法、Levenberg-Marquardt 法和弹性反向传播法(RProp),用于浅水深度建模。然后利用无人机拍摄的多光谱图像和植被指数对台湾山区河流的浅水深度进行建模。结果表明,权值更新优化方法的性能优于基于梯度信息的方法,如 RProp。 梯度下降算法的选择至关重要,选择不当甚至可能导致性能逊于传统的线性回归模型。在灵敏度分析中,近红外和归一化差异水指数被归类为高灵敏度。通过利用多光谱数据和植被指数与 ANN,成功确定了浅水建模的最佳梯度下降算法和关键模型输入,为今后的研究提供了宝贵的启示。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Applied Remote Sensing
Journal of Applied Remote Sensing 环境科学-成像科学与照相技术
CiteScore
3.40
自引率
11.80%
发文量
194
审稿时长
3 months
期刊介绍: The Journal of Applied Remote Sensing is a peer-reviewed journal that optimizes the communication of concepts, information, and progress among the remote sensing community.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信