利用 SHAP 技术提高基于 CNN-LSTM 的洪水预测的可解释性

IF 5.8 2区 环境科学与生态学 Q1 ECOLOGY
Hao Huang , Zhaoli Wang , Yaoxing Liao , Weizhi Gao , Chengguang Lai , Xushu Wu , Zhaoyang Zeng
{"title":"利用 SHAP 技术提高基于 CNN-LSTM 的洪水预测的可解释性","authors":"Hao Huang ,&nbsp;Zhaoli Wang ,&nbsp;Yaoxing Liao ,&nbsp;Weizhi Gao ,&nbsp;Chengguang Lai ,&nbsp;Xushu Wu ,&nbsp;Zhaoyang Zeng","doi":"10.1016/j.ecoinf.2024.102904","DOIUrl":null,"url":null,"abstract":"<div><div>Convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) are popular deep learning architectures currently used for rapid flood simulations. However, deep learning algorithms are difficult to explain, like a “black box” that lacks insight. In order to reveal the intrinsic mechanism of prediction by such architectures, we adopted a coupled CNN-LSTM model based on the explainability technique SHapley Additive exPlanations (SHAP) to predict the rainfall-runoff process and identify key input feature factors, and took the Beijiang River Basin in China as an example, so as to improve the explainability and credibility of this black-box model. The results show that the coupled CNN-LSTM model performs better than the flood predictions compared to the individual CNN or LSTM models under the longest foresight period of 25 h. In particular, the Nash-Sutcliffe Efficiency (NSE) of the former model reaches 0.838, while those of the latter two models are 0.737 and 0.745, respectively. The coupled CNN-LSTM model has a high-accuracy prediction capability, consistently exhibiting NSEs greater than 0.8 for different input time steps and foresight periods. The prediction accuracy is mainly influenced by the observed runoff at the downstream hydrological station from previous time points, while the effects of the input time step length and the foresight period are comparatively negligible. This study provides a new perspective for understanding the potential physical mechanism of black-box models for rainfall-runoff prediction and emphasizes the importance and prospect of the application of explainability techniques.</div></div>","PeriodicalId":51024,"journal":{"name":"Ecological Informatics","volume":"84 ","pages":"Article 102904"},"PeriodicalIF":5.8000,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Improving the explainability of CNN-LSTM-based flood prediction with integrating SHAP technique\",\"authors\":\"Hao Huang ,&nbsp;Zhaoli Wang ,&nbsp;Yaoxing Liao ,&nbsp;Weizhi Gao ,&nbsp;Chengguang Lai ,&nbsp;Xushu Wu ,&nbsp;Zhaoyang Zeng\",\"doi\":\"10.1016/j.ecoinf.2024.102904\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) are popular deep learning architectures currently used for rapid flood simulations. However, deep learning algorithms are difficult to explain, like a “black box” that lacks insight. In order to reveal the intrinsic mechanism of prediction by such architectures, we adopted a coupled CNN-LSTM model based on the explainability technique SHapley Additive exPlanations (SHAP) to predict the rainfall-runoff process and identify key input feature factors, and took the Beijiang River Basin in China as an example, so as to improve the explainability and credibility of this black-box model. The results show that the coupled CNN-LSTM model performs better than the flood predictions compared to the individual CNN or LSTM models under the longest foresight period of 25 h. In particular, the Nash-Sutcliffe Efficiency (NSE) of the former model reaches 0.838, while those of the latter two models are 0.737 and 0.745, respectively. The coupled CNN-LSTM model has a high-accuracy prediction capability, consistently exhibiting NSEs greater than 0.8 for different input time steps and foresight periods. The prediction accuracy is mainly influenced by the observed runoff at the downstream hydrological station from previous time points, while the effects of the input time step length and the foresight period are comparatively negligible. This study provides a new perspective for understanding the potential physical mechanism of black-box models for rainfall-runoff prediction and emphasizes the importance and prospect of the application of explainability techniques.</div></div>\",\"PeriodicalId\":51024,\"journal\":{\"name\":\"Ecological Informatics\",\"volume\":\"84 \",\"pages\":\"Article 102904\"},\"PeriodicalIF\":5.8000,\"publicationDate\":\"2024-11-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ecological Informatics\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1574954124004461\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ECOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Informatics","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1574954124004461","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

卷积神经网络(CNN)和长短期记忆网络(LSTM)是目前用于快速洪水模拟的流行深度学习架构。然而,深度学习算法很难解释,就像一个缺乏洞察力的 "黑盒子"。为了揭示这类架构预测的内在机理,我们采用了基于可解释性技术SHapley Additive exPlanations(SHAP)的耦合CNN-LSTM模型来预测降雨径流过程,识别关键输入特征因子,并以中国北江流域为例,以提高这一黑箱模型的可解释性和可信度。结果表明,与单独的 CNN 或 LSTM 模型相比,耦合 CNN-LSTM 模型在最长预报期 25 h 的洪水预报中表现更好,其中前者的 Nash-Sutcliffe 效率(NSE)达到 0.838,而后两者分别为 0.737 和 0.745。耦合 CNN-LSTM 模型具有高精度预测能力,在不同输入时间步长和预测周期下,NSE 均大于 0.8。预测精度主要受下游水文站前几个时间点观测到的径流量影响,而输入时间步长和预见期的影响相对较小。这项研究为理解降雨-径流预测黑箱模型的潜在物理机制提供了一个新的视角,并强调了可解释性技术应用的重要性和前景。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Improving the explainability of CNN-LSTM-based flood prediction with integrating SHAP technique
Convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) are popular deep learning architectures currently used for rapid flood simulations. However, deep learning algorithms are difficult to explain, like a “black box” that lacks insight. In order to reveal the intrinsic mechanism of prediction by such architectures, we adopted a coupled CNN-LSTM model based on the explainability technique SHapley Additive exPlanations (SHAP) to predict the rainfall-runoff process and identify key input feature factors, and took the Beijiang River Basin in China as an example, so as to improve the explainability and credibility of this black-box model. The results show that the coupled CNN-LSTM model performs better than the flood predictions compared to the individual CNN or LSTM models under the longest foresight period of 25 h. In particular, the Nash-Sutcliffe Efficiency (NSE) of the former model reaches 0.838, while those of the latter two models are 0.737 and 0.745, respectively. The coupled CNN-LSTM model has a high-accuracy prediction capability, consistently exhibiting NSEs greater than 0.8 for different input time steps and foresight periods. The prediction accuracy is mainly influenced by the observed runoff at the downstream hydrological station from previous time points, while the effects of the input time step length and the foresight period are comparatively negligible. This study provides a new perspective for understanding the potential physical mechanism of black-box models for rainfall-runoff prediction and emphasizes the importance and prospect of the application of explainability techniques.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Ecological Informatics
Ecological Informatics 环境科学-生态学
CiteScore
8.30
自引率
11.80%
发文量
346
审稿时长
46 days
期刊介绍: The journal Ecological Informatics is devoted to the publication of high quality, peer-reviewed articles on all aspects of computational ecology, data science and biogeography. The scope of the journal takes into account the data-intensive nature of ecology, the growing capacity of information technology to access, harness and leverage complex data as well as the critical need for informing sustainable management in view of global environmental and climate change. The nature of the journal is interdisciplinary at the crossover between ecology and informatics. It focuses on novel concepts and techniques for image- and genome-based monitoring and interpretation, sensor- and multimedia-based data acquisition, internet-based data archiving and sharing, data assimilation, modelling and prediction of ecological data.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信