Hao Huang , Zhaoli Wang , Yaoxing Liao , Weizhi Gao , Chengguang Lai , Xushu Wu , Zhaoyang Zeng
{"title":"利用 SHAP 技术提高基于 CNN-LSTM 的洪水预测的可解释性","authors":"Hao Huang , Zhaoli Wang , Yaoxing Liao , Weizhi Gao , Chengguang Lai , Xushu Wu , Zhaoyang Zeng","doi":"10.1016/j.ecoinf.2024.102904","DOIUrl":null,"url":null,"abstract":"<div><div>Convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) are popular deep learning architectures currently used for rapid flood simulations. However, deep learning algorithms are difficult to explain, like a “black box” that lacks insight. In order to reveal the intrinsic mechanism of prediction by such architectures, we adopted a coupled CNN-LSTM model based on the explainability technique SHapley Additive exPlanations (SHAP) to predict the rainfall-runoff process and identify key input feature factors, and took the Beijiang River Basin in China as an example, so as to improve the explainability and credibility of this black-box model. The results show that the coupled CNN-LSTM model performs better than the flood predictions compared to the individual CNN or LSTM models under the longest foresight period of 25 h. In particular, the Nash-Sutcliffe Efficiency (NSE) of the former model reaches 0.838, while those of the latter two models are 0.737 and 0.745, respectively. The coupled CNN-LSTM model has a high-accuracy prediction capability, consistently exhibiting NSEs greater than 0.8 for different input time steps and foresight periods. The prediction accuracy is mainly influenced by the observed runoff at the downstream hydrological station from previous time points, while the effects of the input time step length and the foresight period are comparatively negligible. This study provides a new perspective for understanding the potential physical mechanism of black-box models for rainfall-runoff prediction and emphasizes the importance and prospect of the application of explainability techniques.</div></div>","PeriodicalId":51024,"journal":{"name":"Ecological Informatics","volume":"84 ","pages":"Article 102904"},"PeriodicalIF":5.8000,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Improving the explainability of CNN-LSTM-based flood prediction with integrating SHAP technique\",\"authors\":\"Hao Huang , Zhaoli Wang , Yaoxing Liao , Weizhi Gao , Chengguang Lai , Xushu Wu , Zhaoyang Zeng\",\"doi\":\"10.1016/j.ecoinf.2024.102904\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) are popular deep learning architectures currently used for rapid flood simulations. However, deep learning algorithms are difficult to explain, like a “black box” that lacks insight. In order to reveal the intrinsic mechanism of prediction by such architectures, we adopted a coupled CNN-LSTM model based on the explainability technique SHapley Additive exPlanations (SHAP) to predict the rainfall-runoff process and identify key input feature factors, and took the Beijiang River Basin in China as an example, so as to improve the explainability and credibility of this black-box model. The results show that the coupled CNN-LSTM model performs better than the flood predictions compared to the individual CNN or LSTM models under the longest foresight period of 25 h. In particular, the Nash-Sutcliffe Efficiency (NSE) of the former model reaches 0.838, while those of the latter two models are 0.737 and 0.745, respectively. The coupled CNN-LSTM model has a high-accuracy prediction capability, consistently exhibiting NSEs greater than 0.8 for different input time steps and foresight periods. The prediction accuracy is mainly influenced by the observed runoff at the downstream hydrological station from previous time points, while the effects of the input time step length and the foresight period are comparatively negligible. This study provides a new perspective for understanding the potential physical mechanism of black-box models for rainfall-runoff prediction and emphasizes the importance and prospect of the application of explainability techniques.</div></div>\",\"PeriodicalId\":51024,\"journal\":{\"name\":\"Ecological Informatics\",\"volume\":\"84 \",\"pages\":\"Article 102904\"},\"PeriodicalIF\":5.8000,\"publicationDate\":\"2024-11-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ecological Informatics\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1574954124004461\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ECOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ecological Informatics","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1574954124004461","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
Improving the explainability of CNN-LSTM-based flood prediction with integrating SHAP technique
Convolutional neural networks (CNNs) and long short-term memory networks (LSTMs) are popular deep learning architectures currently used for rapid flood simulations. However, deep learning algorithms are difficult to explain, like a “black box” that lacks insight. In order to reveal the intrinsic mechanism of prediction by such architectures, we adopted a coupled CNN-LSTM model based on the explainability technique SHapley Additive exPlanations (SHAP) to predict the rainfall-runoff process and identify key input feature factors, and took the Beijiang River Basin in China as an example, so as to improve the explainability and credibility of this black-box model. The results show that the coupled CNN-LSTM model performs better than the flood predictions compared to the individual CNN or LSTM models under the longest foresight period of 25 h. In particular, the Nash-Sutcliffe Efficiency (NSE) of the former model reaches 0.838, while those of the latter two models are 0.737 and 0.745, respectively. The coupled CNN-LSTM model has a high-accuracy prediction capability, consistently exhibiting NSEs greater than 0.8 for different input time steps and foresight periods. The prediction accuracy is mainly influenced by the observed runoff at the downstream hydrological station from previous time points, while the effects of the input time step length and the foresight period are comparatively negligible. This study provides a new perspective for understanding the potential physical mechanism of black-box models for rainfall-runoff prediction and emphasizes the importance and prospect of the application of explainability techniques.
期刊介绍:
The journal Ecological Informatics is devoted to the publication of high quality, peer-reviewed articles on all aspects of computational ecology, data science and biogeography. The scope of the journal takes into account the data-intensive nature of ecology, the growing capacity of information technology to access, harness and leverage complex data as well as the critical need for informing sustainable management in view of global environmental and climate change.
The nature of the journal is interdisciplinary at the crossover between ecology and informatics. It focuses on novel concepts and techniques for image- and genome-based monitoring and interpretation, sensor- and multimedia-based data acquisition, internet-based data archiving and sharing, data assimilation, modelling and prediction of ecological data.