Weizhi Gao , Yaoxing Liao , Yuhong Chen , Chengguang Lai , Sijing He , Zhaoli Wang
{"title":"利用可解释 CNN 模型提高数据驱动的城市冲积洪水预测的透明度","authors":"Weizhi Gao , Yaoxing Liao , Yuhong Chen , Chengguang Lai , Sijing He , Zhaoli Wang","doi":"10.1016/j.jhydrol.2024.132228","DOIUrl":null,"url":null,"abstract":"<div><div>Mitigating severe losses caused by pluvial floods in urban areas with dense population and property requires effective flood prediction for emergency measures. Physics-based models face issues with low computational efficiency for real‐time flood prediction. An alternative approach for rapid prediction instead of physics-based models is to predict from a data-driven perspective. However, data-driven approaches for urban flood prediction are often perceived as “black box” and might raise concerns. In this study, we propose an explainable deep learning (DL) approach for rapid urban pluvial flood prediction with enhanced transparency using a convolutional neural network (CNN) and the explainable artificial intelligence (AI) framework Shapley additive explanation (SHAP). We process a systematic stepwise feature selection process and establish a CNN model considering topography, drainage networks and rainfall to predict maximum inundation depths. Then, SHAP is applied to provide trustworthy explanations for the decision making in model results. The results show that: 1) Forward selection can offer insights into selecting effective input variables for improved predictions and promote understanding of DL modelling. The spatial pattern of inundation depths predicted by the proposed CNN model shows good agreement with those predicted by the physics-based model, demonstrated by average correlation coefficient (CC) and mean absolute error (MAE) values of 0.982 and 0.021 m, respectively. 2) The CNN model substantially outperforms the physics-based model in computational speed when using the same hardware, achieving speedups of 210 times on GPU and 51 times on CPU in the case study (575167 grid cells, 14.38 km<sup>2</sup>). Particularly, it can still achieve good performance on a CPU-only standard laptop without high-performance hardware, with only a modest increase in computational time. 3) The SHAP explainable analysis confirms that the CNN model correctly captures the relationships between input variables and water depth, revealing a reasonable decision-making process, enhancing its transparency. The explainable DL approach incorporating SHAP for rapid urban pluvial flood prediction is promising to build trust among stakeholders and provide a trustworthy reference for prompt measures aiming at saving lives and protecting assets during flood emergencies. Additionally, the proposed DL approach can potentially be further expanded to analyze the causes of urban flooding events and serve as a foundation for exploring the transferability of data-driven urban flood prediction, providing benefits for better urban flood risk management.</div></div>","PeriodicalId":362,"journal":{"name":"Journal of Hydrology","volume":"645 ","pages":"Article 132228"},"PeriodicalIF":5.9000,"publicationDate":"2024-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Enhancing transparency in data-driven urban pluvial flood prediction using an explainable CNN model\",\"authors\":\"Weizhi Gao , Yaoxing Liao , Yuhong Chen , Chengguang Lai , Sijing He , Zhaoli Wang\",\"doi\":\"10.1016/j.jhydrol.2024.132228\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Mitigating severe losses caused by pluvial floods in urban areas with dense population and property requires effective flood prediction for emergency measures. Physics-based models face issues with low computational efficiency for real‐time flood prediction. An alternative approach for rapid prediction instead of physics-based models is to predict from a data-driven perspective. However, data-driven approaches for urban flood prediction are often perceived as “black box” and might raise concerns. In this study, we propose an explainable deep learning (DL) approach for rapid urban pluvial flood prediction with enhanced transparency using a convolutional neural network (CNN) and the explainable artificial intelligence (AI) framework Shapley additive explanation (SHAP). We process a systematic stepwise feature selection process and establish a CNN model considering topography, drainage networks and rainfall to predict maximum inundation depths. Then, SHAP is applied to provide trustworthy explanations for the decision making in model results. The results show that: 1) Forward selection can offer insights into selecting effective input variables for improved predictions and promote understanding of DL modelling. The spatial pattern of inundation depths predicted by the proposed CNN model shows good agreement with those predicted by the physics-based model, demonstrated by average correlation coefficient (CC) and mean absolute error (MAE) values of 0.982 and 0.021 m, respectively. 2) The CNN model substantially outperforms the physics-based model in computational speed when using the same hardware, achieving speedups of 210 times on GPU and 51 times on CPU in the case study (575167 grid cells, 14.38 km<sup>2</sup>). Particularly, it can still achieve good performance on a CPU-only standard laptop without high-performance hardware, with only a modest increase in computational time. 3) The SHAP explainable analysis confirms that the CNN model correctly captures the relationships between input variables and water depth, revealing a reasonable decision-making process, enhancing its transparency. The explainable DL approach incorporating SHAP for rapid urban pluvial flood prediction is promising to build trust among stakeholders and provide a trustworthy reference for prompt measures aiming at saving lives and protecting assets during flood emergencies. Additionally, the proposed DL approach can potentially be further expanded to analyze the causes of urban flooding events and serve as a foundation for exploring the transferability of data-driven urban flood prediction, providing benefits for better urban flood risk management.</div></div>\",\"PeriodicalId\":362,\"journal\":{\"name\":\"Journal of Hydrology\",\"volume\":\"645 \",\"pages\":\"Article 132228\"},\"PeriodicalIF\":5.9000,\"publicationDate\":\"2024-10-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Hydrology\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S002216942401624X\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CIVIL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Hydrology","FirstCategoryId":"89","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S002216942401624X","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
Enhancing transparency in data-driven urban pluvial flood prediction using an explainable CNN model
Mitigating severe losses caused by pluvial floods in urban areas with dense population and property requires effective flood prediction for emergency measures. Physics-based models face issues with low computational efficiency for real‐time flood prediction. An alternative approach for rapid prediction instead of physics-based models is to predict from a data-driven perspective. However, data-driven approaches for urban flood prediction are often perceived as “black box” and might raise concerns. In this study, we propose an explainable deep learning (DL) approach for rapid urban pluvial flood prediction with enhanced transparency using a convolutional neural network (CNN) and the explainable artificial intelligence (AI) framework Shapley additive explanation (SHAP). We process a systematic stepwise feature selection process and establish a CNN model considering topography, drainage networks and rainfall to predict maximum inundation depths. Then, SHAP is applied to provide trustworthy explanations for the decision making in model results. The results show that: 1) Forward selection can offer insights into selecting effective input variables for improved predictions and promote understanding of DL modelling. The spatial pattern of inundation depths predicted by the proposed CNN model shows good agreement with those predicted by the physics-based model, demonstrated by average correlation coefficient (CC) and mean absolute error (MAE) values of 0.982 and 0.021 m, respectively. 2) The CNN model substantially outperforms the physics-based model in computational speed when using the same hardware, achieving speedups of 210 times on GPU and 51 times on CPU in the case study (575167 grid cells, 14.38 km2). Particularly, it can still achieve good performance on a CPU-only standard laptop without high-performance hardware, with only a modest increase in computational time. 3) The SHAP explainable analysis confirms that the CNN model correctly captures the relationships between input variables and water depth, revealing a reasonable decision-making process, enhancing its transparency. The explainable DL approach incorporating SHAP for rapid urban pluvial flood prediction is promising to build trust among stakeholders and provide a trustworthy reference for prompt measures aiming at saving lives and protecting assets during flood emergencies. Additionally, the proposed DL approach can potentially be further expanded to analyze the causes of urban flooding events and serve as a foundation for exploring the transferability of data-driven urban flood prediction, providing benefits for better urban flood risk management.
期刊介绍:
The Journal of Hydrology publishes original research papers and comprehensive reviews in all the subfields of the hydrological sciences including water based management and policy issues that impact on economics and society. These comprise, but are not limited to the physical, chemical, biogeochemical, stochastic and systems aspects of surface and groundwater hydrology, hydrometeorology and hydrogeology. Relevant topics incorporating the insights and methodologies of disciplines such as climatology, water resource systems, hydraulics, agrohydrology, geomorphology, soil science, instrumentation and remote sensing, civil and environmental engineering are included. Social science perspectives on hydrological problems such as resource and ecological economics, environmental sociology, psychology and behavioural science, management and policy analysis are also invited. Multi-and interdisciplinary analyses of hydrological problems are within scope. The science published in the Journal of Hydrology is relevant to catchment scales rather than exclusively to a local scale or site.