Vahid Nourani , Mahsa Dehghan , Aida H. Baghanam , Sameh A. Kantoush
{"title":"Shapley加性解释(SHAP)在基于人工智能的污水处理厂数字孪生模型解释和特征选择中的双重用途","authors":"Vahid Nourani , Mahsa Dehghan , Aida H. Baghanam , Sameh A. Kantoush","doi":"10.1016/j.jwpe.2025.107947","DOIUrl":null,"url":null,"abstract":"<div><div>In this study, artificial intelligence (AI) black-box models called feedforward neural network (FFNN) as shallow learning and long short-term memory (LSTM) as deep learning were used to evaluate the biological oxygen demand of effluent (BOD<sub>eff</sub>) and chemical oxygen demand (COD<sub>eff</sub>) of the Tabriz wastewater treatment plant (WWTP). Daily data of the treatment plant from 2015 to 2021 were utilized for this modeling. Given the importance of selecting effective input parameters for modeling, four scenarios were employed for optimal input selection. The first scenario was based on the correlation coefficient (CC) method, the second on the mutual information (MI) method, the third utilized the Shapley additive explanation (SHAP) method for ranking the parameters, and the fourth scenario applied newly proposed hybrid MI-SHAP method for a two-step selection of input parameters. In MI-SHAP method, the number of inputs was first reduced using the MI method, and then the remaining parameters were ranked by the SHAP algorithm and used in the modeling process. This procedure significantly reduced the SHAP runtime. The explainable artificial intelligence (XAI) algorithm named SHAP was also used to visualize and illustrate how parameters influence the modeling results. To evaluate the results provided by the SHAP, another algorithm of the XAI, called accumulated local effects (ALE), was used. Through the use of XAI to illustrate the contribution of each input to the results, it was determined that BOD<sub>eff</sub> and COD<sub>eff</sub> with a one-day lag (BOD<sub>eff(t-1)</sub> and COD<sub>eff(t-1)</sub>) were the most influential features in the FFNN and LSTM. These parameters contribute approximately 54 % and 65 % of the total impact on the modeling outcomes in FFNN, and 56 % and 60 % in LSTM modeling, respectively.</div></div>","PeriodicalId":17528,"journal":{"name":"Journal of water process engineering","volume":"75 ","pages":"Article 107947"},"PeriodicalIF":6.3000,"publicationDate":"2025-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dual purpose of Shapley Additive Explanation (SHAP) in model explanation and feature selection for artificial intelligence-based digital twin of wastewater treatment plant\",\"authors\":\"Vahid Nourani , Mahsa Dehghan , Aida H. Baghanam , Sameh A. Kantoush\",\"doi\":\"10.1016/j.jwpe.2025.107947\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In this study, artificial intelligence (AI) black-box models called feedforward neural network (FFNN) as shallow learning and long short-term memory (LSTM) as deep learning were used to evaluate the biological oxygen demand of effluent (BOD<sub>eff</sub>) and chemical oxygen demand (COD<sub>eff</sub>) of the Tabriz wastewater treatment plant (WWTP). Daily data of the treatment plant from 2015 to 2021 were utilized for this modeling. Given the importance of selecting effective input parameters for modeling, four scenarios were employed for optimal input selection. The first scenario was based on the correlation coefficient (CC) method, the second on the mutual information (MI) method, the third utilized the Shapley additive explanation (SHAP) method for ranking the parameters, and the fourth scenario applied newly proposed hybrid MI-SHAP method for a two-step selection of input parameters. In MI-SHAP method, the number of inputs was first reduced using the MI method, and then the remaining parameters were ranked by the SHAP algorithm and used in the modeling process. This procedure significantly reduced the SHAP runtime. The explainable artificial intelligence (XAI) algorithm named SHAP was also used to visualize and illustrate how parameters influence the modeling results. To evaluate the results provided by the SHAP, another algorithm of the XAI, called accumulated local effects (ALE), was used. Through the use of XAI to illustrate the contribution of each input to the results, it was determined that BOD<sub>eff</sub> and COD<sub>eff</sub> with a one-day lag (BOD<sub>eff(t-1)</sub> and COD<sub>eff(t-1)</sub>) were the most influential features in the FFNN and LSTM. These parameters contribute approximately 54 % and 65 % of the total impact on the modeling outcomes in FFNN, and 56 % and 60 % in LSTM modeling, respectively.</div></div>\",\"PeriodicalId\":17528,\"journal\":{\"name\":\"Journal of water process engineering\",\"volume\":\"75 \",\"pages\":\"Article 107947\"},\"PeriodicalIF\":6.3000,\"publicationDate\":\"2025-05-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of water process engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2214714425010190\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CHEMICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of water process engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2214714425010190","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CHEMICAL","Score":null,"Total":0}
Dual purpose of Shapley Additive Explanation (SHAP) in model explanation and feature selection for artificial intelligence-based digital twin of wastewater treatment plant
In this study, artificial intelligence (AI) black-box models called feedforward neural network (FFNN) as shallow learning and long short-term memory (LSTM) as deep learning were used to evaluate the biological oxygen demand of effluent (BODeff) and chemical oxygen demand (CODeff) of the Tabriz wastewater treatment plant (WWTP). Daily data of the treatment plant from 2015 to 2021 were utilized for this modeling. Given the importance of selecting effective input parameters for modeling, four scenarios were employed for optimal input selection. The first scenario was based on the correlation coefficient (CC) method, the second on the mutual information (MI) method, the third utilized the Shapley additive explanation (SHAP) method for ranking the parameters, and the fourth scenario applied newly proposed hybrid MI-SHAP method for a two-step selection of input parameters. In MI-SHAP method, the number of inputs was first reduced using the MI method, and then the remaining parameters were ranked by the SHAP algorithm and used in the modeling process. This procedure significantly reduced the SHAP runtime. The explainable artificial intelligence (XAI) algorithm named SHAP was also used to visualize and illustrate how parameters influence the modeling results. To evaluate the results provided by the SHAP, another algorithm of the XAI, called accumulated local effects (ALE), was used. Through the use of XAI to illustrate the contribution of each input to the results, it was determined that BODeff and CODeff with a one-day lag (BODeff(t-1) and CODeff(t-1)) were the most influential features in the FFNN and LSTM. These parameters contribute approximately 54 % and 65 % of the total impact on the modeling outcomes in FFNN, and 56 % and 60 % in LSTM modeling, respectively.
期刊介绍:
The Journal of Water Process Engineering aims to publish refereed, high-quality research papers with significant novelty and impact in all areas of the engineering of water and wastewater processing . Papers on advanced and novel treatment processes and technologies are particularly welcome. The Journal considers papers in areas such as nanotechnology and biotechnology applications in water, novel oxidation and separation processes, membrane processes (except those for desalination) , catalytic processes for the removal of water contaminants, sustainable processes, water reuse and recycling, water use and wastewater minimization, integrated/hybrid technology, process modeling of water treatment and novel treatment processes. Submissions on the subject of adsorbents, including standard measurements of adsorption kinetics and equilibrium will only be considered if there is a genuine case for novelty and contribution, for example highly novel, sustainable adsorbents and their use: papers on activated carbon-type materials derived from natural matter, or surfactant-modified clays and related minerals, would not fulfil this criterion. The Journal particularly welcomes contributions involving environmentally, economically and socially sustainable technology for water treatment, including those which are energy-efficient, with minimal or no chemical consumption, and capable of water recycling and reuse that minimizes the direct disposal of wastewater to the aquatic environment. Papers that describe novel ideas for solving issues related to water quality and availability are also welcome, as are those that show the transfer of techniques from other disciplines. The Journal will consider papers dealing with processes for various water matrices including drinking water (except desalination), domestic, urban and industrial wastewaters, in addition to their residues. It is expected that the journal will be of particular relevance to chemical and process engineers working in the field. The Journal welcomes Full Text papers, Short Communications, State-of-the-Art Reviews and Letters to Editors and Case Studies