可解释机器学习模型与机制模型在污水处理厂出水氮预测中的比较

IF 6.7 2区 工程技术 Q1 ENGINEERING, CHEMICAL
Yue Wang , Tan Li , Langming Bai , Huarong Yu , Fangshu Qu
{"title":"可解释机器学习模型与机制模型在污水处理厂出水氮预测中的比较","authors":"Yue Wang ,&nbsp;Tan Li ,&nbsp;Langming Bai ,&nbsp;Huarong Yu ,&nbsp;Fangshu Qu","doi":"10.1016/j.jwpe.2025.108344","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate prediction of effluent nitrogen is crucial for optimizing operations of wastewater treatment plants (WWTPs). This study systematically compared the performance of a mechanistic model, i.e., the Activated Sludge Model (ASM), with six machine learning (ML) models in predicting effluent total nitrogen (TN), by using one year of high-resolution full-scale operational data obtained from a municipal wastewater treatment plant (WWTP). Notably, the integration of Shapley Additive Explanations (SHAP) into the ML models enabled transparent interpretation of model predictions. ASM was dynamically calibrated through sensitivity analysis, which identified key parameters such as μ<sub>AOB</sub> and <em>η</em><sub>OHO,anox</sub> related to nitrification and denitrification. Despite capturing TN trends, the ASM model showed limited accuracy (<em>R</em><sup><em>2</em></sup> = 0.26 for training and 0.06 for validation). In contrast, ML models, particularly Random Forest, XGBoost, and LightGBM, demonstrated superior predictive performance (highest <em>R</em><sup><em>2</em></sup> = 0.79, lowest MRE = 7.5 %). The ML can directly learn complex relationships from a large amount of running data, while ASM relies on simplified mechanism equations and has difficulty reflecting the dynamic changes in actual operation. SHAP analysis further revealed that return sludge rate, MLSS, influent ammonia, and nitrate concentrations were the most influential features determining TN removal. These findings were consistent with the ASM sensitivity analysis, verifying the ML model's capacity to uncover biologically meaningful insights. This study demonstrated that interpretable ML models not only outperformed traditional ASM in prediction accuracy but also provide transparent and actionable explanations, marking a significant advancement in the application of AI for wastewater process modeling.</div></div>","PeriodicalId":17528,"journal":{"name":"Journal of water process engineering","volume":"77 ","pages":"Article 108344"},"PeriodicalIF":6.7000,"publicationDate":"2025-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Comparison of interpretable machine learning models and mechanistic model for predicting effluent nitrogen in WWTP\",\"authors\":\"Yue Wang ,&nbsp;Tan Li ,&nbsp;Langming Bai ,&nbsp;Huarong Yu ,&nbsp;Fangshu Qu\",\"doi\":\"10.1016/j.jwpe.2025.108344\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Accurate prediction of effluent nitrogen is crucial for optimizing operations of wastewater treatment plants (WWTPs). This study systematically compared the performance of a mechanistic model, i.e., the Activated Sludge Model (ASM), with six machine learning (ML) models in predicting effluent total nitrogen (TN), by using one year of high-resolution full-scale operational data obtained from a municipal wastewater treatment plant (WWTP). Notably, the integration of Shapley Additive Explanations (SHAP) into the ML models enabled transparent interpretation of model predictions. ASM was dynamically calibrated through sensitivity analysis, which identified key parameters such as μ<sub>AOB</sub> and <em>η</em><sub>OHO,anox</sub> related to nitrification and denitrification. Despite capturing TN trends, the ASM model showed limited accuracy (<em>R</em><sup><em>2</em></sup> = 0.26 for training and 0.06 for validation). In contrast, ML models, particularly Random Forest, XGBoost, and LightGBM, demonstrated superior predictive performance (highest <em>R</em><sup><em>2</em></sup> = 0.79, lowest MRE = 7.5 %). The ML can directly learn complex relationships from a large amount of running data, while ASM relies on simplified mechanism equations and has difficulty reflecting the dynamic changes in actual operation. SHAP analysis further revealed that return sludge rate, MLSS, influent ammonia, and nitrate concentrations were the most influential features determining TN removal. These findings were consistent with the ASM sensitivity analysis, verifying the ML model's capacity to uncover biologically meaningful insights. This study demonstrated that interpretable ML models not only outperformed traditional ASM in prediction accuracy but also provide transparent and actionable explanations, marking a significant advancement in the application of AI for wastewater process modeling.</div></div>\",\"PeriodicalId\":17528,\"journal\":{\"name\":\"Journal of water process engineering\",\"volume\":\"77 \",\"pages\":\"Article 108344\"},\"PeriodicalIF\":6.7000,\"publicationDate\":\"2025-07-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of water process engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2214714425014163\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CHEMICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of water process engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2214714425014163","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CHEMICAL","Score":null,"Total":0}
引用次数: 0

摘要

准确预测出水氮含量对于优化污水处理厂的运行至关重要。本研究通过使用从城市污水处理厂(WWTP)获得的一年高分辨率全面运行数据,系统地比较了机械模型(即活性污泥模型(ASM))与六种机器学习(ML)模型在预测出水总氮(TN)方面的性能。值得注意的是,将Shapley加性解释(SHAP)集成到ML模型中,可以对模型预测进行透明的解释。通过灵敏度分析对ASM进行动态标定,确定了与硝化和反硝化有关的μAOB、ηOHO、anox等关键参数。尽管捕获了TN趋势,ASM模型显示出有限的准确性(训练R2 = 0.26,验证R2 = 0.06)。相比之下,ML模型,特别是Random Forest, XGBoost和LightGBM,表现出优越的预测性能(最高R2 = 0.79,最低MRE = 7.5%)。ML可以直接从大量运行数据中学习复杂关系,而ASM依赖于简化的机制方程,难以反映实际运行中的动态变化。SHAP分析进一步显示,回流污泥率、MLSS、进水氨和硝酸盐浓度是决定TN去除率的最重要特征。这些发现与ASM敏感性分析一致,验证了ML模型揭示生物学意义见解的能力。本研究表明,可解释的ML模型不仅在预测精度上优于传统的ASM,而且提供了透明和可操作的解释,标志着人工智能在废水过程建模中的应用取得了重大进展。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Comparison of interpretable machine learning models and mechanistic model for predicting effluent nitrogen in WWTP

Comparison of interpretable machine learning models and mechanistic model for predicting effluent nitrogen in WWTP
Accurate prediction of effluent nitrogen is crucial for optimizing operations of wastewater treatment plants (WWTPs). This study systematically compared the performance of a mechanistic model, i.e., the Activated Sludge Model (ASM), with six machine learning (ML) models in predicting effluent total nitrogen (TN), by using one year of high-resolution full-scale operational data obtained from a municipal wastewater treatment plant (WWTP). Notably, the integration of Shapley Additive Explanations (SHAP) into the ML models enabled transparent interpretation of model predictions. ASM was dynamically calibrated through sensitivity analysis, which identified key parameters such as μAOB and ηOHO,anox related to nitrification and denitrification. Despite capturing TN trends, the ASM model showed limited accuracy (R2 = 0.26 for training and 0.06 for validation). In contrast, ML models, particularly Random Forest, XGBoost, and LightGBM, demonstrated superior predictive performance (highest R2 = 0.79, lowest MRE = 7.5 %). The ML can directly learn complex relationships from a large amount of running data, while ASM relies on simplified mechanism equations and has difficulty reflecting the dynamic changes in actual operation. SHAP analysis further revealed that return sludge rate, MLSS, influent ammonia, and nitrate concentrations were the most influential features determining TN removal. These findings were consistent with the ASM sensitivity analysis, verifying the ML model's capacity to uncover biologically meaningful insights. This study demonstrated that interpretable ML models not only outperformed traditional ASM in prediction accuracy but also provide transparent and actionable explanations, marking a significant advancement in the application of AI for wastewater process modeling.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of water process engineering
Journal of water process engineering Biochemistry, Genetics and Molecular Biology-Biotechnology
CiteScore
10.70
自引率
8.60%
发文量
846
审稿时长
24 days
期刊介绍: The Journal of Water Process Engineering aims to publish refereed, high-quality research papers with significant novelty and impact in all areas of the engineering of water and wastewater processing . Papers on advanced and novel treatment processes and technologies are particularly welcome. The Journal considers papers in areas such as nanotechnology and biotechnology applications in water, novel oxidation and separation processes, membrane processes (except those for desalination) , catalytic processes for the removal of water contaminants, sustainable processes, water reuse and recycling, water use and wastewater minimization, integrated/hybrid technology, process modeling of water treatment and novel treatment processes. Submissions on the subject of adsorbents, including standard measurements of adsorption kinetics and equilibrium will only be considered if there is a genuine case for novelty and contribution, for example highly novel, sustainable adsorbents and their use: papers on activated carbon-type materials derived from natural matter, or surfactant-modified clays and related minerals, would not fulfil this criterion. The Journal particularly welcomes contributions involving environmentally, economically and socially sustainable technology for water treatment, including those which are energy-efficient, with minimal or no chemical consumption, and capable of water recycling and reuse that minimizes the direct disposal of wastewater to the aquatic environment. Papers that describe novel ideas for solving issues related to water quality and availability are also welcome, as are those that show the transfer of techniques from other disciplines. The Journal will consider papers dealing with processes for various water matrices including drinking water (except desalination), domestic, urban and industrial wastewaters, in addition to their residues. It is expected that the journal will be of particular relevance to chemical and process engineers working in the field. The Journal welcomes Full Text papers, Short Communications, State-of-the-Art Reviews and Letters to Editors and Case Studies
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信