利用基于机器学习的虚拟传感器推进可持续发展目标6.3.2,实现高频营养监测

IF 6.7 2区 工程技术 Q1 ENGINEERING, CHEMICAL
Bongumenzi Ngwenya , Thulane Paepae , Pitshou N. Bokoro
{"title":"利用基于机器学习的虚拟传感器推进可持续发展目标6.3.2,实现高频营养监测","authors":"Bongumenzi Ngwenya ,&nbsp;Thulane Paepae ,&nbsp;Pitshou N. Bokoro","doi":"10.1016/j.jwpe.2025.108831","DOIUrl":null,"url":null,"abstract":"<div><div>Reliable monitoring of Nitrogen and Phosphorus in ambient waters is critical for achieving Sustainable Development Goal (SDG) indicator 6.3.2, yet the high cost of in-situ nutrient sensors limits global data coverage, especially in low-middle-income countries (LMICs). This study presents a novel virtual sensing framework that replaces expensive nutrient sensors with Machine Learning models trained on affordable Baseline-Features (Dissolved Oxygen, pH, Electrical Conductivity) and enhanced with low-cost features (Turbidity, Temperature, Flow). To our knowledge, this is the first study to integrate the REFORMS checklist into the end-to-end development of virtual sensing for SDG 6.3.2 nutrient monitoring, ensuring transparency, reproducibility, and policy relevance. Using Extra Trees as the best performing model, rigorously benchmarked through LazyPredict, spot checking, and hyperparameter tuning (Grid Search, Randomized Search, Bayesian Optimization), the framework achieved state-of-the-art predictive accuracy (R<sup>2</sup> up to 0.98) across contrasting urban (The-Cut) and rural (River-Enborne) catchments. SHAP analysis further demonstrated interpretable feature contributions, with Electrical Conductivity and Turbidity consistently emerging as dominant drivers. The results establish that Baseline-Features are sufficient for stable rural systems, while urban systems require additional features to achieve SDG-compliant accuracy. Beyond technical performance, the study contributes policy recommendations for UNEP and LMIC agencies, including equivalency testing guidelines and capacity-building for national monitoring programs. This framework advances virtual sensing from research concept to an operationally viable tool for bridging nutrient data gaps in SDG 6.3.2 reporting.</div></div>","PeriodicalId":17528,"journal":{"name":"Journal of water process engineering","volume":"79 ","pages":"Article 108831"},"PeriodicalIF":6.7000,"publicationDate":"2025-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Advancing SDG 6.3.2 with machine learning-based virtual sensors for high-frequency nutrient monitoring\",\"authors\":\"Bongumenzi Ngwenya ,&nbsp;Thulane Paepae ,&nbsp;Pitshou N. Bokoro\",\"doi\":\"10.1016/j.jwpe.2025.108831\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Reliable monitoring of Nitrogen and Phosphorus in ambient waters is critical for achieving Sustainable Development Goal (SDG) indicator 6.3.2, yet the high cost of in-situ nutrient sensors limits global data coverage, especially in low-middle-income countries (LMICs). This study presents a novel virtual sensing framework that replaces expensive nutrient sensors with Machine Learning models trained on affordable Baseline-Features (Dissolved Oxygen, pH, Electrical Conductivity) and enhanced with low-cost features (Turbidity, Temperature, Flow). To our knowledge, this is the first study to integrate the REFORMS checklist into the end-to-end development of virtual sensing for SDG 6.3.2 nutrient monitoring, ensuring transparency, reproducibility, and policy relevance. Using Extra Trees as the best performing model, rigorously benchmarked through LazyPredict, spot checking, and hyperparameter tuning (Grid Search, Randomized Search, Bayesian Optimization), the framework achieved state-of-the-art predictive accuracy (R<sup>2</sup> up to 0.98) across contrasting urban (The-Cut) and rural (River-Enborne) catchments. SHAP analysis further demonstrated interpretable feature contributions, with Electrical Conductivity and Turbidity consistently emerging as dominant drivers. The results establish that Baseline-Features are sufficient for stable rural systems, while urban systems require additional features to achieve SDG-compliant accuracy. Beyond technical performance, the study contributes policy recommendations for UNEP and LMIC agencies, including equivalency testing guidelines and capacity-building for national monitoring programs. This framework advances virtual sensing from research concept to an operationally viable tool for bridging nutrient data gaps in SDG 6.3.2 reporting.</div></div>\",\"PeriodicalId\":17528,\"journal\":{\"name\":\"Journal of water process engineering\",\"volume\":\"79 \",\"pages\":\"Article 108831\"},\"PeriodicalIF\":6.7000,\"publicationDate\":\"2025-10-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of water process engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S221471442501904X\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CHEMICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of water process engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S221471442501904X","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CHEMICAL","Score":null,"Total":0}
引用次数: 0

摘要

环境水体中氮和磷的可靠监测对于实现可持续发展目标(SDG)指标6.3.2至关重要,但原位营养传感器的高成本限制了全球数据覆盖,特别是在中低收入国家。本研究提出了一种新的虚拟传感框架,该框架用机器学习模型取代昂贵的营养传感器,该模型训练于可负担得起的基线特征(溶解氧、pH值、电导率),并通过低成本特征(浊度、温度、流量)进行增强。据我们所知,这是第一个将改革清单整合到可持续发展目标6.3.2营养监测虚拟传感的端到端开发中的研究,以确保透明度、可重复性和政策相关性。使用Extra Trees作为表现最好的模型,通过LazyPredict、抽查和超参数调整(网格搜索、随机搜索、贝叶斯优化)进行严格的基准测试,该框架在对比城市(the- cut)和农村(River-Enborne)集水区中实现了最先进的预测精度(R2高达0.98)。SHAP分析进一步证明了可解释的特征贡献,电导率和浊度一直是主要的驱动因素。结果表明,基线特征足以满足稳定的农村系统,而城市系统需要额外的特征来实现符合可持续发展目标的准确性。除技术性能外,该研究还为联合国环境规划署和低收入和中等收入国家机构提供政策建议,包括等效性测试指南和国家监测方案的能力建设。该框架将虚拟传感从研究概念提升为一种可行的操作工具,用于弥合可持续发展目标6.3.2报告中的营养数据差距。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Advancing SDG 6.3.2 with machine learning-based virtual sensors for high-frequency nutrient monitoring
Reliable monitoring of Nitrogen and Phosphorus in ambient waters is critical for achieving Sustainable Development Goal (SDG) indicator 6.3.2, yet the high cost of in-situ nutrient sensors limits global data coverage, especially in low-middle-income countries (LMICs). This study presents a novel virtual sensing framework that replaces expensive nutrient sensors with Machine Learning models trained on affordable Baseline-Features (Dissolved Oxygen, pH, Electrical Conductivity) and enhanced with low-cost features (Turbidity, Temperature, Flow). To our knowledge, this is the first study to integrate the REFORMS checklist into the end-to-end development of virtual sensing for SDG 6.3.2 nutrient monitoring, ensuring transparency, reproducibility, and policy relevance. Using Extra Trees as the best performing model, rigorously benchmarked through LazyPredict, spot checking, and hyperparameter tuning (Grid Search, Randomized Search, Bayesian Optimization), the framework achieved state-of-the-art predictive accuracy (R2 up to 0.98) across contrasting urban (The-Cut) and rural (River-Enborne) catchments. SHAP analysis further demonstrated interpretable feature contributions, with Electrical Conductivity and Turbidity consistently emerging as dominant drivers. The results establish that Baseline-Features are sufficient for stable rural systems, while urban systems require additional features to achieve SDG-compliant accuracy. Beyond technical performance, the study contributes policy recommendations for UNEP and LMIC agencies, including equivalency testing guidelines and capacity-building for national monitoring programs. This framework advances virtual sensing from research concept to an operationally viable tool for bridging nutrient data gaps in SDG 6.3.2 reporting.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of water process engineering
Journal of water process engineering Biochemistry, Genetics and Molecular Biology-Biotechnology
CiteScore
10.70
自引率
8.60%
发文量
846
审稿时长
24 days
期刊介绍: The Journal of Water Process Engineering aims to publish refereed, high-quality research papers with significant novelty and impact in all areas of the engineering of water and wastewater processing . Papers on advanced and novel treatment processes and technologies are particularly welcome. The Journal considers papers in areas such as nanotechnology and biotechnology applications in water, novel oxidation and separation processes, membrane processes (except those for desalination) , catalytic processes for the removal of water contaminants, sustainable processes, water reuse and recycling, water use and wastewater minimization, integrated/hybrid technology, process modeling of water treatment and novel treatment processes. Submissions on the subject of adsorbents, including standard measurements of adsorption kinetics and equilibrium will only be considered if there is a genuine case for novelty and contribution, for example highly novel, sustainable adsorbents and their use: papers on activated carbon-type materials derived from natural matter, or surfactant-modified clays and related minerals, would not fulfil this criterion. The Journal particularly welcomes contributions involving environmentally, economically and socially sustainable technology for water treatment, including those which are energy-efficient, with minimal or no chemical consumption, and capable of water recycling and reuse that minimizes the direct disposal of wastewater to the aquatic environment. Papers that describe novel ideas for solving issues related to water quality and availability are also welcome, as are those that show the transfer of techniques from other disciplines. The Journal will consider papers dealing with processes for various water matrices including drinking water (except desalination), domestic, urban and industrial wastewaters, in addition to their residues. It is expected that the journal will be of particular relevance to chemical and process engineers working in the field. The Journal welcomes Full Text papers, Short Communications, State-of-the-Art Reviews and Letters to Editors and Case Studies
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信