Enhancing surface water quality prediction in data-scarce sites using transfer learning and neural networks

IF 6.3 2区 工程技术 Q1 ENGINEERING, CHEMICAL
Zhenliang Liao , Xuan Wang , Wenchong Tian , Wanying Xie
{"title":"Enhancing surface water quality prediction in data-scarce sites using transfer learning and neural networks","authors":"Zhenliang Liao ,&nbsp;Xuan Wang ,&nbsp;Wenchong Tian ,&nbsp;Wanying Xie","doi":"10.1016/j.jwpe.2025.107923","DOIUrl":null,"url":null,"abstract":"<div><div>Surface water quality prediction is essential for effective water treatment, pollution control, and regulatory compliance. However, neural network (NN)-based predictions are significantly constrained by the limited availability of high-quality training data at newly established or data-scarce monitoring stations. This study innovatively addresses this challenge by employing Transfer Learning (TL) to leverage existing knowledge from data-rich monitoring sites, aiming to improve predictive performance under conditions of data scarcity. To systematically enhance TL effectiveness, we developed and comprehensively evaluated six novel Similarity Measurement Indexes (SMIs) designed explicitly for optimal source domain selection. A case study involving five monitoring stations in Southern China demonstrated that the proposed TL methodology significantly improved prediction accuracy, achieving a substantial reduction of up to 79.9 % in RMSE compared with models trained solely on limited local data. Among the newly introduced SMIs, the <em>P-RMSER</em> and <em>Distance</em> indexes emerged as highly effective tools for identifying the most suitable source domains. Furthermore, we found that the selection of TL hyperparameters—particularly the number of frozen layers and fine-tuning learning rate—was critical in further optimizing predictive performance. These findings offer innovative practical guidelines and methodological advancements for achieving robust water quality forecasting in data-scarce environments.</div></div>","PeriodicalId":17528,"journal":{"name":"Journal of water process engineering","volume":"75 ","pages":"Article 107923"},"PeriodicalIF":6.3000,"publicationDate":"2025-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of water process engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S221471442500995X","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CHEMICAL","Score":null,"Total":0}
引用次数: 0

Abstract

Surface water quality prediction is essential for effective water treatment, pollution control, and regulatory compliance. However, neural network (NN)-based predictions are significantly constrained by the limited availability of high-quality training data at newly established or data-scarce monitoring stations. This study innovatively addresses this challenge by employing Transfer Learning (TL) to leverage existing knowledge from data-rich monitoring sites, aiming to improve predictive performance under conditions of data scarcity. To systematically enhance TL effectiveness, we developed and comprehensively evaluated six novel Similarity Measurement Indexes (SMIs) designed explicitly for optimal source domain selection. A case study involving five monitoring stations in Southern China demonstrated that the proposed TL methodology significantly improved prediction accuracy, achieving a substantial reduction of up to 79.9 % in RMSE compared with models trained solely on limited local data. Among the newly introduced SMIs, the P-RMSER and Distance indexes emerged as highly effective tools for identifying the most suitable source domains. Furthermore, we found that the selection of TL hyperparameters—particularly the number of frozen layers and fine-tuning learning rate—was critical in further optimizing predictive performance. These findings offer innovative practical guidelines and methodological advancements for achieving robust water quality forecasting in data-scarce environments.
基于迁移学习和神经网络的地表水水质预测研究
地表水水质预测是有效的水处理、污染控制和法规遵从的必要条件。然而,基于神经网络(NN)的预测受到新建立的或数据稀缺的监测站高质量训练数据可用性的限制。本研究创新性地解决了这一挑战,利用迁移学习(TL)来利用来自数据丰富的监测站点的现有知识,旨在提高数据稀缺条件下的预测性能。为了系统地提高TL的有效性,我们开发并综合评估了六个新的相似性度量指标(SMIs),这些指标是明确设计用于最优源域选择的。一项涉及中国南方5个监测站的案例研究表明,所提出的TL方法显著提高了预测精度,与仅基于有限当地数据训练的模型相比,RMSE大幅降低了79.9%。在新引入的SMIs中,P-RMSER和距离指数成为识别最合适源域的高效工具。此外,我们发现TL超参数的选择——特别是冻结层的数量和微调学习率——对于进一步优化预测性能至关重要。这些发现为在数据匮乏的环境中实现可靠的水质预测提供了创新的实用指南和方法进步。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of water process engineering
Journal of water process engineering Biochemistry, Genetics and Molecular Biology-Biotechnology
CiteScore
10.70
自引率
8.60%
发文量
846
审稿时长
24 days
期刊介绍: The Journal of Water Process Engineering aims to publish refereed, high-quality research papers with significant novelty and impact in all areas of the engineering of water and wastewater processing . Papers on advanced and novel treatment processes and technologies are particularly welcome. The Journal considers papers in areas such as nanotechnology and biotechnology applications in water, novel oxidation and separation processes, membrane processes (except those for desalination) , catalytic processes for the removal of water contaminants, sustainable processes, water reuse and recycling, water use and wastewater minimization, integrated/hybrid technology, process modeling of water treatment and novel treatment processes. Submissions on the subject of adsorbents, including standard measurements of adsorption kinetics and equilibrium will only be considered if there is a genuine case for novelty and contribution, for example highly novel, sustainable adsorbents and their use: papers on activated carbon-type materials derived from natural matter, or surfactant-modified clays and related minerals, would not fulfil this criterion. The Journal particularly welcomes contributions involving environmentally, economically and socially sustainable technology for water treatment, including those which are energy-efficient, with minimal or no chemical consumption, and capable of water recycling and reuse that minimizes the direct disposal of wastewater to the aquatic environment. Papers that describe novel ideas for solving issues related to water quality and availability are also welcome, as are those that show the transfer of techniques from other disciplines. The Journal will consider papers dealing with processes for various water matrices including drinking water (except desalination), domestic, urban and industrial wastewaters, in addition to their residues. It is expected that the journal will be of particular relevance to chemical and process engineers working in the field. The Journal welcomes Full Text papers, Short Communications, State-of-the-Art Reviews and Letters to Editors and Case Studies
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信