Edgar Santos-Fernandez , Simon Denman , Kerrie Mengersen
{"title":"新的贝叶斯和深度学习时空模型可以更有效地揭示传感器数据中的异常","authors":"Edgar Santos-Fernandez , Simon Denman , Kerrie Mengersen","doi":"10.1016/j.watres.2025.123928","DOIUrl":null,"url":null,"abstract":"<div><div>Environmental and water quality monitoring increasingly relies on high-frequency data streams from sensor networks, yet anomalies in these datasets can compromise their reliability. Here we introduce two novel unsupervised methods for anomaly detection in spatio-temporal sensor arrays specifically designed for highly structured datasets such as those obtained by networks of sensors in rivers. The first is a dynamic Bayesian spatio-temporal model using a reduced rank Gaussian process, and the second is a deep learning architecture called Spatio-Temporal Attention-based LSTM for River Networks. We rigorously evaluate both methods through comprehensive simulation benchmarks incorporating diverse anomaly types common in environmental data. Our comparative analysis reveals the strengths and limitations of each approach, demonstrating superior performance over existing methods in both accuracy and computational efficiency. We further introduce an ensemble method that synergistically combines the strengths of both approaches. Our framework addresses the growing need for robust, efficient algorithms and computational methods for monitoring complex ecosystems, advancing spatio-temporal anomaly detection in environmental applications. By providing detailed implementation guidelines and open-source code, we enable immediate application by ecological and environmental scientists and practitioners, facilitating improved monitoring and enhanced decision-making in river network management.</div></div>","PeriodicalId":443,"journal":{"name":"Water Research","volume":"286 ","pages":"Article 123928"},"PeriodicalIF":12.4000,"publicationDate":"2025-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"New Bayesian and deep learning spatio-temporal models can reveal anomalies in sensor data more effectively\",\"authors\":\"Edgar Santos-Fernandez , Simon Denman , Kerrie Mengersen\",\"doi\":\"10.1016/j.watres.2025.123928\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Environmental and water quality monitoring increasingly relies on high-frequency data streams from sensor networks, yet anomalies in these datasets can compromise their reliability. Here we introduce two novel unsupervised methods for anomaly detection in spatio-temporal sensor arrays specifically designed for highly structured datasets such as those obtained by networks of sensors in rivers. The first is a dynamic Bayesian spatio-temporal model using a reduced rank Gaussian process, and the second is a deep learning architecture called Spatio-Temporal Attention-based LSTM for River Networks. We rigorously evaluate both methods through comprehensive simulation benchmarks incorporating diverse anomaly types common in environmental data. Our comparative analysis reveals the strengths and limitations of each approach, demonstrating superior performance over existing methods in both accuracy and computational efficiency. We further introduce an ensemble method that synergistically combines the strengths of both approaches. Our framework addresses the growing need for robust, efficient algorithms and computational methods for monitoring complex ecosystems, advancing spatio-temporal anomaly detection in environmental applications. By providing detailed implementation guidelines and open-source code, we enable immediate application by ecological and environmental scientists and practitioners, facilitating improved monitoring and enhanced decision-making in river network management.</div></div>\",\"PeriodicalId\":443,\"journal\":{\"name\":\"Water Research\",\"volume\":\"286 \",\"pages\":\"Article 123928\"},\"PeriodicalIF\":12.4000,\"publicationDate\":\"2025-07-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Water Research\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S004313542500836X\",\"RegionNum\":1,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ENVIRONMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Water Research","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S004313542500836X","RegionNum":1,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ENVIRONMENTAL","Score":null,"Total":0}
New Bayesian and deep learning spatio-temporal models can reveal anomalies in sensor data more effectively
Environmental and water quality monitoring increasingly relies on high-frequency data streams from sensor networks, yet anomalies in these datasets can compromise their reliability. Here we introduce two novel unsupervised methods for anomaly detection in spatio-temporal sensor arrays specifically designed for highly structured datasets such as those obtained by networks of sensors in rivers. The first is a dynamic Bayesian spatio-temporal model using a reduced rank Gaussian process, and the second is a deep learning architecture called Spatio-Temporal Attention-based LSTM for River Networks. We rigorously evaluate both methods through comprehensive simulation benchmarks incorporating diverse anomaly types common in environmental data. Our comparative analysis reveals the strengths and limitations of each approach, demonstrating superior performance over existing methods in both accuracy and computational efficiency. We further introduce an ensemble method that synergistically combines the strengths of both approaches. Our framework addresses the growing need for robust, efficient algorithms and computational methods for monitoring complex ecosystems, advancing spatio-temporal anomaly detection in environmental applications. By providing detailed implementation guidelines and open-source code, we enable immediate application by ecological and environmental scientists and practitioners, facilitating improved monitoring and enhanced decision-making in river network management.
期刊介绍:
Water Research, along with its open access companion journal Water Research X, serves as a platform for publishing original research papers covering various aspects of the science and technology related to the anthropogenic water cycle, water quality, and its management worldwide. The audience targeted by the journal comprises biologists, chemical engineers, chemists, civil engineers, environmental engineers, limnologists, and microbiologists. The scope of the journal include:
•Treatment processes for water and wastewaters (municipal, agricultural, industrial, and on-site treatment), including resource recovery and residuals management;
•Urban hydrology including sewer systems, stormwater management, and green infrastructure;
•Drinking water treatment and distribution;
•Potable and non-potable water reuse;
•Sanitation, public health, and risk assessment;
•Anaerobic digestion, solid and hazardous waste management, including source characterization and the effects and control of leachates and gaseous emissions;
•Contaminants (chemical, microbial, anthropogenic particles such as nanoparticles or microplastics) and related water quality sensing, monitoring, fate, and assessment;
•Anthropogenic impacts on inland, tidal, coastal and urban waters, focusing on surface and ground waters, and point and non-point sources of pollution;
•Environmental restoration, linked to surface water, groundwater and groundwater remediation;
•Analysis of the interfaces between sediments and water, and between water and atmosphere, focusing specifically on anthropogenic impacts;
•Mathematical modelling, systems analysis, machine learning, and beneficial use of big data related to the anthropogenic water cycle;
•Socio-economic, policy, and regulations studies.