新的贝叶斯和深度学习时空模型可以更有效地揭示传感器数据中的异常

IF 12.4 1区 环境科学与生态学 Q1 ENGINEERING, ENVIRONMENTAL
Edgar Santos-Fernandez , Simon Denman , Kerrie Mengersen
{"title":"新的贝叶斯和深度学习时空模型可以更有效地揭示传感器数据中的异常","authors":"Edgar Santos-Fernandez ,&nbsp;Simon Denman ,&nbsp;Kerrie Mengersen","doi":"10.1016/j.watres.2025.123928","DOIUrl":null,"url":null,"abstract":"<div><div>Environmental and water quality monitoring increasingly relies on high-frequency data streams from sensor networks, yet anomalies in these datasets can compromise their reliability. Here we introduce two novel unsupervised methods for anomaly detection in spatio-temporal sensor arrays specifically designed for highly structured datasets such as those obtained by networks of sensors in rivers. The first is a dynamic Bayesian spatio-temporal model using a reduced rank Gaussian process, and the second is a deep learning architecture called Spatio-Temporal Attention-based LSTM for River Networks. We rigorously evaluate both methods through comprehensive simulation benchmarks incorporating diverse anomaly types common in environmental data. Our comparative analysis reveals the strengths and limitations of each approach, demonstrating superior performance over existing methods in both accuracy and computational efficiency. We further introduce an ensemble method that synergistically combines the strengths of both approaches. Our framework addresses the growing need for robust, efficient algorithms and computational methods for monitoring complex ecosystems, advancing spatio-temporal anomaly detection in environmental applications. By providing detailed implementation guidelines and open-source code, we enable immediate application by ecological and environmental scientists and practitioners, facilitating improved monitoring and enhanced decision-making in river network management.</div></div>","PeriodicalId":443,"journal":{"name":"Water Research","volume":"286 ","pages":"Article 123928"},"PeriodicalIF":12.4000,"publicationDate":"2025-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"New Bayesian and deep learning spatio-temporal models can reveal anomalies in sensor data more effectively\",\"authors\":\"Edgar Santos-Fernandez ,&nbsp;Simon Denman ,&nbsp;Kerrie Mengersen\",\"doi\":\"10.1016/j.watres.2025.123928\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Environmental and water quality monitoring increasingly relies on high-frequency data streams from sensor networks, yet anomalies in these datasets can compromise their reliability. Here we introduce two novel unsupervised methods for anomaly detection in spatio-temporal sensor arrays specifically designed for highly structured datasets such as those obtained by networks of sensors in rivers. The first is a dynamic Bayesian spatio-temporal model using a reduced rank Gaussian process, and the second is a deep learning architecture called Spatio-Temporal Attention-based LSTM for River Networks. We rigorously evaluate both methods through comprehensive simulation benchmarks incorporating diverse anomaly types common in environmental data. Our comparative analysis reveals the strengths and limitations of each approach, demonstrating superior performance over existing methods in both accuracy and computational efficiency. We further introduce an ensemble method that synergistically combines the strengths of both approaches. Our framework addresses the growing need for robust, efficient algorithms and computational methods for monitoring complex ecosystems, advancing spatio-temporal anomaly detection in environmental applications. By providing detailed implementation guidelines and open-source code, we enable immediate application by ecological and environmental scientists and practitioners, facilitating improved monitoring and enhanced decision-making in river network management.</div></div>\",\"PeriodicalId\":443,\"journal\":{\"name\":\"Water Research\",\"volume\":\"286 \",\"pages\":\"Article 123928\"},\"PeriodicalIF\":12.4000,\"publicationDate\":\"2025-07-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Water Research\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S004313542500836X\",\"RegionNum\":1,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ENVIRONMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Water Research","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S004313542500836X","RegionNum":1,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ENVIRONMENTAL","Score":null,"Total":0}
引用次数: 0

摘要

环境和水质监测越来越依赖于来自传感器网络的高频数据流,然而这些数据集的异常可能会损害其可靠性。在这里,我们介绍了两种新的无监督方法,用于时空传感器阵列的异常检测,这是专门为高度结构化的数据集(如河流传感器网络获得的数据集)设计的。第一个是使用降阶高斯过程的动态贝叶斯时空模型,第二个是一种深度学习架构,称为基于时空注意力的河流网络LSTM。我们通过综合模拟基准,结合环境数据中常见的各种异常类型,严格评估了这两种方法。我们的比较分析揭示了每种方法的优势和局限性,在准确性和计算效率方面都优于现有方法。我们进一步介绍了一种集成方法,它协同地结合了两种方法的优势。我们的框架解决了对监测复杂生态系统的鲁棒、高效算法和计算方法日益增长的需求,推进了环境应用中的时空异常检测。通过提供详细的实施指南和开源代码,我们可以让生态环境科学家和从业者立即应用,促进河网管理的监测和决策。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
New Bayesian and deep learning spatio-temporal models can reveal anomalies in sensor data more effectively
Environmental and water quality monitoring increasingly relies on high-frequency data streams from sensor networks, yet anomalies in these datasets can compromise their reliability. Here we introduce two novel unsupervised methods for anomaly detection in spatio-temporal sensor arrays specifically designed for highly structured datasets such as those obtained by networks of sensors in rivers. The first is a dynamic Bayesian spatio-temporal model using a reduced rank Gaussian process, and the second is a deep learning architecture called Spatio-Temporal Attention-based LSTM for River Networks. We rigorously evaluate both methods through comprehensive simulation benchmarks incorporating diverse anomaly types common in environmental data. Our comparative analysis reveals the strengths and limitations of each approach, demonstrating superior performance over existing methods in both accuracy and computational efficiency. We further introduce an ensemble method that synergistically combines the strengths of both approaches. Our framework addresses the growing need for robust, efficient algorithms and computational methods for monitoring complex ecosystems, advancing spatio-temporal anomaly detection in environmental applications. By providing detailed implementation guidelines and open-source code, we enable immediate application by ecological and environmental scientists and practitioners, facilitating improved monitoring and enhanced decision-making in river network management.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Water Research
Water Research 环境科学-工程:环境
CiteScore
20.80
自引率
9.40%
发文量
1307
审稿时长
38 days
期刊介绍: Water Research, along with its open access companion journal Water Research X, serves as a platform for publishing original research papers covering various aspects of the science and technology related to the anthropogenic water cycle, water quality, and its management worldwide. The audience targeted by the journal comprises biologists, chemical engineers, chemists, civil engineers, environmental engineers, limnologists, and microbiologists. The scope of the journal include: •Treatment processes for water and wastewaters (municipal, agricultural, industrial, and on-site treatment), including resource recovery and residuals management; •Urban hydrology including sewer systems, stormwater management, and green infrastructure; •Drinking water treatment and distribution; •Potable and non-potable water reuse; •Sanitation, public health, and risk assessment; •Anaerobic digestion, solid and hazardous waste management, including source characterization and the effects and control of leachates and gaseous emissions; •Contaminants (chemical, microbial, anthropogenic particles such as nanoparticles or microplastics) and related water quality sensing, monitoring, fate, and assessment; •Anthropogenic impacts on inland, tidal, coastal and urban waters, focusing on surface and ground waters, and point and non-point sources of pollution; •Environmental restoration, linked to surface water, groundwater and groundwater remediation; •Analysis of the interfaces between sediments and water, and between water and atmosphere, focusing specifically on anthropogenic impacts; •Mathematical modelling, systems analysis, machine learning, and beneficial use of big data related to the anthropogenic water cycle; •Socio-economic, policy, and regulations studies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信