监测污水处理厂分析参数的异常检测模型的构思与评估

IF 1.4 4区 计算机科学 Q4 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
P. Oliveira, M. Salomé Duarte, Paulo Novais
{"title":"监测污水处理厂分析参数的异常检测模型的构思与评估","authors":"P. Oliveira, M. Salomé Duarte, Paulo Novais","doi":"10.3233/aic-230064","DOIUrl":null,"url":null,"abstract":"The exponential growth of technology in recent decades has led to the emergence of some challenges inherent to this growth. One of these challenges is the enormous amount of data collected by the different sensors in our society, namely in management processes such as Wastewater Treatment Plants (WWTPs). These infrastructures comprise several processes to treat wastewater and discharge clean water in water courses. Therefore, the concentration of pollutants must be below the allowable emissions limits. In this work, anomaly detection models were conceived, tuned and evaluated to monitor essential parameters such as nitrate and ammonia concentrations and pH to improve WWTP management. Four Machine Learning models were considered, particularly Local Outlier Fraction, Isolation Forest, One-Class Support Vector Machines and Long Short-Term Memory-Autoencoders (LSTM-AE), to detect anomalies in the three parameters mentioned. Through the different experiments, it was possible to verify that, in terms of F1-Score, the best candidate model for the three analyzed parameters was LSTM-AE-based, with a value consistently higher than 97%.","PeriodicalId":50835,"journal":{"name":"AI Communications","volume":"53 1","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2023-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Conception and evaluation of anomaly detection models for monitoring analytical parameters in wastewater treatment plants\",\"authors\":\"P. Oliveira, M. Salomé Duarte, Paulo Novais\",\"doi\":\"10.3233/aic-230064\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The exponential growth of technology in recent decades has led to the emergence of some challenges inherent to this growth. One of these challenges is the enormous amount of data collected by the different sensors in our society, namely in management processes such as Wastewater Treatment Plants (WWTPs). These infrastructures comprise several processes to treat wastewater and discharge clean water in water courses. Therefore, the concentration of pollutants must be below the allowable emissions limits. In this work, anomaly detection models were conceived, tuned and evaluated to monitor essential parameters such as nitrate and ammonia concentrations and pH to improve WWTP management. Four Machine Learning models were considered, particularly Local Outlier Fraction, Isolation Forest, One-Class Support Vector Machines and Long Short-Term Memory-Autoencoders (LSTM-AE), to detect anomalies in the three parameters mentioned. Through the different experiments, it was possible to verify that, in terms of F1-Score, the best candidate model for the three analyzed parameters was LSTM-AE-based, with a value consistently higher than 97%.\",\"PeriodicalId\":50835,\"journal\":{\"name\":\"AI Communications\",\"volume\":\"53 1\",\"pages\":\"\"},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2023-12-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"AI Communications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.3233/aic-230064\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"AI Communications","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.3233/aic-230064","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

近几十年来,技术呈指数级增长,由此带来了一些固有的挑战。其中一个挑战是社会中不同传感器收集的大量数据,即污水处理厂(WWTP)等管理过程中的数据。这些基础设施包括处理废水和向水道排放清洁水的多个过程。因此,污染物的浓度必须低于允许的排放限值。在这项工作中,对异常检测模型进行了构思、调整和评估,以监测硝酸盐、氨浓度和 pH 值等重要参数,从而改善污水处理厂的管理。考虑了四种机器学习模型,特别是局部离群分数、隔离森林、单类支持向量机和长短期记忆自动编码器(LSTM-AE),以检测上述三个参数中的异常情况。通过不同的实验,可以验证就 F1 分数而言,三个分析参数的最佳候选模型是基于 LSTM-AE 的,其值始终高于 97%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Conception and evaluation of anomaly detection models for monitoring analytical parameters in wastewater treatment plants
The exponential growth of technology in recent decades has led to the emergence of some challenges inherent to this growth. One of these challenges is the enormous amount of data collected by the different sensors in our society, namely in management processes such as Wastewater Treatment Plants (WWTPs). These infrastructures comprise several processes to treat wastewater and discharge clean water in water courses. Therefore, the concentration of pollutants must be below the allowable emissions limits. In this work, anomaly detection models were conceived, tuned and evaluated to monitor essential parameters such as nitrate and ammonia concentrations and pH to improve WWTP management. Four Machine Learning models were considered, particularly Local Outlier Fraction, Isolation Forest, One-Class Support Vector Machines and Long Short-Term Memory-Autoencoders (LSTM-AE), to detect anomalies in the three parameters mentioned. Through the different experiments, it was possible to verify that, in terms of F1-Score, the best candidate model for the three analyzed parameters was LSTM-AE-based, with a value consistently higher than 97%.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
AI Communications
AI Communications 工程技术-计算机:人工智能
CiteScore
2.30
自引率
12.50%
发文量
34
审稿时长
4.5 months
期刊介绍: AI Communications is a journal on artificial intelligence (AI) which has a close relationship to EurAI (European Association for Artificial Intelligence, formerly ECCAI). It covers the whole AI community: Scientific institutions as well as commercial and industrial companies. AI Communications aims to enhance contacts and information exchange between AI researchers and developers, and to provide supranational information to those concerned with AI and advanced information processing. AI Communications publishes refereed articles concerning scientific and technical AI procedures, provided they are of sufficient interest to a large readership of both scientific and practical background. In addition it contains high-level background material, both at the technical level as well as the level of opinions, policies and news.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信