{"title":"监测污水处理厂分析参数的异常检测模型的构思与评估","authors":"P. Oliveira, M. Salomé Duarte, Paulo Novais","doi":"10.3233/aic-230064","DOIUrl":null,"url":null,"abstract":"The exponential growth of technology in recent decades has led to the emergence of some challenges inherent to this growth. One of these challenges is the enormous amount of data collected by the different sensors in our society, namely in management processes such as Wastewater Treatment Plants (WWTPs). These infrastructures comprise several processes to treat wastewater and discharge clean water in water courses. Therefore, the concentration of pollutants must be below the allowable emissions limits. In this work, anomaly detection models were conceived, tuned and evaluated to monitor essential parameters such as nitrate and ammonia concentrations and pH to improve WWTP management. Four Machine Learning models were considered, particularly Local Outlier Fraction, Isolation Forest, One-Class Support Vector Machines and Long Short-Term Memory-Autoencoders (LSTM-AE), to detect anomalies in the three parameters mentioned. Through the different experiments, it was possible to verify that, in terms of F1-Score, the best candidate model for the three analyzed parameters was LSTM-AE-based, with a value consistently higher than 97%.","PeriodicalId":50835,"journal":{"name":"AI Communications","volume":"53 1","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2023-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Conception and evaluation of anomaly detection models for monitoring analytical parameters in wastewater treatment plants\",\"authors\":\"P. Oliveira, M. Salomé Duarte, Paulo Novais\",\"doi\":\"10.3233/aic-230064\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The exponential growth of technology in recent decades has led to the emergence of some challenges inherent to this growth. One of these challenges is the enormous amount of data collected by the different sensors in our society, namely in management processes such as Wastewater Treatment Plants (WWTPs). These infrastructures comprise several processes to treat wastewater and discharge clean water in water courses. Therefore, the concentration of pollutants must be below the allowable emissions limits. In this work, anomaly detection models were conceived, tuned and evaluated to monitor essential parameters such as nitrate and ammonia concentrations and pH to improve WWTP management. Four Machine Learning models were considered, particularly Local Outlier Fraction, Isolation Forest, One-Class Support Vector Machines and Long Short-Term Memory-Autoencoders (LSTM-AE), to detect anomalies in the three parameters mentioned. Through the different experiments, it was possible to verify that, in terms of F1-Score, the best candidate model for the three analyzed parameters was LSTM-AE-based, with a value consistently higher than 97%.\",\"PeriodicalId\":50835,\"journal\":{\"name\":\"AI Communications\",\"volume\":\"53 1\",\"pages\":\"\"},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2023-12-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"AI Communications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.3233/aic-230064\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"AI Communications","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.3233/aic-230064","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
摘要
近几十年来,技术呈指数级增长,由此带来了一些固有的挑战。其中一个挑战是社会中不同传感器收集的大量数据,即污水处理厂(WWTP)等管理过程中的数据。这些基础设施包括处理废水和向水道排放清洁水的多个过程。因此,污染物的浓度必须低于允许的排放限值。在这项工作中,对异常检测模型进行了构思、调整和评估,以监测硝酸盐、氨浓度和 pH 值等重要参数,从而改善污水处理厂的管理。考虑了四种机器学习模型,特别是局部离群分数、隔离森林、单类支持向量机和长短期记忆自动编码器(LSTM-AE),以检测上述三个参数中的异常情况。通过不同的实验,可以验证就 F1 分数而言,三个分析参数的最佳候选模型是基于 LSTM-AE 的,其值始终高于 97%。
Conception and evaluation of anomaly detection models for monitoring analytical parameters in wastewater treatment plants
The exponential growth of technology in recent decades has led to the emergence of some challenges inherent to this growth. One of these challenges is the enormous amount of data collected by the different sensors in our society, namely in management processes such as Wastewater Treatment Plants (WWTPs). These infrastructures comprise several processes to treat wastewater and discharge clean water in water courses. Therefore, the concentration of pollutants must be below the allowable emissions limits. In this work, anomaly detection models were conceived, tuned and evaluated to monitor essential parameters such as nitrate and ammonia concentrations and pH to improve WWTP management. Four Machine Learning models were considered, particularly Local Outlier Fraction, Isolation Forest, One-Class Support Vector Machines and Long Short-Term Memory-Autoencoders (LSTM-AE), to detect anomalies in the three parameters mentioned. Through the different experiments, it was possible to verify that, in terms of F1-Score, the best candidate model for the three analyzed parameters was LSTM-AE-based, with a value consistently higher than 97%.
期刊介绍:
AI Communications is a journal on artificial intelligence (AI) which has a close relationship to EurAI (European Association for Artificial Intelligence, formerly ECCAI). It covers the whole AI community: Scientific institutions as well as commercial and industrial companies.
AI Communications aims to enhance contacts and information exchange between AI researchers and developers, and to provide supranational information to those concerned with AI and advanced information processing. AI Communications publishes refereed articles concerning scientific and technical AI procedures, provided they are of sufficient interest to a large readership of both scientific and practical background. In addition it contains high-level background material, both at the technical level as well as the level of opinions, policies and news.