Moving forward in water distribution network leak identification through an innovative features engineering step

IF 3 3区 工程技术 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Elvio Damonti, Giancarlo Bernasconi
{"title":"Moving forward in water distribution network leak identification through an innovative features engineering step","authors":"Elvio Damonti,&nbsp;Giancarlo Bernasconi","doi":"10.1016/j.dsp.2025.105603","DOIUrl":null,"url":null,"abstract":"<div><div>In Italy an average of 40% of the water in transit in Water Distribution Networks (WDNs) is lost, which represents a significant economic loss, and, because of the corresponding energy waste, also a considerable environmental damage. Over the years various methods have been developed for detecting and locating leaks in WDNs, and, in particular, several algorithms have been implemented that use Convolutional Neural Networks (CNNs). They are all based on a training phase run on a representative subset of the WDN data, and the main differences between the various implementations are in the data pre-processing and in the CNN configuration. This paper proposes a new fully Data-Driven approach, where a preliminar features engineering step, performed by a visual analysis of specific data patterns, both in the time domain and in the Fourier domain, allowed us to conceive and identify two paramount features engineering steps: a new effective data pre-processing algorythm and a new configuration of CNN that uses an Overcomplete Autoencoder (Overcomplete AE) topology with residual blocks. These two steps, described in detail in this paper, allowed us to better highlight and identify the anomalies caused by leaks in WDN pressures time series and they permitted, in association with a new original automatic analysis of the reconstruction error made by the Autoencoder, to achieve results that are on the top of the current state of art. Specifically, the whole innovative method is presented in detail exploiting publicly available data, so to be easily reproducible, and, more specifically, for this purpose, the benchmark was run on a synthetic 'LeakDB' dataset of 500 scenarios and the outcomes were then validated through different data obtained from a second and more complex synthetic 'LeakDB' dataset containing 1000 scenarios. Both these datasets are related to a District Metering Area (DMA) of the Hanoi WDN and both are publicly available.</div></div>","PeriodicalId":51011,"journal":{"name":"Digital Signal Processing","volume":"168 ","pages":"Article 105603"},"PeriodicalIF":3.0000,"publicationDate":"2025-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1051200425006256","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

In Italy an average of 40% of the water in transit in Water Distribution Networks (WDNs) is lost, which represents a significant economic loss, and, because of the corresponding energy waste, also a considerable environmental damage. Over the years various methods have been developed for detecting and locating leaks in WDNs, and, in particular, several algorithms have been implemented that use Convolutional Neural Networks (CNNs). They are all based on a training phase run on a representative subset of the WDN data, and the main differences between the various implementations are in the data pre-processing and in the CNN configuration. This paper proposes a new fully Data-Driven approach, where a preliminar features engineering step, performed by a visual analysis of specific data patterns, both in the time domain and in the Fourier domain, allowed us to conceive and identify two paramount features engineering steps: a new effective data pre-processing algorythm and a new configuration of CNN that uses an Overcomplete Autoencoder (Overcomplete AE) topology with residual blocks. These two steps, described in detail in this paper, allowed us to better highlight and identify the anomalies caused by leaks in WDN pressures time series and they permitted, in association with a new original automatic analysis of the reconstruction error made by the Autoencoder, to achieve results that are on the top of the current state of art. Specifically, the whole innovative method is presented in detail exploiting publicly available data, so to be easily reproducible, and, more specifically, for this purpose, the benchmark was run on a synthetic 'LeakDB' dataset of 500 scenarios and the outcomes were then validated through different data obtained from a second and more complex synthetic 'LeakDB' dataset containing 1000 scenarios. Both these datasets are related to a District Metering Area (DMA) of the Hanoi WDN and both are publicly available.
创新特征工程在配水管网泄漏识别中的应用
在意大利,平均有40%的输水管网(wdn)的输水损失,这意味着巨大的经济损失,而且由于相应的能源浪费,也造成了相当大的环境破坏。多年来,人们开发了各种方法来检测和定位wdn中的泄漏,特别是使用卷积神经网络(cnn)实现了几种算法。它们都是基于在WDN数据的代表性子集上运行的训练阶段,各种实现之间的主要区别在于数据预处理和CNN配置。本文提出了一种新的完全数据驱动的方法,其中初步的特征工程步骤,通过在时域和傅立叶域中对特定数据模式进行可视化分析来执行,使我们能够构思和确定两个最重要的特征工程步骤:一种新的有效数据预处理算法和一种新的CNN配置,该配置使用带有残差块的Overcomplete Autoencoder (Overcomplete AE)拓扑。本文详细描述了这两个步骤,使我们能够更好地突出和识别由WDN压力时间序列中的泄漏引起的异常,并且它们允许与Autoencoder对重建误差的新原始自动分析相结合,以获得当前最先进的结果。具体来说,整个创新方法详细介绍了利用公开可用的数据,以便易于再现,更具体地说,为此目的,在包含500个场景的合成“LeakDB”数据集上运行基准测试,然后通过从包含1000个场景的第二个更复杂的合成“LeakDB”数据集获得的不同数据验证结果。这两个数据集都与河内WDN的区域计量区(DMA)有关,并且都是公开的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Digital Signal Processing
Digital Signal Processing 工程技术-工程:电子与电气
CiteScore
5.30
自引率
17.20%
发文量
435
审稿时长
66 days
期刊介绍: Digital Signal Processing: A Review Journal is one of the oldest and most established journals in the field of signal processing yet it aims to be the most innovative. The Journal invites top quality research articles at the frontiers of research in all aspects of signal processing. Our objective is to provide a platform for the publication of ground-breaking research in signal processing with both academic and industrial appeal. The journal has a special emphasis on statistical signal processing methodology such as Bayesian signal processing, and encourages articles on emerging applications of signal processing such as: • big data• machine learning• internet of things• information security• systems biology and computational biology,• financial time series analysis,• autonomous vehicles,• quantum computing,• neuromorphic engineering,• human-computer interaction and intelligent user interfaces,• environmental signal processing,• geophysical signal processing including seismic signal processing,• chemioinformatics and bioinformatics,• audio, visual and performance arts,• disaster management and prevention,• renewable energy,
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信