{"title":"创新特征工程在配水管网泄漏识别中的应用","authors":"Elvio Damonti, Giancarlo Bernasconi","doi":"10.1016/j.dsp.2025.105603","DOIUrl":null,"url":null,"abstract":"<div><div>In Italy an average of 40% of the water in transit in Water Distribution Networks (WDNs) is lost, which represents a significant economic loss, and, because of the corresponding energy waste, also a considerable environmental damage. Over the years various methods have been developed for detecting and locating leaks in WDNs, and, in particular, several algorithms have been implemented that use Convolutional Neural Networks (CNNs). They are all based on a training phase run on a representative subset of the WDN data, and the main differences between the various implementations are in the data pre-processing and in the CNN configuration. This paper proposes a new fully Data-Driven approach, where a preliminar features engineering step, performed by a visual analysis of specific data patterns, both in the time domain and in the Fourier domain, allowed us to conceive and identify two paramount features engineering steps: a new effective data pre-processing algorythm and a new configuration of CNN that uses an Overcomplete Autoencoder (Overcomplete AE) topology with residual blocks. These two steps, described in detail in this paper, allowed us to better highlight and identify the anomalies caused by leaks in WDN pressures time series and they permitted, in association with a new original automatic analysis of the reconstruction error made by the Autoencoder, to achieve results that are on the top of the current state of art. Specifically, the whole innovative method is presented in detail exploiting publicly available data, so to be easily reproducible, and, more specifically, for this purpose, the benchmark was run on a synthetic 'LeakDB' dataset of 500 scenarios and the outcomes were then validated through different data obtained from a second and more complex synthetic 'LeakDB' dataset containing 1000 scenarios. Both these datasets are related to a District Metering Area (DMA) of the Hanoi WDN and both are publicly available.</div></div>","PeriodicalId":51011,"journal":{"name":"Digital Signal Processing","volume":"168 ","pages":"Article 105603"},"PeriodicalIF":3.0000,"publicationDate":"2025-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Moving forward in water distribution network leak identification through an innovative features engineering step\",\"authors\":\"Elvio Damonti, Giancarlo Bernasconi\",\"doi\":\"10.1016/j.dsp.2025.105603\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In Italy an average of 40% of the water in transit in Water Distribution Networks (WDNs) is lost, which represents a significant economic loss, and, because of the corresponding energy waste, also a considerable environmental damage. Over the years various methods have been developed for detecting and locating leaks in WDNs, and, in particular, several algorithms have been implemented that use Convolutional Neural Networks (CNNs). They are all based on a training phase run on a representative subset of the WDN data, and the main differences between the various implementations are in the data pre-processing and in the CNN configuration. This paper proposes a new fully Data-Driven approach, where a preliminar features engineering step, performed by a visual analysis of specific data patterns, both in the time domain and in the Fourier domain, allowed us to conceive and identify two paramount features engineering steps: a new effective data pre-processing algorythm and a new configuration of CNN that uses an Overcomplete Autoencoder (Overcomplete AE) topology with residual blocks. These two steps, described in detail in this paper, allowed us to better highlight and identify the anomalies caused by leaks in WDN pressures time series and they permitted, in association with a new original automatic analysis of the reconstruction error made by the Autoencoder, to achieve results that are on the top of the current state of art. Specifically, the whole innovative method is presented in detail exploiting publicly available data, so to be easily reproducible, and, more specifically, for this purpose, the benchmark was run on a synthetic 'LeakDB' dataset of 500 scenarios and the outcomes were then validated through different data obtained from a second and more complex synthetic 'LeakDB' dataset containing 1000 scenarios. Both these datasets are related to a District Metering Area (DMA) of the Hanoi WDN and both are publicly available.</div></div>\",\"PeriodicalId\":51011,\"journal\":{\"name\":\"Digital Signal Processing\",\"volume\":\"168 \",\"pages\":\"Article 105603\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2025-09-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Digital Signal Processing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1051200425006256\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1051200425006256","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Moving forward in water distribution network leak identification through an innovative features engineering step
In Italy an average of 40% of the water in transit in Water Distribution Networks (WDNs) is lost, which represents a significant economic loss, and, because of the corresponding energy waste, also a considerable environmental damage. Over the years various methods have been developed for detecting and locating leaks in WDNs, and, in particular, several algorithms have been implemented that use Convolutional Neural Networks (CNNs). They are all based on a training phase run on a representative subset of the WDN data, and the main differences between the various implementations are in the data pre-processing and in the CNN configuration. This paper proposes a new fully Data-Driven approach, where a preliminar features engineering step, performed by a visual analysis of specific data patterns, both in the time domain and in the Fourier domain, allowed us to conceive and identify two paramount features engineering steps: a new effective data pre-processing algorythm and a new configuration of CNN that uses an Overcomplete Autoencoder (Overcomplete AE) topology with residual blocks. These two steps, described in detail in this paper, allowed us to better highlight and identify the anomalies caused by leaks in WDN pressures time series and they permitted, in association with a new original automatic analysis of the reconstruction error made by the Autoencoder, to achieve results that are on the top of the current state of art. Specifically, the whole innovative method is presented in detail exploiting publicly available data, so to be easily reproducible, and, more specifically, for this purpose, the benchmark was run on a synthetic 'LeakDB' dataset of 500 scenarios and the outcomes were then validated through different data obtained from a second and more complex synthetic 'LeakDB' dataset containing 1000 scenarios. Both these datasets are related to a District Metering Area (DMA) of the Hanoi WDN and both are publicly available.
期刊介绍:
Digital Signal Processing: A Review Journal is one of the oldest and most established journals in the field of signal processing yet it aims to be the most innovative. The Journal invites top quality research articles at the frontiers of research in all aspects of signal processing. Our objective is to provide a platform for the publication of ground-breaking research in signal processing with both academic and industrial appeal.
The journal has a special emphasis on statistical signal processing methodology such as Bayesian signal processing, and encourages articles on emerging applications of signal processing such as:
• big data• machine learning• internet of things• information security• systems biology and computational biology,• financial time series analysis,• autonomous vehicles,• quantum computing,• neuromorphic engineering,• human-computer interaction and intelligent user interfaces,• environmental signal processing,• geophysical signal processing including seismic signal processing,• chemioinformatics and bioinformatics,• audio, visual and performance arts,• disaster management and prevention,• renewable energy,