Markov decision process based value chain calculation of water distribution network scheduling

Precise value of scheduling decisions forms the cornerstone of water distribution network (WDN) scheduling optimization, which aims at conserving energy and enhancing network operational efficiency. This article proposes a computational methodology for evaluating the value chain of scheduling decisions in WDN. The scheduling process is modeled as a Markov decision process with immediate reward function, action and state space. Due to the periodicity of water supply and sequential nature of scheduling, the calculation quantifies cumulative value of scheduling decisions by incorporating state transition probability with expected value. The effectiveness and applicability of the proposed evaluation method are demonstrated using scheduling data from a real world WDN. The method provides rational values on scheduling period and strategies, offering practical feedback for scheduling decisions.