An optimal joint maintenance and mission abort policy for a system executing multi-attempt missions

Abstract

Mission-critical systems are subject to deterioration-induced failures that induce not only mission failure cost but also system failure penalty. Deciding whether and when to abort the mission is crucial for overall cost minimization. When a mission’s success is evaluated in terms of the cumulative execution time and can be achieved by multiple attempts, operators can implement maintenance to increase the mission success probability. This calls upon the need to decide the system maintenance timing together with mission abort decisions, which is challenging due to not only the complex multi-layer interactions between these two decision variables but also the large state and action spaces. In this paper, we develop a Markov decision process (MDP) framework to determine the optimal system maintenance and mission abort timing. First, we propose a joint maintenance and mission abort policy that enables the operator to include the impact of the maintenance cost into decision-making and implement system maintenance and mission abort throughout the mission execution process, which thereby outperforms existing alternatives in overall cost minimization. Second, we develop an MDP-based optimization framework and analytically obtain the structural properties of the optimal policy, including the existence of the state-dependent control limits for system maintenance and mission abort decisions and their interdependence. Third, we develop an enhanced value iteration algorithm that exploits the developed structural properties to significantly improve the computational efficiency over the standard approach. The advantages of the proposed policy and algorithm are demonstrated by a case study of a UAV performing a surveillance mission.