Open Problem—Convergence and Asymptotic Optimality of the Relative Value Iteration in Ergodic Control

Abstract

The relative value iteration scheme (RVI) for Markov decision processes (MDP) dates back to White (1963), a seminal work, which introduced an algorithm for solving the ergodic dynamic programming e...