Cogilland Peng. Reversible Markov Decision Processes with an Average-reward Criterion. Society for Industrial & Applied Mathematics (SIAM), 2013, doi:10.1137/110844957.