Estimates for perturbations of discounted Markov chains on general spaces
Volume 30 / 2003
Applicationes Mathematicae 30 (2003), 39-53
MSC: 60J10, 93D05, 93D09.
DOI: 10.4064/am30-1-3
Abstract
We analyse a Markov chain and perturbations of the transition probability and the one-step cost function (possibly unbounded) defined on it. Under certain conditions, of Lyapunov and Harris type, we obtain new estimates of the effects of such perturbations via an index of perturbations, defined as the difference of the total expected discounted costs between the original Markov chain and the perturbed one. We provide an example which illustrates our analysis.
