JEDNOSTKA NAUKOWA KATEGORII A+

Deterministic optimal policies for Markov control processes with pathwise constraints

Tom 39 / 2012

Armando F. Mendoza-Pérez, Onésimo Hernández-Lerma Applicationes Mathematicae 39 (2012), 185-209 MSC: 93E20, 90C40. DOI: 10.4064/am39-2-6

Streszczenie

This paper deals with discrete-time Markov control processes in Borel spaces with unbounded rewards. Under suitable hypotheses, we show that a randomized stationary policy is optimal for a certain expected constrained problem (ECP) if and only if it is optimal for the corresponding pathwise constrained problem (pathwise CP). Moreover, we show that a certain parametric family of unconstrained optimality equations yields convergence properties that lead to an approximation scheme which allows us to obtain constrained optimal policies as the limit of unconstrained deterministic optimal policies. In addition, we give sufficient conditions for the existence of deterministic policies that solve these constrained problems.

Autorzy

  • Armando F. Mendoza-PérezCEFyMAP-UNACH
    Cuarta Oriente Norte 1428
    entre 13 y 14 norte
    C.P. 29040
    Tuxtla Gutiérrez, Chiapas, México
    e-mail
  • Onésimo Hernández-LermaMathematics Department
    CINVESTAV-IPN
    A. Postal 14-740
    México D.F. 07000, México
    e-mail

Przeszukaj wydawnictwa IMPAN

Zbyt krótkie zapytanie. Wpisz co najmniej 4 znaki.

Przepisz kod z obrazka

Odśwież obrazek

Odśwież obrazek