Risk Sensitive Control of Markov Processes in Countable State Space
Risk Sensitive Control of Markov Processes in Countable State Space
Loading...
Files
Publication or External Link
Date
1996
Authors
Hernandez-Hernandez, Daniel
Marcus, Steven I.
Advisor
Citation
DRUM DOI
Abstract
In this paper we consider infinite horizon risk-sensitive control of Markov processes with discrete time and denumerable state space. This problem is solved proving, under suitable conditions, that there exists a bounded solution to the dynamic programming equation. The dynamic programming equation is transformed into an Isaacs equation for a stochastic game, and the vanishing discount method is used to study its solution. In addition, we prove that the existence conditions are as well necessary.