Risk-Sensitive and Minimax Control of Discrete-Time, Finite-State Markov Decision Processes
Coraluppi, Stephano P.
Marcus, Steven I.
MetadataShow full item record
This paper analyzes a connection between risk-sensitive and minimaxcriteria for discrete-time, finite-states Markov Decision Processes(MDPs). We synthesize optimal policies with respect to both criteria,both for finite horizon and discounted infinite horizon problems. Ageneralized decision-making framework is introduced, which includes asspecial cases a number of approaches that have been considered in theliterature. The framework allows for discounted risk-sensitive andminimax formulations leading to stationary optimal policies on theinfinite horizon. We illustrate our results with a simple machinereplacement problem.
Showing items related by title, author, creator and subject.
Control of Hysteresis in Smart Actuators, Part I: Modeling, Parameter Identification, and Inverse Control Tan, Xiaobo; Baras, John S. (2002)Hysteresis in smart actuators presents a challenge in control of these actuators. A fundamental idea to cope with hysteresis is inverse compensation. In this paper we study modeling, identification and inverse control of ...
Reilly, J. (1990)We outline two example applications of optimal control methodologies to aid in the design of control systems. The first method uses CONSOLE, a computer-aided design program based on feasible direction and multicriterion ...
Zaffriou, E. (1989)The Shell Standard Control Problem (SSCP), with its hard constraint specifications and the multiple performance objectives, is clearly the kind of problem to which the use of an on-line optimizing control algorithm like ...