Risk-Sensitive and Minimax Control of Discrete-Time, Finite-State Markov Decision Processes
Coraluppi, Stephano P.
Marcus, Steven I.
MetadataShow full item record
This paper analyzes a connection between risk-sensitive and minimaxcriteria for discrete-time, finite-states Markov Decision Processes(MDPs). We synthesize optimal policies with respect to both criteria,both for finite horizon and discounted infinite horizon problems. Ageneralized decision-making framework is introduced, which includes asspecial cases a number of approaches that have been considered in theliterature. The framework allows for discounted risk-sensitive andminimax formulations leading to stationary optimal policies on theinfinite horizon. We illustrate our results with a simple machinereplacement problem.
Showing items related by title, author, creator and subject.
Zhang, Lei (2005-10-05)A Networked Control System (NCS) is a control system in which the sensors and actuators are connected to a feedback controller via a shared communication medium. In an NCS, the shared medium can only provide a limited ...
comprehensive aeroelastic analysis of helicopter rotor with trailing-edge flap for primary control and vibration control Shen, Jinwei (2003-12-12)A comprehensive aeroelastic analytical model of helicopter rotors with trailingedge flaps for primary and vibration controls has been developed. The derivation of system equations is based on Hamilton principles, and ...
Adaptive Control of Nonlinear Systems with Applications to Flight Control Systems and Suspension Dynamics Ghanadan, Reza (1993)In this dissertation, we employ recent theoretical advances in differential geometric formulation of nonlinear control theory and adaptive control to develop a practical adaptive nonlinear control strategy.<P>We first ...