Guaranteed Performance Regions for Markov Models

Loading...
Thumbnail Image
Files
TR_91-8.pdf(673.24 KB)
No. of downloads: 511
Publication or External Link
Date
1991
Authors
Shimkin, N.
Shwartz, A.
Advisor
Citation
DRUM DOI
Abstract
A user facing a multi-user resource-sharing system considers a vector of performance measures (e.g. response times to various tasks). Acceptable performance is defined through a set in the space of performance vectors. Can the user obtain a (time- average) performance vector which approaches this desired set? We consider the worst-case scenario, where other users may, for selfish reasons, try to exclude his vector from the desired set. For a Markovian model of the system, we give a sufficient condition for approachability (which is also necessary for convex sets), and construct appropriate policies. The mathematical formulation leads to an approachability theory for stochastic games.
Notes
Rights