Now showing items 1-4 of 4
Adaptive Policies for a System of Competing Queues I: Convergence Results for the Long-Run Average Cost.
This paper considers a system of discrete-time queues competing for the attention of a single geometric server. The problem of implementing a given Markov stationary service allocation policy g through an adaptive allocation ...
Optimal Production Strategies for Discrete Time Machines Subject to Failures and Breakdown.
In this paper, discrete-time versions of a model by Akella and Kumar  are presented for the production of a single commodity on a machine subject to random failures and breakdowns. The successive up and down times of ...
Estimation and Optimal Control for Constrained Markov Chains.
The (optimal) design of many engineering systems can be adequately recast as a Markov decision process, where requirements on system performance are captured in the form of constraints. In this paper, various optimality ...
Implementation Issues for Markov Decision Processes.
In this paper, the problem of steering a long-run average coat functional to a prespecified value is discussed in the context of Markov decision processes wish countable statespace; this problem naturally arises in the ...