Search

Now showing items 1-4 of 4

Approximate Receding Horizon Approach for Markov Decision Processes: Average Reward Case

Chang, Hyeong Soo; Marcus, Steven I. (2001)

Building on the receding horizon approach by Hernandez-Lerma andLasserre in solving Markov decision processes (MDPs),this paper first analyzes the performance of the (approximate) receding horizon approach in terms of ...

Stability of Wireless Networks for Mode S Radar

Chawla, Jay P.; Marcus, Steven I.; Shayman, Mark A. (2000)

Stability issues in a connectionless, one-hop queueing system featuringservers with overlapping service regions (e.g. a Mode Select (Mode S) Radarcommunications network or part of an Aeronautical Telecommunications Network ...

Multi-time Scale Markov Decision Processes

Chang, Hyeong Soo; Fard, Pedram; Marcus, Steven I.; Shayman, Mark (2002)

This paper proposes a simple analytical model called M time-scale MarkovDecision Process (MMDP) for hierarchically structured sequential decision making processes, where decisions in each level in the M-level hierarchy are ...

Optimal Multilevel Feedback Policies for ABR Flow Control using Two Timescale SPSA

Bhatnagar, Shalabh; Fu, Michael C.; Marcus, Steven I. (1999)

Optimal multilevel feedback control policies for rate based flow controlin available bit rate (ABR) service in asynchronous transfer mode (ATM)networks are obtained in the presence of information and propagationdelays, ...