He, YingFu, Michael C.Marcus, Steven I.In this paper, we give a summary of recent development of simulation-based algorithmsfor average cost MDP problems, which are different from those for discounted cost problems or shortest pathproblems. We introduce both simulation-based policy iteration algorithms and simulation-based value iterationalgorithms for average cost problems, and give the pros and cons of each algorithm.en-USalgorithmsSimulation-Based Policy IterationSimulation-Based Value IterationMarkov Decision Processesaverage costUnichainSystems Integration MethodologyTechnical Report