Digital Repository at the University of Maryland (DRUM)  >
Institute for Systems Research  >
Institute for Systems Research Technical Reports 

Please use this identifier to cite or link to this item:

Title: Approximate Policy Iteration for Semiconductor Fab-Level Decision Making - a Case Study
Authors: He, Ying
Bhatnagar, Shalabh
Fu, Michael C.
Marcus, Steven I.
Advisors: Marcus, Steven I.
Department/Program: ISR
Type: Technical Report
Keywords: Approximate Policy Iteration
Semiconductor Fab-Level Decision Making
Markov Decision Processes
Discounted Cost Problem
Sensor-Actuator Networks
Next-Generation Product Realization Systems
Issue Date: 2000
Series/Report no.: ISR; TR 2000-49
Abstract: In this paper, we propose an approximate policy iteration (API) algorithm for asemiconductor fab-level decision making problem. This problem is formulated as adiscounted cost Markov Decision Process (MDP), and we have applied exact policy iterationto solve a simple example in prior work. However, the overwhelmingcomputational requirements of exact policy iteration prevent its application forlarger problems. Approximate policy iteration overcomes this obstacle by approximating thecost-to-go using function approximation. Numerical simulation on the same example showsthat the proposed API algorithm leads to a policy with cost close to that of the optimalpolicy.
Appears in Collections:Institute for Systems Research Technical Reports

Files in This Item:

File Description SizeFormatNo. of Downloads
TR_2000-49.pdf276.46 kBAdobe PDF689View/Open

All items in DRUM are protected by copyright, with all rights reserved.


DRUM is brought to you by the University of Maryland Libraries
University of Maryland, College Park, MD 20742-7011 (301)314-1328.
Please send us your comments