Show simple item record

Solving Continuous-State POMDPs via Density Projection

dc.contributor.authorZhou, Enlu
dc.contributor.authorFu, Michael C.
dc.contributor.authorMarcus, Steven I.
dc.date.accessioned2008-02-04T13:55:32Z
dc.date.available2008-02-04T13:55:32Z
dc.date.issued2007
dc.identifier.urihttp://hdl.handle.net/1903/7506
dc.description.abstractResearch on numerical solution methods for partially observable Markov decision processes (POMDPs) has primarily focused on discrete-state models, and these algorithms do not generally extend to continuous-state POMDPs, due to the infinite dimensionality of the belief space. In this paper, we develop a computationally viable and theoretically sound method for solving continuous-state POMDPs by effectively reducing the dimensionality of the belief space via density projections. The density projection technique is also incorporated into particle filtering to provide a filtering scheme for online decision making. We provide an error bound between the value function induced by the policy obtained by our method and the true value function of the POMDP, and also an error bound between the projection particle filtering and the optimal filtering. Finally, we illustrate the effectiveness of our method through an inventory control problem.en
dc.format.extent963862 bytes
dc.format.mimetypeapplication/pdf
dc.language.isoen_USen
dc.relation.ispartofseriesTRen
dc.relation.ispartofseries2008-6en
dc.subjectPOMDPen
dc.subjectparticle filteringen
dc.titleSolving Continuous-State POMDPs via Density Projectionen
dc.typeTechnical Reporten
dc.relation.isAvailableAtInstitute for Systems Researchen_us
dc.relation.isAvailableAtDigital Repository at the University of Marylanden_us
dc.relation.isAvailableAtUniversity of Maryland (College Park, MD)en_us


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record