This paper presents results obtained for the robust control of discrete time dynamical systems. The problem is formulated and solved using dynamic programming. Both necessary and sufficient conditions in terms of (stationary ) dynamic programming equalities are presented. The output feedback problem is solved using the concept of an information state, where a decoupling between estimation and control is obtained.