The Optimal Regulator Problem for a Stationary Linear System With State-Dependent Noise

Abstract

The problem of minimizing a quadratic functional of the system outputs and control for a stationary linear system with state-dependent noise is solved in this paper. Both the finite final time and infinite final time versions of the problem are treated. For the latter case existence conditions are obtained using the second method of Lyapunov. The optimal controls for both problems are obtained using Bellman’s continuous dynamic programming. In light of this, the system dynamics are assumed to determine a diffusion process. For the infinite final time version of the problem noted above, sufficient conditions are obtained for the stability of the optimal system and uniqueness of the optimal control law. In addition, for this problem, an example is treated. The computational results for this example illustrate some of the qualitative features of regulators for linear, stationary systems with state-dependent disturbances.