Convergence of an iterative algorithm for solving Hamilton-Jacobi type equations

Markman, Jerry; Katz, I.

doi:10.1090/S0025-5718-01-01304-7

Convergence of an iterative algorithm for solving Hamilton-Jacobi type equations
HTML articles powered by AMS MathViewer

by Jerry Markman and I. Norman Katz;

Math. Comp. 71 (2002), 77-103

DOI: https://doi.org/10.1090/S0025-5718-01-01304-7

Published electronically: March 9, 2001

PDF | Request permission

Abstract:

Solutions of the optimal control and $H_\infty$-control problems for nonlinear affine systems can be found by solving Hamilton-Jacobi equations. However, these first order nonlinear partial differential equations can, in general, not be solved analytically. This paper studies the rate of convergence of an iterative algorithm which solves these equations numerically for points near the origin. It is shown that the procedure converges to the stabilizing solution exponentially with respect to the iteration variable. Illustrative examples are presented which confirm the theoretical rate of convergence.

References

Arthur E. Bryson Jr. and Yu Chi Ho, Applied optimal control, Hemisphere Publishing Corp., Washington, DC; distributed by Halsted Press [John Wiley & Sons, Inc.], New York-London-Sydney, 1975. Optimization, estimation, and control; Revised printing. MR 446628
Hans-W. Knobloch, Alberto Isidori, and Dietrich Flockerzi, Topics in control theory, DMV Seminar, vol. 22, Birkhäuser Verlag, Basel, 1993. MR 1284714, DOI 10.1007/978-3-0348-8566-9
W. L. Garrard, Additional results on sub-optimal feedback control of non-linear systems, Internat. J. Control (1) 10 (1969), 657–663. MR 260458, DOI 10.1080/00207176908905867
Y. Nishikawa, N. Sannomiya, and H. Itakura, A method of suboptimal design of nonlinear feedback systems, Automatica J. IFAC 7 (1971), 703–712 (English, with French, German and Russian summaries). MR 324508, DOI 10.1016/0005-1098(71)90008-2
George N. Saridis and Chun Sing G. Lee, An approximation theory of optimal control for trainable manipulators, IEEE Trans. Systems Man Cybernet. 9 (1979), no. 3, 152–159. MR 521133, DOI 10.1109/TSMC.1979.4310171
Randal Beard, George Saridis, and John Wen, Improving the Performance of Stabilizing Controls for Nonlinear Systems, IEEE Journal on Control Systems, 1996, 27–35.
K.A. Wise, and J.L. Sedwick, Missile autopilot design using nonlinear $H_\infty$-optimal control, Proceedings of 13th IFAC Symposium on Automatic Control in Aerospace, 1994.
Jerry Markman, Numerical Solutions of the Hamilton-Jacobi Equations Arising in Nonlinear $H_\infty$ and Optimal Control, Washington University, Department of Systems Science and Mathematics, D.Sc. thesis 1998.
Jerry Markman, and I. Norman Katz, An Iterative Algorithm for Solving Hamilton-Jacobi Equations, SIAM J. Sci. Comput. 22 (2000), 312–329.
Alberto Isidori, Attenuation of disturbances in nonlinear control systems, Systems, models and feedback: theory and applications (Capri, 1992) Progr. Systems Control Theory, vol. 12, Birkhäuser Boston, Boston, MA, 1992, pp. 275–300. MR 1169952
W. A. Coppel, Stability and Asymptotic Behavior of Differential Equations, D.C. Heath and Company, 1965, Boston.
Stephen Wiggins, Introduction to applied nonlinear dynamical systems and chaos, Texts in Applied Mathematics, vol. 2, Springer-Verlag, New York, 1990. MR 1056699, DOI 10.1007/978-1-4757-4067-7
Sam Perlis, Maximal orders in rational cyclic algebras of composite degree, Trans. Amer. Math. Soc. 46 (1939), 82–96. MR 15, DOI 10.1090/S0002-9947-1939-0000015-X
A. J. van der Schaft, $L_2$-gain analysis of nonlinear systems and nonlinear state feedback $H_\infty$ control, IEEE Trans. Automat. Control 37 (1992), no. 6, 770–784. MR 1164548, DOI 10.1109/9.256331
A. M. Stuart and A. R. Humphries, Dynamical systems and numerical analysis, Cambridge Monographs on Applied and Computational Mathematics, vol. 2, Cambridge University Press, Cambridge, 1996. MR 1402909