Optimal Control Theory

Upper-level undergraduate text introduces aspects of optimal control theory: dynamic programming, Pontryagin's minimum principle, and numerical techniques for trajectory optimization. Numerous figures, tables. Solution guide available upon request. 1970 edition.

In the late 1950's, the group of Soviet mathematicians consisting of L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze, and E. F. Mishchenko made fundamental contributions to optimal control theory. Much of their work was collected in their monograph, The Mathematical Theory of Optimal Processes. Subsequently, Professor Gamkrelidze made further important contributions to the theory of necessary conditions for problems of optimal control and general optimization problems. In the present monograph, Professor Gamkrelidze presents his current view of the fundamentals of optimal control theory. It is intended for use in a one-semester graduate course or advanced undergraduate course. We are now making these ideas available in English to all those interested in optimal control theory. West Lafayette, Indiana, USA Leonard D. Berkovitz Translation Editor Vll Preface This book is based on lectures I gave at the Tbilisi State University during the fall of 1974. It contains, in essence, the principles of general control theory and proofs of the maximum principle and basic existence theorems of optimal control theory. Although the proofs of the basic theorems presented here are far from being the shortest, I think they are fully justified from the conceptual view point. In any case, the notions we introduce and the methods developed have one unquestionable advantage -they are constantly used throughout control theory, and not only for the proofs of the theorems presented in this book.

This book is an introduction to the mathematical theory of optimal control of processes governed by ordinary differential eq- tions. It is intended for students and professionals in mathematics and in areas of application who want a broad, yet relatively deep, concise and coherent introduction to the subject and to its relati- ship with applications. In order to accommodate a range of mathema- cal interests and backgrounds among readers, the material is arranged so that the more advanced mathematical sections can be omitted wi- out loss of continuity. For readers primarily interested in appli- tions a recommended minimum course consists of Chapter I, the sections of Chapters II, III, and IV so recommended in the introductory sec tions of those chapters, and all of Chapter V. The introductory sec tion of each chapter should further guide the individual reader toward material that is of interest to him. A reader who has had a good course in advanced calculus should be able to understand the defini tions and statements of the theorems and should be able to follow a substantial portion of the mathematical development. The entire book can be read by someone familiar with the basic aspects of Lebesque integration and functional analysis. For the reader who wishes to find out more about applications we recommend references [2], [13], [33], [35], and [50], of the Bibliography at the end of the book.

Optimal control methods are used to determine optimal ways to control a dynamic system. The theoretical work in this field serves as a foundation for the book, which the authors have applied to business management problems developed from their research and classroom instruction. Sethi and Thompson have provided management science and economics communities with a thoroughly revised edition of their classic text on Optimal Control Theory. The new edition has been completely refined with careful attention to the text and graphic material presentation. Chapters cover a range of topics including finance, production and inventory problems, marketing problems, machine maintenance and replacement, problems of optimal consumption of natural resources, and applications of control theory to economics. The book contains new results that were not available when the first edition was published, as well as an expansion of the material on stochastic optimal control theory.

This monograph is an introduction to optimal control theory for systems governed by vector ordinary differential equations. It is not intended as a state-of-the-art handbook for researchers. We have tried to keep two types of reader in mind: (1) mathematicians, graduate students, and advanced undergraduates in mathematics who want a concise introduction to a field which contains nontrivial interesting applications of mathematics (for example, weak convergence, convexity, and the theory of ordinary differential equations); (2) economists, applied scientists, and engineers who want to understand some of the mathematical foundations. of optimal control theory. In general, we have emphasized motivation and explanation, avoiding the "definition-axiom-theorem-proof" approach. We make use of a large number of examples, especially one simple canonical example which we carry through the entire book. In proving theorems, we often just prove the simplest case, then state the more general results which can be proved. Many of the more difficult topics are discussed in the "Notes" sections at the end of chapters and several major proofs are in the Appendices. We feel that a solid understanding of basic facts is best attained by at first avoiding excessive generality. We have not tried to give an exhaustive list of references, preferring to refer the reader to existing books or papers with extensive bibliographies. References are given by author's name and the year of publication, e.g., Waltman [1974].

A focused presentation of how sparse optimization methods can be used to solve optimal control and estimation problems.

The calculus of variations is used to find functions that optimize quantities expressed in terms of integrals. Optimal control theory seeks to find functions that minimize cost integrals for systems described by differential equations. This book is an introduction to both the classical theory of the calculus of variations and the more modern developments of optimal control theory from the perspective of an applied mathematician. It focuses on understanding concepts and how to apply them. The range of potential applications is broad: the calculus of variations and optimal control theory have been widely used in numerous ways in biology, criminology, economics, engineering, finance, management science, and physics. Applications described in this book include cancer chemotherapy, navigational control, and renewable resource harvesting. The prerequisites for the book are modest: the standard calculus sequence, a first course on ordinary differential equations, and some facility with the use of mathematical software. It is suitable for an undergraduate or beginning graduate course, or for self study. It provides excellent preparation for more advanced books and courses on the calculus of variations and optimal control theory.

A rigorous introduction to optimal control theory, which will enable engineers and scientists to put the theory into practice.