Introductory Optimization Dynamics

Optimal Control theory has been increasingly used in Economi- and Management Science in the last fifteen years or so. It is now commonplace, even at textbook level. It has been applied to a great many areas of Economics and Management Science, such as Optimal Growth, Optimal Population, Pollution control, Natural Resources, Bioeconomics, Education, International Trade, Monopoly, Oligopoly and Duopoly, Urban and Regional Economics, Arms Race control, Business Finance, Inventory Planning, Marketing, Maintenance and Replacement policy and many others. It is a powerful tool of dynamic optimization. There is no doubt social sciences students should be familiar with this tool, if not for their own research, at least for reading the literature. These Lecture Notes attempt to provide a plain exposition of Optimal Control Theory, with a number of economic examples and applications designed mainly to illustrate the various techniques and point out the wide range of possible applications rather than to treat exhaustively any area of economic theory or policy. Chapters 2,3 and 4 are devoted to the Calculus of Variations, Chapter 5 develops Optimal Control theory from the Variational approach, Chapter 6 deals with the problems of constrained state and control variables , Chapter 7, with Linear Control models and Chapter 8, with stabilization models. Discrete systems are discussed in Chapter 9 and Sensitivity analysis in Chapter 10. Chapter 11 presents a wide range of Economics and Management Science applications.

This book explores discrete-time dynamic optimization and provides a detailed introduction to both deterministic and stochastic models. Covering problems with finite and infinite horizon, as well as Markov renewal programs, Bayesian control models and partially observable processes, the book focuses on the precise modelling of applications in a variety of areas, including operations research, computer science, mathematics, statistics, engineering, economics and finance. Dynamic Optimization is a carefully presented textbook which starts with discrete-time deterministic dynamic optimization problems, providing readers with the tools for sequential decision-making, before proceeding to the more complicated stochastic models. The authors present complete and simple proofs and illustrate the main results with numerous examples and exercises (without solutions). With relevant material covered in four appendices, this book is completely self-contained.

Optimal control theory is a technique being used increasingly by academic economists to study problems involving optimal decisions in a multi-period framework. This textbook is designed to make the difficult subject of optimal control theory easily accessible to economists while at the same time maintaining rigour. Economic intuitions are emphasized, and examples and problem sets covering a wide range of applications in economics are provided to assist in the learning process. Theorems are clearly stated and their proofs are carefully explained. The development of the text is gradual and fully integrated, beginning with simple formulations and progressing to advanced topics such as control parameters, jumps in state variables, and bounded state space. For greater economy and elegance, optimal control theory is introduced directly, without recourse to the calculus of variations. The connection with the latter and with dynamic programming is explained in a separate chapter. A second purpose of the book is to draw the parallel between optimal control theory and static optimization. Chapter 1 provides an extensive treatment of constrained and unconstrained maximization, with emphasis on economic insight and applications. Starting from basic concepts, it derives and explains important results, including the envelope theorem and the method of comparative statics. This chapter may be used for a course in static optimization. The book is largely self-contained. No previous knowledge of differential equations is required.

Since its initial publication, this text has defined courses in dynamic optimization taught to economics and management science students. The two-part treatment covers the calculus of variations and optimal control. 1998 edition.