Stability Of The Turnpike Phenomenon In Discrete Time Optimal Control Problems

The structure of approximate solutions of autonomous discrete-time optimal control problems and individual turnpike results for optimal control problems without convexity (concavity) assumptions are examined in this book. In particular, the book focuses on the properties of approximate solutions which are independent of the length of the interval, for all sufficiently large intervals; these results apply to the so-called turnpike property of the optimal control problems. By encompassing the so-called turnpike property the approximate solutions of the problems are determined primarily by the objective function and are fundamentally independent of the choice of interval and endpoint conditions, except in regions close to the endpoints. This book also explores the turnpike phenomenon for two large classes of autonomous optimal control problems. It is illustrated that the turnpike phenomenon is stable for an optimal control problem if the corresponding infinite horizon optimal control problem possesses an asymptotic turnpike property. If an optimal control problem belonging to the first class possesses the turnpike property, then the turnpike is a singleton (unit set). The stability of the turnpike property under small perturbations of an objective function and of a constraint map is established. For the second class of problems where the turnpike phenomenon is not necessarily a singleton the stability of the turnpike property under small perturbations of an objective function is established. Containing solutions of difficult problems in optimal control and presenting new approaches, techniques and methods this book is of interest for mathematicians working in optimal control and the calculus of variations. It also can be useful in preparation courses for graduate students.

This book is devoted to the study of two large classes of discrete-time optimal control problems arising in mathematical economics. Nonautonomous optimal control problems of the first class are determined by a sequence of objective functions and sequence of constraint maps. They correspond to a general model of economic growth. We are interested in turnpike properties of approximate solutions and in the stability of the turnpike phenomenon under small perturbations of objective functions and constraint maps. The second class of autonomous optimal control problems corresponds to another general class of models of economic dynamics which includes the Robinson–Solow–Srinivasan model as a particular case. In Chap. 1 we discuss turnpike properties for a large class of discrete-time optimal control problems studied in the literature and for the Robinson–Solow–Srinivasan model. In Chap. 2 we introduce the first class of optimal control problems and study its turnpike property. This class of problems is also discussed in Chaps. 3–6. In Chap. 3 we study the stability of the turnpike phenomenon under small perturbations of the objective functions. Analogous results for problems with discounting are considered in Chap. 4. In Chap. 5 we study the stability of the turnpike phenomenon under small perturbations of the objective functions and the constraint maps. Analogous results for problems with discounting are established in Chap. 6. The results of Chaps. 5 and 6 are new. The second class of problems is studied in Chaps. 7–9. In Chap. 7 we study the turnpike properties. The stability of the turnpike phenomenon under small perturbations of the objective functions is established in Chap. 8. In Chap. 9 we establish the stability of the turnpike phenomenon under small perturbations of the objective functions and the constraint maps. The results of Chaps. 8 and 9 are new. In Chap. 10 we study optimal control problems related to a model of knowledge-based endogenous economic growth and show the existence of trajectories of unbounded economic growth and provide estimates for the growth rate.

This book is devoted to the study of the turnpike phenomenon and describes the existence of solutions for a large variety of infinite horizon optimal control classes of problems. Chapter 1 provides introductory material on turnpike properties. Chapter 2 studies the turnpike phenomenon for discrete-time optimal control problems. The turnpike properties of autonomous problems with extended-value integrands are studied in Chapter 3. Chapter 4 focuses on large classes of infinite horizon optimal control problems without convexity (concavity) assumptions. In Chapter 5, the turnpike results for a class of dynamic discrete-time two-player zero-sum game are proven. This thorough exposition will be very useful for mathematicians working in the fields of optimal control, the calculus of variations, applied functional analysis and infinite horizon optimization. It may also be used as a primary text in a graduate course in optimal control or as supplementary text for a variety of courses in other disciplines. Researchers in other fields such as economics and game theory, where turnpike properties are well known, will also find this Work valuable.

This book is devoted to the study of the turnpike phenomenon arising in optimal control theory. Special focus is placed on Turnpike results, in sufficient and necessary conditions for the turnpike phenomenon and in its stability under small perturbations of objective functions. The most important feature of this book is that it develops a large, general class of optimal control problems in metric space. Additional value is in the provision of solutions to a number of difficult and interesting problems in optimal control theory in metric spaces. Mathematicians working in optimal control, optimization, and experts in applications of optimal control to economics and engineering, will find this book particularly useful. All main results obtained in the book are new. The monograph contains nine chapters. Chapter 1 is an introduction. Chapter 2 discusses Banach space valued functions, set-valued mappings in infinite dimensional spaces, and related continuous-time dynamical systems. Some convergence results are obtained. In Chapter 3, a discrete-time dynamical system with a Lyapunov function in a metric space induced by a set-valued mapping, is studied. Chapter 4 is devoted to the study of a class of continuous-time dynamical systems, an analog of the class of discrete-time dynamical systems considered in Chapter 3. Chapter 5 develops a turnpike theory for a class of general dynamical systems in a metric space with a Lyapunov function. Chapter 6 contains a study of the turnpike phenomenon for discrete-time nonautonomous problems on subintervals of half-axis in metric spaces, which are not necessarily compact. Chapter 7 contains preliminaries which are needed in order to study turnpike properties of infinite-dimensional optimal control problems. In Chapter 8, sufficient and necessary conditions for the turnpike phenomenon for continuous-time optimal control problems on subintervals of the half-axis in metric spaces, is established. In Chapter 9, the examination continues of the turnpike phenomenon for the continuous-time optimal control problems on subintervals of half-axis in metric spaces discussed in Chapter 8.

This book is devoted to the study of classes of optimal control problems arising in economic growth theory, related to the Robinson–Solow–Srinivasan (RSS) model. The model was introduced in the 1960s by economists Joan Robinson, Robert Solow, and Thirukodikaval Nilakanta Srinivasan and was further studied by Robinson, Nobuo Okishio, and Joseph Stiglitz. Since then, the study of the RSS model has become an important element of economic dynamics. In this book, two large general classes of optimal control problems, both of them containing the RSS model as a particular case, are presented for study. For these two classes, a turnpike theory is developed and the existence of solutions to the corresponding infinite horizon optimal control problems is established. The book contains 9 chapters. Chapter 1 discusses turnpike properties for some optimal control problems that are known in the literature, including problems corresponding to the RSS model. The first class of optimal control problems is studied in Chaps. 2–6. In Chap. 2, infinite horizon optimal control problems with nonautonomous optimality criteria are considered. The utility functions, which determine the optimality criterion, are nonconcave. This class of models contains the RSS model as a particular case. The stability of the turnpike phenomenon of the one-dimensional nonautonomous concave RSS model is analyzed in Chap. 3. The following chapter takes up the study of a class of autonomous nonconcave optimal control problems, a subclass of problems considered in Chap. 2. The equivalence of the turnpike property and the asymptotic turnpike property, as well as the stability of the turnpike phenomenon, is established. Turnpike conditions and the stability of the turnpike phenomenon for nonautonomous problems are examined in Chap. 5, with Chap. 6 devoted to the study of the turnpike properties for the one-dimensional nonautonomous nonconcave RSS model. The utility functions, which determine the optimality criterion, are nonconcave. The class of RSS models is identified with a complete metric space of utility functions. Using the Baire category approach, the turnpike phenomenon is shown to hold for most of the models. Chapter 7 begins the study of the second large class of autonomous optimal control problems, and turnpike conditions are established. The stability of the turnpike phenomenon for this class of problems is investigated further in Chaps. 8 and 9.

This book provides a comprehensive study of turnpike phenomenon arising in optimal control theory. The focus is on individual (non-generic) turnpike results which are both mathematically significant and have numerous applications in engineering and economic theory. All results obtained in the book are new. New approaches, techniques, and methods are rigorously presented and utilize research from finite-dimensional variational problems and discrete-time optimal control problems to find the necessary conditions for the turnpike phenomenon in infinite dimensional spaces. The semigroup approach is employed in the discussion as well as PDE descriptions of continuous-time dynamics. The main results on sufficient and necessary conditions for the turnpike property are completely proved and the numerous illustrative examples support the material for the broad spectrum of experts. Mathematicians interested in the calculus of variations, optimal control and in applied functional analysis will find this book a useful guide to the turnpike phenomenon in infinite dimensional spaces. Experts in economic and engineering modeling as well as graduate students will also benefit from the developed techniques and obtained results.

Individual turnpike results are of great interest due to their numerous applications in engineering and in economic theory; in this book the study is focused on new results of turnpike phenomenon in linear optimal control problems. The book is intended for engineers as well as for mathematicians interested in the calculus of variations, optimal control and in applied functional analysis. Two large classes of problems are studied in more depth. The first class studied in Chapter 2 consists of linear control problems with periodic nonsmooth convex integrands. Chapters 3-5 consist of linear control problems with autonomous convex smooth integrands. Chapter 6 discusses a turnpike property for dynamic zero-sum games with linear constraints. Chapter 7 examines genericity results. In Chapter 8, the description of structure of variational problems with extended-valued integrands is obtained. Chapter 9 ends the exposition with a study of turnpike phenomenon for dynamic games with extended value integrands.

Numerical Control: Part A, Volume 23 in the Handbook of Numerical Analysis series, highlights new advances in the field, with this new volume presenting interesting chapters written by an international board of authors. Chapters in this volume include Numerics for finite-dimensional control systems, Moments and convex optimization for analysis and control of nonlinear PDEs, The turnpike property in optimal control, Structure-Preserving Numerical Schemes for Hamiltonian Dynamics, Optimal Control of PDEs and FE-Approximation, Filtration techniques for the uniform controllability of semi-discrete hyperbolic equations, Numerical controllability properties of fractional partial differential equations, Optimal Control, Numerics, and Applications of Fractional PDEs, and much more. Provides the authority and expertise of leading contributors from an international board of authors Presents the latest release in the Handbook of Numerical Analysis series Updated release includes the latest information on Numerical Control