Infinite Horizon Optimal Control In The Discrete Time Framework

​​​​In this book the authors take a rigorous look at the infinite-horizon discrete-time optimal control theory from the viewpoint of Pontryagin’s principles. Several Pontryagin principles are described which govern systems and various criteria which define the notions of optimality, along with a detailed analysis of how each Pontryagin principle relate to each other. The Pontryagin principle is examined in a stochastic setting and results are given which generalize Pontryagin’s principles to multi-criteria problems. ​Infinite-Horizon Optimal Control in the Discrete-Time Framework is aimed toward researchers and PhD students in various scientific fields such as mathematics, applied mathematics, economics, management, sustainable development (such as, of fisheries and of forests), and Bio-medical sciences who are drawn to infinite-horizon discrete-time optimal control problems.

Devoted to the structure of approximate solutions of discrete-time optimal control problems and approximate solutions of dynamic discrete-time two-player zero-sum games, this book presents results on properties of approximate solutions in an interval that is independent lengthwise, for all sufficiently large intervals. Results concerning the so-called turnpike property of optimal control problems and zero-sum games in the regions close to the endpoints of the time intervals are the main focus of this book. The description of the structure of approximate solutions on sufficiently large intervals and its stability will interest graduate students and mathematicians in optimal control and game theory, engineering, and economics. This book begins with a brief overview and moves on to analyze the structure of approximate solutions of autonomous nonconcave discrete-time optimal control Lagrange problems.Next the structures of approximate solutions of autonomous discrete-time optimal control problems that are discrete-time analogs of Bolza problems in calculus of variations are studied. The structures of approximate solutions of two-player zero-sum games are analyzed through standard convexity-concavity assumptions. Finally, turnpike properties for approximate solutions in a class of nonautonomic dynamic discrete-time games with convexity-concavity assumptions are examined.

The series is designed to bring together those mathematicians who are seriously interested in getting new challenging stimuli from economic theories with those economists who are seeking effective mathematical tools for their research. A lot of economic problems can be formulated as constrained optimizations and equilibration of their solutions. Various mathematical theories have been supplying economists with indispensable machineries for these problems arising in economic theory. Conversely, mathematicians have been stimulated by various mathematical difficulties raised by economic theories.

Since the days of Lev Pontryagin and his associates, the discipline of Optimal Control has enjoyed a tremendous upswing – not only in terms of its mathematical foundations, but also with regard to numerous fields of application, which have given rise to highly active research areas. Few scholars, however, have been able to make contributions to both the mathematical developments and the (socio-)economic applications; Vladimir Veliov is one of them. In the course of his scientific career, he has contributed highly influential research on mathematical aspects of Optimal Control Theory, as well as applications in Economics and Operations Research. One of the hallmarks of his research is its impressive breadth. This volume, published on the occasion of his 65th birthday, accurately reflects that diversity. The mathematical aspects covered include stability theory for difference inclusions, metric regularity, generalized duality theory, the Bolza problem from a functional analytic perspective, and fractional calculus. In turn, the book explores various applications of control theory, such as population dynamics, population economics, epidemiology, optimal growth theory, resource and energy economics, environmental management, and climate change. Further topics include optimal liquidity, dynamics of the firm, and wealth inequality.

This book is devoted to the study of two large classes of discrete-time optimal control problems arising in mathematical economics. Nonautonomous optimal control problems of the first class are determined by a sequence of objective functions and sequence of constraint maps. They correspond to a general model of economic growth. We are interested in turnpike properties of approximate solutions and in the stability of the turnpike phenomenon under small perturbations of objective functions and constraint maps. The second class of autonomous optimal control problems corresponds to another general class of models of economic dynamics which includes the Robinson–Solow–Srinivasan model as a particular case. In Chap. 1 we discuss turnpike properties for a large class of discrete-time optimal control problems studied in the literature and for the Robinson–Solow–Srinivasan model. In Chap. 2 we introduce the first class of optimal control problems and study its turnpike property. This class of problems is also discussed in Chaps. 3–6. In Chap. 3 we study the stability of the turnpike phenomenon under small perturbations of the objective functions. Analogous results for problems with discounting are considered in Chap. 4. In Chap. 5 we study the stability of the turnpike phenomenon under small perturbations of the objective functions and the constraint maps. Analogous results for problems with discounting are established in Chap. 6. The results of Chaps. 5 and 6 are new. The second class of problems is studied in Chaps. 7–9. In Chap. 7 we study the turnpike properties. The stability of the turnpike phenomenon under small perturbations of the objective functions is established in Chap. 8. In Chap. 9 we establish the stability of the turnpike phenomenon under small perturbations of the objective functions and the constraint maps. The results of Chaps. 8 and 9 are new. In Chap. 10 we study optimal control problems related to a model of knowledge-based endogenous economic growth and show the existence of trajectories of unbounded economic growth and provide estimates for the growth rate.

This book presents recent developments in modelling and optimization of engineering systems and the use of advanced mathematical methods for solving complex real-world problems. It provides recent theoretical developments and new techniques based on control, optimization theory, mathematical modeling and fractional calculus that can be used to model and understand complex behavior in natural phenomena including latest technologies such as additive manufacturing. Specific topics covered in detail include combinatorial optimization, flow and heat transfer, mathematical modelling, energy storage and management policy, artificial intelligence, optimal control, modelling and optimization of manufacturing systems.

This book is devoted to the study of the turnpike phenomenon and describes the existence of solutions for a large variety of infinite horizon optimal control classes of problems. Chapter 1 provides introductory material on turnpike properties. Chapter 2 studies the turnpike phenomenon for discrete-time optimal control problems. The turnpike properties of autonomous problems with extended-value integrands are studied in Chapter 3. Chapter 4 focuses on large classes of infinite horizon optimal control problems without convexity (concavity) assumptions. In Chapter 5, the turnpike results for a class of dynamic discrete-time two-player zero-sum game are proven. This thorough exposition will be very useful for mathematicians working in the fields of optimal control, the calculus of variations, applied functional analysis and infinite horizon optimization. It may also be used as a primary text in a graduate course in optimal control or as supplementary text for a variety of courses in other disciplines. Researchers in other fields such as economics and game theory, where turnpike properties are well known, will also find this Work valuable.

This book provides a comprehensive study of turnpike phenomenon arising in optimal control theory. The focus is on individual (non-generic) turnpike results which are both mathematically significant and have numerous applications in engineering and economic theory. All results obtained in the book are new. New approaches, techniques, and methods are rigorously presented and utilize research from finite-dimensional variational problems and discrete-time optimal control problems to find the necessary conditions for the turnpike phenomenon in infinite dimensional spaces. The semigroup approach is employed in the discussion as well as PDE descriptions of continuous-time dynamics. The main results on sufficient and necessary conditions for the turnpike property are completely proved and the numerous illustrative examples support the material for the broad spectrum of experts. Mathematicians interested in the calculus of variations, optimal control and in applied functional analysis will find this book a useful guide to the turnpike phenomenon in infinite dimensional spaces. Experts in economic and engineering modeling as well as graduate students will also benefit from the developed techniques and obtained results.