Discrete Time Optimal Control And Games On Large Intervals

Devoted to the structure of approximate solutions of discrete-time optimal control problems and approximate solutions of dynamic discrete-time two-player zero-sum games, this book presents results on properties of approximate solutions in an interval that is independent lengthwise, for all sufficiently large intervals. Results concerning the so-called turnpike property of optimal control problems and zero-sum games in the regions close to the endpoints of the time intervals are the main focus of this book. The description of the structure of approximate solutions on sufficiently large intervals and its stability will interest graduate students and mathematicians in optimal control and game theory, engineering, and economics. This book begins with a brief overview and moves on to analyze the structure of approximate solutions of autonomous nonconcave discrete-time optimal control Lagrange problems.Next the structures of approximate solutions of autonomous discrete-time optimal control problems that are discrete-time analogs of Bolza problems in calculus of variations are studied. The structures of approximate solutions of two-player zero-sum games are analyzed through standard convexity-concavity assumptions. Finally, turnpike properties for approximate solutions in a class of nonautonomic dynamic discrete-time games with convexity-concavity assumptions are examined.

This book is devoted to the study of two large classes of discrete-time optimal control problems arising in mathematical economics. Nonautonomous optimal control problems of the first class are determined by a sequence of objective functions and sequence of constraint maps. They correspond to a general model of economic growth. We are interested in turnpike properties of approximate solutions and in the stability of the turnpike phenomenon under small perturbations of objective functions and constraint maps. The second class of autonomous optimal control problems corresponds to another general class of models of economic dynamics which includes the Robinson–Solow–Srinivasan model as a particular case. In Chap. 1 we discuss turnpike properties for a large class of discrete-time optimal control problems studied in the literature and for the Robinson–Solow–Srinivasan model. In Chap. 2 we introduce the first class of optimal control problems and study its turnpike property. This class of problems is also discussed in Chaps. 3–6. In Chap. 3 we study the stability of the turnpike phenomenon under small perturbations of the objective functions. Analogous results for problems with discounting are considered in Chap. 4. In Chap. 5 we study the stability of the turnpike phenomenon under small perturbations of the objective functions and the constraint maps. Analogous results for problems with discounting are established in Chap. 6. The results of Chaps. 5 and 6 are new. The second class of problems is studied in Chaps. 7–9. In Chap. 7 we study the turnpike properties. The stability of the turnpike phenomenon under small perturbations of the objective functions is established in Chap. 8. In Chap. 9 we establish the stability of the turnpike phenomenon under small perturbations of the objective functions and the constraint maps. The results of Chaps. 8 and 9 are new. In Chap. 10 we study optimal control problems related to a model of knowledge-based endogenous economic growth and show the existence of trajectories of unbounded economic growth and provide estimates for the growth rate.

This book presents a comprehensive new, multi-objective and integrative view on traditional game and control theories. Consisting of 15 chapters, it is divided into three parts covering noncooperative games; mixtures of simultaneous and sequential multi-objective games; and multi-agent control of Pareto-Nash-Stackelberg-type games respectively. Can multicriteria optimization, game theory and optimal control be integrated into a unique theory? Are there mathematical models and solution concepts that could constitute the basis of a new paradigm? Is there a common approach and method to solve emerging problems? The book addresses these and other related questions and problems to create the foundation for the Pareto-Nash-Stackelberg Game and Control Theory. It considers a series of simultaneous/Nash and sequential/Stackelberg games, single-criterion and multicriteria/Pareto games, combining Nash and Stackelberg game concepts and Pareto optimization, as well as a range of notions related to system control. In addition, it considers the problems of finding and representing the entire set of solutions. Intended for researches, professors, specialists, and students in the areas of game theory, operational research, applied mathematics, economics, computer science and engineering, it also serves as a textbook for various courses in these fields.

This book is devoted to the study of optimal control problems arising in forest management, an important and fascinating topic in mathematical economics studied by many researchers over the years. The volume studies the forest management problem by analyzing a class of optimal control problems that contains it and showing the existence of optimal solutions over infinite horizon. It also studies the structure of approximate solutions on finite intervals and their turnpike properties, as well as the stability of the turnpike phenomenon and the structure of approximate solutions on finite intervals in the regions close to the end points. The book is intended for mathematicians interested in the optimization theory, optimal control and their applications to the economic theory.

This book provides a comprehensive study of turnpike phenomenon arising in optimal control theory. The focus is on individual (non-generic) turnpike results which are both mathematically significant and have numerous applications in engineering and economic theory. All results obtained in the book are new. New approaches, techniques, and methods are rigorously presented and utilize research from finite-dimensional variational problems and discrete-time optimal control problems to find the necessary conditions for the turnpike phenomenon in infinite dimensional spaces. The semigroup approach is employed in the discussion as well as PDE descriptions of continuous-time dynamics. The main results on sufficient and necessary conditions for the turnpike property are completely proved and the numerous illustrative examples support the material for the broad spectrum of experts. Mathematicians interested in the calculus of variations, optimal control and in applied functional analysis will find this book a useful guide to the turnpike phenomenon in infinite dimensional spaces. Experts in economic and engineering modeling as well as graduate students will also benefit from the developed techniques and obtained results.

This book introduces optimal control methods, formulated as optimization problems, applied to business dynamics problems. Business dynamics refers to a combination of business management and financial objectives embedded in a dynamical system model. The model is subject to a control that optimizes a performance index and takes both management and financial aspects into account. Business Dynamics Models: Optimization-Based One Step Ahead Optimal Control includes solutions that provide a rationale for the use of optimal control and guidelines for further investigation into more complex models, as well as formulations that can also be used in a so-called flight simulator mode to investigate different complex scenarios. The text offers a modern programming environment (Jupyter notebooks in JuMP/Julia) for modeling, simulation, and optimization, and Julia code and notebooks are provided on a website for readers to experiment with their own examples. This book is intended for students majoring in applied mathematics, business, and engineering. The authors use a formulation-algorithm-example approach, rather than the classical definition-theorem-proof, making the material understandable to senior undergraduates and beginning graduates.

This book is devoted to the study of the turnpike phenomenon and describes the existence of solutions for a large variety of infinite horizon optimal control classes of problems. Chapter 1 provides introductory material on turnpike properties. Chapter 2 studies the turnpike phenomenon for discrete-time optimal control problems. The turnpike properties of autonomous problems with extended-value integrands are studied in Chapter 3. Chapter 4 focuses on large classes of infinite horizon optimal control problems without convexity (concavity) assumptions. In Chapter 5, the turnpike results for a class of dynamic discrete-time two-player zero-sum game are proven. This thorough exposition will be very useful for mathematicians working in the fields of optimal control, the calculus of variations, applied functional analysis and infinite horizon optimization. It may also be used as a primary text in a graduate course in optimal control or as supplementary text for a variety of courses in other disciplines. Researchers in other fields such as economics and game theory, where turnpike properties are well known, will also find this Work valuable.

This book is devoted to the study of a class of optimal control problems arising in mathematical economics, related to the Robinson–Solow–Srinivasan (RSS) model. It will be useful for researches interested in the turnpike theory, infinite horizon optimal control and their applications, and mathematical economists. The RSS is a well-known model of economic dynamics that was introduced in the 1960s and as many other models of economic dynamics, the RSS model is determined by an objective function (a utility function) and a set-valued mapping (a technology map). The set-valued map generates a dynamical system whose trajectories are under consideration and the objective function determines an optimality criterion. The goal is to find optimal trajectories of the dynamical system, using the optimality criterion. Chapter 1 discusses turnpike properties for some classes of discrete time optimal control problems. Chapter 2 present the description of the RSS model and discuss its basic properties. Infinite horizon optimal control problems, related to the RSS model are studied in Chapter 3. Turnpike properties for the RSS model are analyzed in Chapter 4. Chapter 5 studies infinite horizon optimal control problems related to the RSS model with a nonconcave utility function. Chapter 6 focuses on infinite horizon optimal control problems with nonautonomous optimality criterions. Chapter 7 contains turnpike results for a class of discrete-time optimal control problems. Chapter 8 discusses the RSS model and compares different optimality criterions. Chapter 9 is devoted to the study of the turnpike properties for the RSS model. In Chapter 10 the one-dimensional autonomous RSS model is considered and the continuous time RSS model is studied in Chapter 11.