Inverse Optimal Control And Inverse Noncooperative Dynamic Game Theory

This book presents a novel unified treatment of inverse problems in optimal control and noncooperative dynamic game theory. It provides readers with fundamental tools for the development of practical algorithms to solve inverse problems in control, robotics, biology, and economics. The treatment involves the application of Pontryagin's minimum principle to a variety of inverse problems and proposes algorithms founded on the elegance of dynamic optimization theory. There is a balanced emphasis between fundamental theoretical questions and practical matters. The text begins by providing an introduction and background to its topics. It then discusses discrete-time and continuous-time inverse optimal control. The focus moves on to differential and dynamic games and the book is completed by consideration of relevant applications. The algorithms and theoretical results developed in Inverse Optimal Control and Inverse Noncooperative Dynamic Game Theory provide new insights into information requirements for solving inverse problems, including the structure, quantity, and types of state and control data. These insights have significant practical consequences in the design of technologies seeking to exploit inverse techniques such as collaborative robots, driver-assistance technologies, and autonomous systems. The book will therefore be of interest to researchers, engineers, and postgraduate students in several disciplines within the area of control and robotics.

This work addresses inverse dynamic games, which generalize the inverse problem of optimal control, and where the aim is to identify cost functions based on observed optimal trajectories. The identified cost functions can describe individual behavior in cooperative systems, e.g. human behavior in human-machine haptic shared control scenarios.

​There are several techniques to study noncooperative dynamic games, such as dynamic programming and the maximum principle (also called the Lagrange method). It turns out, however, that one way to characterize dynamic potential games requires to analyze inverse optimal control problems, and it is here where the Euler equation approach comes in because it is particularly well–suited to solve inverse problems. Despite the importance of dynamic potential games, there is no systematic study about them. This monograph is the first attempt to provide a systematic, self–contained presentation of stochastic dynamic potential games.

An overview of the analysis of dynamic/differential zero-sum and nonzero-sum games and the role of different information patterns.

Interval Analysis An innovative and unique application of interval analysis to optimal control problems In Interval Analysis: Application in the Optimal Control Problems, celebrated researcher and engineer Dr. Navid Razmjooy delivers an expert discussion of the uncertainties in the analysis of optimal control problems. In the book, Dr. Razmjooy uses an open-ended approach to solving optimal control problems with indefinite intervals. Utilizing an extended, Runge-Kutta method, the author demonstrates how to accelerate its speed with the piecewise function. You’ll find recursive methods used to achieve more compact answers, as well as how to solve optimal control problems using the interval Chebyshev’s function. The book also contains: A thorough introduction to common errors and mistakes, generating uncertainties in physical models Comprehensive explorations of the literature on the subject, including Hukurara’s derivatives Practical discussions of the interval analysis and its variants, including the classical (Minkowski) methods Complete treatments of existing control methods, including classic, conventional advanced, and robust control. Perfect for master’s and PhD students working on system uncertainties, Interval Analysis: Application in the Optimal Control Problems will also benefit researchers working in laboratories, universities, and research centers.

Discrete-Time Inverse Optimal Control for Nonlinear Systems proposes a novel inverse optimal control scheme for stabilization and trajectory tracking of discrete-time nonlinear systems. This avoids the need to solve the associated Hamilton-Jacobi-Bellman equation and minimizes a cost functional, resulting in a more efficient controller. Design More Efficient Controllers for Stabilization and Trajectory Tracking of Discrete-Time Nonlinear Systems The book presents two approaches for controller synthesis: the first based on passivity theory and the second on a control Lyapunov function (CLF). The synthesized discrete-time optimal controller can be directly implemented in real-time systems. The book also proposes the use of recurrent neural networks to model discrete-time nonlinear systems. Combined with the inverse optimal control approach, such models constitute a powerful tool to deal with uncertainties such as unmodeled dynamics and disturbances. Learn from Simulations and an In-Depth Case Study The authors include a variety of simulations to illustrate the effectiveness of the synthesized controllers for stabilization and trajectory tracking of discrete-time nonlinear systems. An in-depth case study applies the control schemes to glycemic control in patients with type 1 diabetes mellitus, to calculate the adequate insulin delivery rate required to prevent hyperglycemia and hypoglycemia levels. The discrete-time optimal and robust control techniques proposed can be used in a range of industrial applications, from aerospace and energy to biomedical and electromechanical systems. Highlighting optimal and efficient control algorithms, this is a valuable resource for researchers, engineers, and students working in nonlinear system control.

Dynamic game theory serves the purpose of including strategic interaction in decision making and is therefore often applied to economic problems. This book presents the state-of-the-art and directions for future research in dynamic game theory related to economics. It was initiated by contributors to the 12th Viennese Workshop on Optimal Control, Dynamic Games and Nonlinear Dynamics and combines a selection of papers from the workshop with invited papers of high quality.