Learning Based Adaptive Control

Adaptive control has been one of the main problems studied in control theory. The subject is well understood, yet it has a very active research frontier. This book focuses on a specific subclass of adaptive control, namely, learning-based adaptive control. As systems evolve during time or are exposed to unstructured environments, it is expected that some of their characteristics may change. This book offers a new perspective about how to deal with these variations. By merging together Model-Free and Model-Based learning algorithms, the author demonstrates, using a number of mechatronic examples, how the learning process can be shortened and optimal control performance can be reached and maintained. Includes a good number of Mechatronics Examples of the techniques. Compares and blends Model-free and Model-based learning algorithms. Covers fundamental concepts, state-of-the-art research, necessary tools for modeling, and control.

The book reviews developments in the following fields: optimal adaptive control; online differential games; reinforcement learning principles; and dynamic feedback control systems.

This book stems from the growing use of learning-based techniques, such as reinforcement learning and adaptive control, in the control of autonomous and safety-critical systems. Safety is critical to many applications, such as autonomous driving, air traffic control, and robotics. As these learning-enabled technologies become more prevalent in the control of autonomous systems, it becomes increasingly important to ensure that such systems are safe. To address these challenges, the authors provide a self-contained treatment of learning-based control techniques with rigorous guarantees of stability and safety. This book contains recent results on provably correct control techniques from specifications that go beyond safety and stability, such as temporal logic formulas. The authors bring together control theory, optimization, machine learning, and formal methods and present worked-out examples and extensive simulation examples to complement the mathematical style of presentation. Prerequisites are minimal, and the underlying ideas are accessible to readers with only a brief background in control-theoretic ideas, such as Lyapunov stability theory.

The robotic mechanism and its controller make a complete system. As the robotic mechanism is reconfigured, the control system has to be adapted accordingly. The need for the reconfiguration usually arises from the changing functional requirements. This book will focus on the adaptive control of robotic manipulators to address the changed conditions. The aim of the book is to summarise and introduce the state-of-the-art technologies in the field of adaptive control of robotic manipulators in order to improve the methodologies on the adaptive control of robotic manipulators. Advances made in the past decades are described in the book, including adaptive control theories and design, and application of adaptive control to robotic manipulators.

Methods by which robots can learn control laws that enable real-time reactivity using dynamical systems; with applications and exercises. This book presents a wealth of machine learning techniques to make the control of robots more flexible and safe when interacting with humans. It introduces a set of control laws that enable reactivity using dynamical systems, a widely used method for solving motion-planning problems in robotics. These control approaches can replan in milliseconds to adapt to new environmental constraints and offer safe and compliant control of forces in contact. The techniques offer theoretical advantages, including convergence to a goal, non-penetration of obstacles, and passivity. The coverage of learning begins with low-level control parameters and progresses to higher-level competencies composed of combinations of skills. Learning for Adaptive and Reactive Robot Control is designed for graduate-level courses in robotics, with chapters that proceed from fundamentals to more advanced content. Techniques covered include learning from demonstration, optimization, and reinforcement learning, and using dynamical systems in learning control laws, trajectory planning, and methods for compliant and force control . Features for teaching in each chapter: applications, which range from arm manipulators to whole-body control of humanoid robots; pencil-and-paper and programming exercises; lecture videos, slides, and MATLAB code examples available on the author’s website . an eTextbook platform website offering protected material[EPS2] for instructors including solutions.

The focus of this book is the application of artificial neural networks in uncertain dynamical systems. It explains how to use neural networks in concert with adaptive techniques for system identification, state estimation, and control problems. The authors begin with a brief historical overview of adaptive control, followed by a review of mathematical preliminaries. In the subsequent chapters, they present several neural network-based control schemes. Each chapter starts with a concise introduction to the problem under study, and a neural network-based control strategy is designed for the simplest case scenario. After these designs are discussed, different practical limitations (i.e., saturation constraints and unavailability of all system states) are gradually added, and other control schemes are developed based on the primary scenario. Through these exercises, the authors present structures that not only provide mathematical tools for navigating control problems, but also supply solutions that are pertinent to real-life systems.

This book discusses methods and algorithms for the near-optimal adaptive control of nonlinear systems, including the corresponding theoretical analysis and simulative examples, and presents two innovative methods for the redundancy resolution of redundant manipulators with consideration of parameter uncertainty and periodic disturbances. It also reports on a series of systematic investigations on a near-optimal adaptive control method based on the Taylor expansion, neural networks, estimator design approaches, and the idea of sliding mode control, focusing on the tracking control problem of nonlinear systems under different scenarios. The book culminates with a presentation of two new redundancy resolution methods; one addresses adaptive kinematic control of redundant manipulators, and the other centers on the effect of periodic input disturbance on redundancy resolution. Each self-contained chapter is clearly written, making the book accessible to graduate students as well as academic and industrial researchers in the fields of adaptive and optimal control, robotics, and dynamic neural networks.

Following the successful 1st CEAS (Council of European Aerospace Societies) Specialist Conference on Guidance, Navigation and Control (CEAS EuroGNC) held in Munich, Germany in 2011, Delft University of Technology happily accepted the invitation of organizing the 2nd CEAS EuroGNC in Delft, The Netherlands in 2013. The goal of the conference is to promote new advances in aerospace GNC theory and technologies for enhancing safety, survivability, efficiency, performance, autonomy and intelligence of aerospace systems using on-board sensing, computing and systems. A great push for new developments in GNC are the ever higher safety and sustainability requirements in aviation. Impressive progress was made in new research fields such as sensor and actuator fault detection and diagnosis, reconfigurable and fault tolerant flight control, online safe flight envelop prediction and protection, online global aerodynamic model identification, online global optimization and flight upset recovery. All of these challenges depend on new online solutions from on-board computing systems. Scientists and engineers in GNC have been developing model based, sensor based as well as knowledge based approaches aiming for highly robust, adaptive, nonlinear, intelligent and autonomous GNC systems. Although the papers presented at the conference and selected in this book could not possibly cover all of the present challenges in the GNC field, many of them have indeed been addressed and a wealth of new ideas, solutions and results were proposed and presented. For the 2nd CEAS Specialist Conference on Guidance, Navigation and Control the International Program Committee conducted a formal review process. Each paper was reviewed in compliance with good journal practice by at least two independent and anonymous reviewers. The papers published in this book were selected from the conference proceedings based on the results and recommendations from the reviewers.