High Level Feedback Control With Neural Networks

Complex industrial or robotic systems with uncertainty and disturbances are difficult to control. As system uncertainty or performance requirements increase, it becomes necessary to augment traditional feedback controllers with additional feedback loops that effectively “add intelligence” to the system. Some theories of artificial intelligence (AI) are now showing how complex machine systems should mimic human cognitive and biological processes to improve their capabilities for dealing with uncertainty.This book bridges the gap between feedback control and AI. It provides design techniques for “high-level” neural-network feedback-control topologies that contain servo-level feedback-control loops as well as AI decision and training at the higher levels. Several advanced feedback topologies containing neural networks are presented, including “dynamic output feedback”, “reinforcement learning” and “optimal design”, as well as a “fuzzy-logic reinforcement” controller. The control topologies are intuitive, yet are derived using sound mathematical principles where proofs of stability are given so that closed-loop performance can be relied upon in using these control systems. Computer-simulation examples are given to illustrate the performance.

Complex industrial or robotic systems with uncertainty and disturbances are difficult to control. As system uncertainty or performance requirements increase, it becomes necessary to augment traditional feedback controllers with additional feedback loops that effectively "add intelligence" to the system. Some theories of artificial intelligence (AI) are now showing how complex machine systems should mimic human cognitive and biological processes to improve their capabilities for dealing with uncertainty. This book bridges the gap between feedback control and AI. It provides design techniques for "high-level" neural-network feedback-control topologies that contain servo-level feedback-control loops as well as AI decision and training at the higher levels. Several advanced feedback topologies containing neural networks are presented, including "dynamic output feedback", "reinforcement learning" and "optimal design", as well as a "fuzzy-logic reinforcement" controller. The control topologies areintuitive, yet are derived using sound mathematical principles where proofs of stability are given so that closed-loop performance can be relied upon in using these control systems. Computer-simulation examples are given to illustrate the performance.

This book provides techniques to produce robust, stable and useable solutions to problems of H-infinity and H2 control in high-performance, non-linear systems for the first time. The book is of importance to control designers working in a variety of industrial systems. Case studies are given and the design of nonlinear control systems of the same caliber as those obtained in recent years using linear optimal and bounded-norm designs is explained.

Reinforcement learning (RL) and adaptive dynamic programming (ADP) has been one of the most critical research fields in science and engineering for modern complex systems. This book describes the latest RL and ADP techniques for decision and control in human engineered systems, covering both single player decision and control and multi-player games. Edited by the pioneers of RL and ADP research, the book brings together ideas and methods from many fields and provides an important and timely guidance on controlling a wide variety of systems, such as robots, industrial processes, and economic decision-making.

Intelligent systems are a hallmark of modern feedback control systems. But as these systems mature, we have come to expect higher levels of performance in speed and accuracy in the face of severe nonlinearities, disturbances, unforeseen dynamics, and unstructured uncertainties. Artificial neural networks offer a combination of adaptability, parallel processing, and learning capabilities that outperform other intelligent control methods in more complex systems. Borrowing from Biology Examining neurocontroller design in discrete-time for the first time, Neural Network Control of Nonlinear Discrete-Time Systems presents powerful modern control techniques based on the parallelism and adaptive capabilities of biological nervous systems. At every step, the author derives rigorous stability proofs and presents simulation examples to demonstrate the concepts. Progressive Development After an introduction to neural networks, dynamical systems, control of nonlinear systems, and feedback linearization, the book builds systematically from actuator nonlinearities and strict feedback in nonlinear systems to nonstrict feedback, system identification, model reference adaptive control, and novel optimal control using the Hamilton-Jacobi-Bellman formulation. The author concludes by developing a framework for implementing intelligent control in actual industrial systems using embedded hardware. Neural Network Control of Nonlinear Discrete-Time Systems fosters an understanding of neural network controllers and explains how to build them using detailed derivations, stability analysis, and computer simulations.

Radial Basis Function (RBF) Neural Network Control for Mechanical Systems is motivated by the need for systematic design approaches to stable adaptive control system design using neural network approximation-based techniques. The main objectives of the book are to introduce the concrete design methods and MATLAB simulation of stable adaptive RBF neural control strategies. In this book, a broad range of implementable neural network control design methods for mechanical systems are presented, such as robot manipulators, inverted pendulums, single link flexible joint robots, motors, etc. Advanced neural network controller design methods and their stability analysis are explored. The book provides readers with the fundamentals of neural network control system design. This book is intended for the researchers in the fields of neural adaptive control, mechanical systems, Matlab simulation, engineering design, robotics and automation. Jinkun Liu is a professor at Beijing University of Aeronautics and Astronautics.

This Encyclopedia of Control Systems, Robotics, and Automation is a component of the global Encyclopedia of Life Support Systems EOLSS, which is an integrated compendium of twenty one Encyclopedias. This 22-volume set contains 240 chapters, each of size 5000-30000 words, with perspectives, applications and extensive illustrations. It is the only publication of its kind carrying state-of-the-art knowledge in the fields of Control Systems, Robotics, and Automation and is aimed, by virtue of the several applications, at the following five major target audiences: University and College Students, Educators, Professional Practitioners, Research Personnel and Policy Analysts, Managers, and Decision Makers and NGOs.

Neural Networks for Control brings together examples of all the most important paradigms for the application of neural networks to robotics and control. Primarily concerned with engineering problems and approaches to their solution through neurocomputing systems, the book is divided into three sections: general principles, motion control, and applications domains (with evaluations of the possible applications by experts in the applications areas.) Special emphasis is placed on designs based on optimization or reinforcement, which will become increasingly important as researchers address more complex engineering challenges or real biological-control problems.A Bradford Book. Neural Network Modeling and Connectionism series