Stochastic Networked Control Systems

Networked control systems are increasingly ubiquitous today, with applications ranging from vehicle communication and adaptive power grids to space exploration and economics. The optimal design of such systems presents major challenges, requiring tools from various disciplines within applied mathematics such as decentralized control, stochastic control, information theory, and quantization. A thorough, self-contained book, Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints aims to connect these diverse disciplines with precision and rigor, while conveying design guidelines to controller architects. Unique in the literature, it lays a comprehensive theoretical foundation for the study of networked control systems, and introduces an array of concrete tools for work in the field. Salient features included: · Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems. · Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods. · Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems. · Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models. · Decentralized agreement and dynamic optimization under information constraints. This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end. · Characterization, comparison and optimal design of information structures in static and dynamic teams. Operational, structural and topological properties of information structures in optimal decision making, with a systematic program for generating optimal encoding and control policies. The notion of signaling, and its utilization in stabilization and optimization of decentralized control systems. · Presentation of mathematical methods for stochastic stability of networked control systems using random-time, state-dependent drift conditions and martingale methods. · Characterization and study of information channels leading to various forms of stochastic stability such as stationarity, ergodicity, and quadratic stability; and connections with information and quantization theories. Analysis of various classes of centralized and decentralized control systems. · Jointly optimal design of encoding and control policies over various information channels and under general optimization criteria, including a detailed coverage of linear-quadratic-Gaussian models. · Decentralized agreement and dynamic optimization under information constraints. This monograph is geared toward a broad audience of academic and industrial researchers interested in control theory, information theory, optimization, economics, and applied mathematics. It could likewise serve as a supplemental graduate text. The reader is expected to have some familiarity with linear systems, stochastic processes, and Markov chains, but the necessary background can also be acquired in part through the four appendices included at the end.

This book nds its origin in the WIDE PhD School on Networked Control Systems, which we organized in July 2009 in Siena, Italy. Having gathered experts on all the aspects of networked control systems, it was a small step to go from the summer school to the book, certainly given the enthusiasm of the lecturers at the school. We felt that a book collecting overviewson the important developmentsand open pr- lems in the eld of networked control systems could stimulate and support future research in this appealing area. Given the tremendouscurrentinterests in distributed control exploiting wired and wireless communication networks, the time seemed to be right for the book that lies now in front of you. The goal of the book is to set out the core techniques and tools that are ava- able for the modeling, analysis and design of networked control systems. Roughly speaking, the book consists of three parts. The rst part presents architectures for distributed control systems and models of wired and wireless communication n- works. In particular, in the rst chapter important technological and architectural aspects on distributed control systems are discussed. The second chapter provides insight in the behavior of communication channels in terms of delays, packet loss and information constraints leading to suitable modeling paradigms for commu- cation networks.

Optimal Networked Control Systems with MATLAB® discusses optimal controller design in discrete time for networked control systems (NCS). The authors apply several powerful modern control techniques in discrete time to the design of intelligent controllers for such NCS. Detailed derivations, rigorous stability proofs, computer simulation examples, and downloadable MATLAB® codes are included for each case. The book begins by providing background on NCS, networked imperfections, dynamical systems, stability theory, and stochastic optimal adaptive controllers in discrete time for linear and nonlinear systems. It lays the foundation for reinforcement learning-based optimal adaptive controller use for finite and infinite horizons. The text then: Introduces quantization effects for linear and nonlinear NCS, describing the design of stochastic adaptive controllers for a class of linear and nonlinear systems Presents two-player zero-sum game-theoretic formulation for linear systems in input–output form enclosed by a communication network Addresses the stochastic optimal control of nonlinear NCS by using neuro dynamic programming Explores stochastic optimal design for nonlinear two-player zero-sum games under communication constraints Treats an event-sampled distributed NCS to minimize transmission of state and control signals within the feedback loop via the communication network Covers distributed joint optimal network scheduling and control design for wireless NCS, as well as the effect of network protocols on the wireless NCS controller design An ideal reference for graduate students, university researchers, and practicing engineers, Optimal Networked Control Systems with MATLAB® instills a solid understanding of neural network controllers and how to build them.

This book introduces a unique, packet-based co-design control framework for networked control systems. It begins by providing a comprehensive survey of state-of-the-art research on networked control systems, giving readers a general overview of the field. It then verifies the proposed control framework both theoretically and experimentally – the former using multiple control methodologies, and the latter using a unique online test rig for networked control systems. The framework investigates in detail the most common, communication constraints, including network-induced delays, data packet dropout, data packet disorders, and network access constraints, as well as multiple controller design and system analysis tools such as model predictive control, linear matrix inequalities and optimal control. This unique and complete co-design framework greatly benefits researchers, graduate students and engineers in the fields of control theory and engineering.

In this book, control and filtering problems for several classes of stochastic networked systems are discussed. In each chapter, the stability, robustness, reliability, consensus performance, and/or disturbance attenuation levels are investigated within a unified theoretical framework. The aim is to derive the sufficient conditions such that the resulting systems achieve the prescribed design requirements despite all the network-induced phenomena. Further, novel notions such as randomly occurring sensor failures and consensus in probability are discussed. Finally, the theories/techniques developed are applied to emerging research areas. Key Features Unifies existing and emerging concepts concerning stochastic control/filtering and distributed control/filtering with an emphasis on a variety of network-induced complexities Includes concepts like randomly occurring sensor failures and consensus in probability (with respect to time-varying stochastic multi-agent systems) Exploits the recursive linear matrix inequality approach, completing the square method, Hamilton-Jacobi inequality approach, and parameter-dependent matrix inequality approach to handle the emerging mathematical/computational challenges Captures recent advances of theories, techniques, and applications of stochastic control as well as filtering from an engineering-oriented perspective Gives simulation examples in each chapter to reflect the engineering practice

In this book, control and filtering problems for several classes of stochastic networked systems are discussed. In each chapter, the stability, robustness, reliability, consensus performance, and/or disturbance attenuation levels are investigated within a unified theoretical framework. The aim is to derive the sufficient conditions such that the resulting systems achieve the prescribed design requirements despite all the network-induced phenomena. Further, novel notions such as randomly occurring sensor failures and consensus in probability are discussed. Finally, the theories/techniques developed are applied to emerging research areas. Key Features Unifies existing and emerging concepts concerning stochastic control/filtering and distributed control/filtering with an emphasis on a variety of network-induced complexities Includes concepts like randomly occurring sensor failures and consensus in probability (with respect to time-varying stochastic multi-agent systems) Exploits the recursive linear matrix inequality approach, completing the square method, Hamilton-Jacobi inequality approach, and parameter-dependent matrix inequality approach to handle the emerging mathematical/computational challenges Captures recent advances of theories, techniques, and applications of stochastic control as well as filtering from an engineering-oriented perspective Gives simulation examples in each chapter to reflect the engineering practice

This book shows some secure control methods of networked control systems related to linear control system, nonlinear control system, multi-agent system and its applications in power systems. The proposed secure control methods provide some useful results about modeling of network attacks, resilient analysis and synthesis methods, active defense control method.The contents of this book are lists as followings. (1) Modeling of DoS attacks, deception attacks and replay attacks; (2)Secure control methods are proposed by combing delay system method, switched system method and event-based control method. (3) Active control methods are proposed by using model-predictive control and redundant control. (4) The proposed control methods are applied to the security problem of power system.The methods of this book include DoS attacks modeling such as, periodic jamming attack model,model-based average dwell time model, deception attack modeling and relay attack modeling; piece-wise Lyapunov-Krasoviskiifunctional method, stochastic control method; the results including resilient conditions of networked control system and related resilient control design method with linear matrix inequalities(LMIs).From this book, readers can learn about the general network attack modeling methods, resilient analysis and synthesis methods, active control methods from viewpoint of redundancy control, and secure conditions of power systems.Some fundamental knowledge prepared to read this book includes delay system theory, event triggered mechanism, T-S fuzzy system theory and frequency/voltage control of power system.

Analysis and Synthesis of Networked Control Systems focuses on essential aspects of this field, including quantization over networks, data fusion over networks, predictive control over networks and fault detection over networks. The networked control systems have led to a complete new range of real-world applications. In recent years, the techniques of Internet of Things are developed rapidly, the research of networked control systems plays a key role in Internet of Things. The book is self-contained, providing sufficient mathematical foundations for understanding the contents of each chapter. It will be of significant interest to scientists and engineers engaged in the field of Networked Control Systems. Dr. Yuanqing Xia, a professor at Beijing Institute of Technology, has been working on control theory and its applications for over ten years.