Robot Learning Human Skills And Intelligent Control Design

In the last decades robots are expected to be of increasing intelligence to deal with a large range of tasks. Especially, robots are supposed to be able to learn manipulation skills from humans. To this end, a number of learning algorithms and techniques have been developed and successfully implemented for various robotic tasks. Among these methods, learning from demonstrations (LfD) enables robots to effectively and efficiently acquire skills by learning from human demonstrators, such that a robot can be quickly programmed to perform a new task. This book introduces recent results on the development of advanced LfD-based learning and control approaches to improve the robot dexterous manipulation. First, there's an introduction to the simulation tools and robot platforms used in the authors' research. In order to enable a robot learning of human-like adaptive skills, the book explains how to transfer a human user's arm variable stiffness to the robot, based on the online estimation from the muscle electromyography (EMG). Next, the motion and impedance profiles can be both modelled by dynamical movement primitives such that both of them can be planned and generalized for new tasks. Furthermore, the book introduces how to learn the correlation between signals collected from demonstration, i.e., motion trajectory, stiffness profile estimated from EMG and interaction force, using statistical models such as hidden semi-Markov model and Gaussian Mixture Regression. Several widely used human-robot interaction interfaces (such as motion capture-based teleoperation) are presented, which allow a human user to interact with a robot and transfer movements to it in both simulation and real-word environments. Finally, improved performance of robot manipulation resulted from neural network enhanced control strategies is presented. A large number of examples of simulation and experiments of daily life tasks are included in this book to facilitate better understanding of the readers.

In the last decades robots are expected to be of increasing intelligence to deal with a large range of tasks. Especially, robots are supposed to be able to learn manipulation skills from humans. To this end, a number of learning algorithms and techniques have been developed and successfully implemented for various robotic tasks. Among these methods, learning from demonstrations (LfD) enables robots to effectively and efficiently acquire skills by learning from human demonstrators, such that a robot can be quickly programmed to perform a new task. This book introduces recent results on the development of advanced LfD-based learning and control approaches to improve the robot dexterous manipulation. First, there's an introduction to the simulation tools and robot platforms used in the authors' research. In order to enable a robot learning of human-like adaptive skills, the book explains how to transfer a human user’s arm variable stiffness to the robot, based on the online estimation from the muscle electromyography (EMG). Next, the motion and impedance profiles can be both modelled by dynamical movement primitives such that both of them can be planned and generalized for new tasks. Furthermore, the book introduces how to learn the correlation between signals collected from demonstration, i.e., motion trajectory, stiffness profile estimated from EMG and interaction force, using statistical models such as hidden semi-Markov model and Gaussian Mixture Regression. Several widely used human-robot interaction interfaces (such as motion capture-based teleoperation) are presented, which allow a human user to interact with a robot and transfer movements to it in both simulation and real-word environments. Finally, improved performance of robot manipulation resulted from neural network enhanced control strategies is presented. A large number of examples of simulation and experiments of daily life tasks are included in this book to facilitate better understanding of the readers.

Human-in-the-loop Learning and Control for Robot Teleoperation presents recent, research progress on teleoperation and robots, including human-robot interaction, learning and control for teleoperation with many extensions on intelligent learning techniques. The book integrates cutting-edge research on learning and control algorithms of robot teleoperation, neural motor learning control, wave variable enhancement, EMG-based teleoperation control, and other key aspects related to robot technology, presenting implementation tactics, adequate application examples and illustrative interpretations. Robots have been used in various industrial processes to reduce labor costs and improve work efficiency. However, most robots are only designed to work on repetitive and fixed tasks, leaving a gap with the human desired manufacturing effect. Introduces research progress and technical contributions on teleoperation robots, including intelligent human-robot interactions and learning and control algorithms for teleoperation Presents control strategies and learning algorithms to a teleoperation framework to enhance human-robot shared control, bi-directional perception and intelligence of the teleoperation system Discusses several control and learning methods, describes the working implementation and shows how these methods can be applied to a specific and practical teleoperation system

This book focusses on robotic skill learning and intelligent control for robotic manipulators including enabling of robots to efficiently learn motor and stiffness/force regulation policies from humans. It explains transfer of human limb impedance control strategies to the robots so that the adaptive impedance control for the robot can be realized.

As robotic systems make their way into standard practice, they have opened the door to a wide spectrum of complex applications. Such applications usually demand that the robots be highly intelligent. Future robots are likely to have greater sensory capabilities, more intelligence, higher levels of manual dexter ity, and adequate mobility, compared to humans. In order to ensure high-quality control and performance in robotics, new intelligent control techniques must be developed, which are capable of coping with task complexity, multi-objective decision making, large volumes of perception data and substantial amounts of heuristic information. Hence, the pursuit of intelligent autonomous robotic systems has been a topic of much fascinating research in recent years. On the other hand, as emerging technologies, Soft Computing paradigms consisting of complementary elements of Fuzzy Logic, Neural Computing and Evolutionary Computation are viewed as the most promising methods towards intelligent robotic systems. Due to their strong learning and cognitive ability and good tolerance of uncertainty and imprecision, Soft Computing techniques have found wide application in the area of intelligent control of robotic systems.

With the increasing applications of intelligent robotic systems in various ?elds, the - sign and control of these systems have increasingly attracted interest from researchers. This edited book entitled “Design and Control of Intelligent Robotic Systems” in the book series of “Studies in Computational Intelligence” is a collection of some advanced research on design and control of intelligent robots. The works presented range in scope from design methodologies to robot development. Various design approaches and al- rithms, such as evolutionary computation, neural networks, fuzzy logic, learning, etc. are included. We also would like to mention that most studies reported in this book have been implemented in physical systems. An overview on the applications of computational intelligence in bio-inspired robotics is given in Chapter 1 by M. Begum and F. Karray, with highlights of the recent progress in bio-inspired robotics research and a focus on the usage of computational intelligence tools to design human-like cognitive abilities in the robotic systems. In Chapter 2, Lisa L. Grant and Ganesh K. Venayagamoorthy present greedy search, particle swarm optimization and fuzzy logic based strategies for navigating a swarm of robots for target search in a hazardous environment, with potential applications in high-risk tasks such as disaster recovery and hazardous material detection.

Learning from Demonstration (LfD) explores techniques for learning a task policy from examples provided by a human teacher. The field of LfD has grown into an extensive body of literature over the past 30 years, with a wide variety of approaches for encoding human demonstrations and modeling skills and tasks. Additionally, we have recently seen a focus on gathering data from non-expert human teachers (i.e., domain experts but not robotics experts). In this book, we provide an introduction to the field with a focus on the unique technical challenges associated with designing robots that learn from naive human teachers. We begin, in the introduction, with a unification of the various terminology seen in the literature as well as an outline of the design choices one has in designing an LfD system. Chapter 2 gives a brief survey of the psychology literature that provides insights from human social learning that are relevant to designing robotic social learners. Chapter 3 walks through an LfD interaction, surveying the design choices one makes and state of the art approaches in prior work. First, is the choice of input, how the human teacher interacts with the robot to provide demonstrations. Next, is the choice of modeling technique. Currently, there is a dichotomy in the field between approaches that model low-level motor skills and those that model high-level tasks composed of primitive actions. We devote a chapter to each of these. Chapter 7 is devoted to interactive and active learning approaches that allow the robot to refine an existing task model. And finally, Chapter 8 provides best practices for evaluation of LfD systems, with a focus on how to approach experiments with human subjects in this domain.

This book moves from a thorough investigation of human capabilities during movements and interactions with objects and environment and translates those principles into the design planning and control of innovative mechatronic systems, providing significant advancements in the fields of human–robot interaction, autonomous robots, prosthetics and assistive devices. The work presented in this monograph is characterized by a significant paradigmatic shift with respect to typical approaches, as it always place the human at the center of the technology developed, and the human represents the starting point and the actual beneficiary of the developed solutions. The content of this book is targeted to robotics and neuroscience enthusiasts, researchers and makers, students and simple lovers of the matter.