Recent Advances In Robot Learning

Recent Advances in Robot Learning contains seven papers on robot learning written by leading researchers in the field. As the selection of papers illustrates, the field of robot learning is both active and diverse. A variety of machine learning methods, ranging from inductive logic programming to reinforcement learning, is being applied to many subproblems in robot perception and control, often with objectives as diverse as parameter calibration and concept formulation. While no unified robot learning framework has yet emerged to cover the variety of problems and approaches described in these papers and other publications, a clear set of shared issues underlies many robot learning problems. Machine learning, when applied to robotics, is situated: it is embedded into a real-world system that tightly integrates perception, decision making and execution. Since robot learning involves decision making, there is an inherent active learning issue. Robotic domains are usually complex, yet the expense of using actual robotic hardware often prohibits the collection of large amounts of training data. Most robotic systems are real-time systems. Decisions must be made within critical or practical time constraints. These characteristics present challenges and constraints to the learning system. Since these characteristics are shared by other important real-world application domains, robotics is a highly attractive area for research on machine learning. On the other hand, machine learning is also highly attractive to robotics. There is a great variety of open problems in robotics that defy a static, hand-coded solution. Recent Advances in Robot Learning is an edited volume of peer-reviewed original research comprising seven invited contributions by leading researchers. This research work has also been published as a special issue of Machine Learning (Volume 23, Numbers 2 and 3).

Building a robot that learns to perform a task has been acknowledged as one of the major challenges facing artificial intelligence. Self-improving robots would relieve humans from much of the drudgery of programming and would potentially allow operation in environments that were changeable or only partially known. Progress towards this goal would also make fundamental contributions to artificial intelligence by furthering our understanding of how to successfully integrate disparate abilities such as perception, planning, learning and action. Although its roots can be traced back to the late fifties, the area of robot learning has lately seen a resurgence of interest. The flurry of interest in robot learning has partly been fueled by exciting new work in the areas of reinforcement earning, behavior-based architectures, genetic algorithms, neural networks and the study of artificial life. Robot Learning gives an overview of some of the current research projects in robot learning being carried out at leading universities and research laboratories in the United States. The main research directions in robot learning covered in this book include: reinforcement learning, behavior-based architectures, neural networks, map learning, action models, navigation and guided exploration.

Mobile robots are the focus of a great deal of current research in robotics. Mobile robotics is a young, multidisciplinary field involving knowledge from many areas, including electrical, electronic and mechanical engineering, computer, cognitive and social sciences. Being engaged in the design of automated systems, it lies at the intersection of artificial intelligence, computational vision, and robotics. Thanks to the numerous researchers sharing their goals, visions and results within the community, mobile robotics is becoming a very rich and stimulating area. The book Recent Advances in Mobile Robotics addresses the topic by integrating contributions from many researchers around the globe. It emphasizes the computational methods of programming mobile robots, rather than the methods of constructing the hardware. Its content reflects different complementary aspects of theory and practice, which have recently taken place. We believe that it will serve as a valuable handbook to those who work in research and development of mobile robots.

Deep Learning for Robot Perception and Cognition introduces a broad range of topics and methods in deep learning for robot perception and cognition together with end-to-end methodologies. The book provides the conceptual and mathematical background needed for approaching a large number of robot perception and cognition tasks from an end-to-end learning point-of-view. The book is suitable for students, university and industry researchers and practitioners in Robotic Vision, Intelligent Control, Mechatronics, Deep Learning, Robotic Perception and Cognition tasks. Presents deep learning principles and methodologies Explains the principles of applying end-to-end learning in robotics applications Presents how to design and train deep learning models Shows how to apply deep learning in robot vision tasks such as object recognition, image classification, video analysis, and more Uses robotic simulation environments for training deep learning models Applies deep learning methods for different tasks ranging from planning and navigation to biosignal analysis

This book brings together some recent advances and development in robotics. In 12 chapters, written by experts and researchers in respective fields, the book presents some up-to-date research ideas and findings in a wide range of robotics, including the design, modeling, control, learning, interaction, and navigation of robots. From an application perspective, the book covers UAVs, USVs, mobile robots, humanoid robots, graspers, and underwater robots. The unique text offers practical guidance to graduate students and researchers in research and applications in the field of robotics.

This book constitutes the thoroughly refereed post-workshop proceedings of the 8th European Workshop on Learning Robots, EWLR'99, held in Lausanne, Switzerland in September 1999. The seven revised full workshop papers presented were carefully reviewed and selected for inclusion in the book. Also included are two invited full papers. Among the topics addressed are map building for robot navigation, multi-task reinforcement learning, neural network approaches, example-based learning, situated agents, planning maps for mobile robots, path finding, autonomous robots, and biologically inspired approaches.

In the last decades robots are expected to be of increasing intelligence to deal with a large range of tasks. Especially, robots are supposed to be able to learn manipulation skills from humans. To this end, a number of learning algorithms and techniques have been developed and successfully implemented for various robotic tasks. Among these methods, learning from demonstrations (LfD) enables robots to effectively and efficiently acquire skills by learning from human demonstrators, such that a robot can be quickly programmed to perform a new task. This book introduces recent results on the development of advanced LfD-based learning and control approaches to improve the robot dexterous manipulation. First, there's an introduction to the simulation tools and robot platforms used in the authors' research. In order to enable a robot learning of human-like adaptive skills, the book explains how to transfer a human user’s arm variable stiffness to the robot, based on the online estimation from the muscle electromyography (EMG). Next, the motion and impedance profiles can be both modelled by dynamical movement primitives such that both of them can be planned and generalized for new tasks. Furthermore, the book introduces how to learn the correlation between signals collected from demonstration, i.e., motion trajectory, stiffness profile estimated from EMG and interaction force, using statistical models such as hidden semi-Markov model and Gaussian Mixture Regression. Several widely used human-robot interaction interfaces (such as motion capture-based teleoperation) are presented, which allow a human user to interact with a robot and transfer movements to it in both simulation and real-word environments. Finally, improved performance of robot manipulation resulted from neural network enhanced control strategies is presented. A large number of examples of simulation and experiments of daily life tasks are included in this book to facilitate better understanding of the readers.

Robots are being used in increasingly complicated and demanding tasks, often in environments that are complex or even hostile. Underwater, space and volcano exploration are just some of the activities that robots are taking part in, mainly because the environments that are being explored are dangerous for humans. Robots can also inhabit dynamic environments, for example to operate among humans, not just in factories, but also taking on more active roles. Recently, for instance, they have made their way into the home entertainment market. Given the variety of situations that robots will be placed in, learning becomes increasingly important. Robot learning is essentially about equipping robots with the capacity to improve their behaviour over time, based on their incoming experiences. The papers in this volume present a variety of techniques. Each paper provides a mini-introduction to a subfield of robot learning. Some also give a fine introduction to the field of robot learning as a whole. There is one unifying aspect to the work reported in the book, namely its interdisciplinary nature, especially in the combination of robotics, computer science and biology. This approach has two important benefits: first, the study of learning in biological systems can provide robot learning scientists and engineers with valuable insights into learning mechanisms of proven functionality and versatility; second, computational models of learning in biological systems, and their implementation in simulated agents and robots, can provide researchers of biological systems with a powerful platform for the development and testing of learning theories. Contents:Interdisciplinary Approaches to Robot Learning: Introduction (J Demiris & A Birk)Bootstrapping the Developmental Process: The Filter Hypothesis (L Berthouze)Biomimetic Gaze Stabilization (T Shibata & S Schaal)Experiments and Models About Cognitive Map Learning for Motivated Navigation (P Gaussier et al.)Learning Selection of Action for Cortically-Inspired Robot Control (H Frezza-Buet & F Alexandre)Transferring Learned Knowledge in a Lifelong Learning Mobile Robot Agent (J O'Sullivan)Of Hummingbirds and Helicopters: An Algebraic Framework for Interdisciplinary Studies of Imitation and Its Applications (C Nehaniv & K Dautenhahn)Evolving Complex Visual Behaviours Using Genetic Programming and Shaping (S Perkins & G M Hayes)Preston: A System for the Evaluation of Behaviour Sequences (M Wilson) Readership: Researchers and graduate students in robotics and machine learning who are interested in interdisciplinary approaches to their fields. Keywords:Robotics;Learning, Interdisciplinary Approaches;Robot Learning;Robots;Adaptivity;Biologically Inspired Robotics