Robot Shaping

foreword by Lashon Booker To program an autonomous robot to act reliably in a dynamic environment is a complex task. The dynamics of the environment are unpredictable, and the robots' sensors provide noisy input. A learning autonomous robot, one that can acquire knowledge through interaction with its environment and then adapt its behavior, greatly simplifies the designer's work. A learning robot need not be given all of the details of its environment, and its sensors and actuators need not be finely tuned. Robot Shaping is about designing and building learning autonomous robots. The term "shaping" comes from experimental psychology, where it describes the incremental training of animals. The authors propose a new engineering discipline, "behavior engineering," to provide the methodologies and tools for creating autonomous robots. Their techniques are based on classifier systems, a reinforcement learning architecture originated by John Holland, to which they have added several new ideas, such as "mutespec," classifier system "energy,"and dynamic population size. In the book they present Behavior Analysis and Training (BAT) as an example of a behavior engineering methodology.

Robots are being used in increasingly complicated and demanding tasks, often in environments that are complex or even hostile. Underwater, space and volcano exploration are just some of the activities that robots are taking part in, mainly because the environments that are being explored are dangerous for humans. Robots can also inhabit dynamic environments, for example to operate among humans, not just in factories, but also taking on more active roles. Recently, for instance, they have made their way into the home entertainment market. Given the variety of situations that robots will be placed in, learning becomes increasingly important. Robot learning is essentially about equipping robots with the capacity to improve their behaviour over time, based on their incoming experiences. The papers in this volume present a variety of techniques. Each paper provides a mini-introduction to a subfield of robot learning. Some also give a fine introduction to the field of robot learning as a whole. There is one unifying aspect to the work reported in the book, namely its interdisciplinary nature, especially in the combination of robotics, computer science and biology. This approach has two important benefits: first, the study of learning in biological systems can provide robot learning scientists and engineers with valuable insights into learning mechanisms of proven functionality and versatility; second, computational models of learning in biological systems, and their implementation in simulated agents and robots, can provide researchers of biological systems with a powerful platform for the development and testing of learning theories. Contents:Interdisciplinary Approaches to Robot Learning: Introduction (J Demiris & A Birk)Bootstrapping the Developmental Process: The Filter Hypothesis (L Berthouze)Biomimetic Gaze Stabilization (T Shibata & S Schaal)Experiments and Models About Cognitive Map Learning for Motivated Navigation (P Gaussier et al.)Learning Selection of Action for Cortically-Inspired Robot Control (H Frezza-Buet & F Alexandre)Transferring Learned Knowledge in a Lifelong Learning Mobile Robot Agent (J O'Sullivan)Of Hummingbirds and Helicopters: An Algebraic Framework for Interdisciplinary Studies of Imitation and Its Applications (C Nehaniv & K Dautenhahn)Evolving Complex Visual Behaviours Using Genetic Programming and Shaping (S Perkins & G M Hayes)Preston: A System for the Evaluation of Behaviour Sequences (M Wilson) Readership: Researchers and graduate students in robotics and machine learning who are interested in interdisciplinary approaches to their fields. Keywords:Robotics;Learning, Interdisciplinary Approaches;Robot Learning;Robots;Adaptivity;Biologically Inspired Robotics

This book is the result of over ten (10) years of research and development in flexible robots and structures at Sandia National Laboratories. The authors de cided to collect this wealth of knowledge into a set of viewgraphs in order to teach a graduate class in Flexible Robot Dynamics and Controls within the Mechanical En gineering Department at the University of New Mexico (UNM). These viewgraphs, encouragement from several students, and many late nights have produced a book that should provide an upper-level undergraduate and graduate textbook and a reference for experienced professionals. The content of this book spans several disciplines including structural dynam ics, system identification, optimization, and linear, digital, and nonlinear control theory which are developed from several points of view including electrical, me chanical, and aerospace engineering as well as engineering mechanics. As a result, the authors believe that this book demonstrates the value of solid applied theory when developing hardware solutions to real world problems. The reader will find many real world applications in this book and will be shown the applicability of these techniques beyond flexible structures which, in turn, shows the value of mul tidisciplinary education and teaming.

Presents a unified treatment of HRI-related issues, identifies key themes, and discusses challenge problems that are likely to shape the field in the near future. The survey includes research results from a cross section of the universities, government efforts, industry labs, and countries that contribute to HRI.

This book provides a collection of fourty articles containing new material on both theoretical aspects of Evolutionary Computing (EC), and demonstrating the usefulness/success of it for various kinds of large-scale real world problems. Around 23 articles deal with various theoretical aspects of EC and 17 articles demonstrate the success of EC methodologies. These articles are written by leading experts of the field from different countries all over the world.

As the capability and utility of robots has increased dramatically with new technology, robotic systems can perform tasks that are physically dangerous for humans, repetitive in nature, or require increased accuracy, precision, and sterile conditions to radically minimize human error. The Robotics and Automation Handbook addresses the major aspects of designing, fabricating, and enabling robotic systems and their various applications. It presents kinetic and dynamic methods for analyzing robotic systems, considering factors such as force and torque. From these analyses, the book develops several controls approaches, including servo actuation, hybrid control, and trajectory planning. Design aspects include determining specifications for a robot, determining its configuration, and utilizing sensors and actuators. The featured applications focus on how the specific difficulties are overcome in the development of the robotic system. With the ability to increase human safety and precision in applications ranging from handling hazardous materials and exploring extreme environments to manufacturing and medicine, the uses for robots are growing steadily. The Robotics and Automation Handbook provides a solid foundation for engineers and scientists interested in designing, fabricating, or utilizing robotic systems.

A jaw-dropping exploration of everything that goes wrong when we build AI systems and the movement to fix them. Today’s “machine-learning” systems, trained by data, are so effective that we’ve invited them to see and hear for us—and to make decisions on our behalf. But alarm bells are ringing. Recent years have seen an eruption of concern as the field of machine learning advances. When the systems we attempt to teach will not, in the end, do what we want or what we expect, ethical and potentially existential risks emerge. Researchers call this the alignment problem. Systems cull résumés until, years later, we discover that they have inherent gender biases. Algorithms decide bail and parole—and appear to assess Black and White defendants differently. We can no longer assume that our mortgage application, or even our medical tests, will be seen by human eyes. And as autonomous vehicles share our streets, we are increasingly putting our lives in their hands. The mathematical and computational models driving these changes range in complexity from something that can fit on a spreadsheet to a complex system that might credibly be called “artificial intelligence.” They are steadily replacing both human judgment and explicitly programmed software. In best-selling author Brian Christian’s riveting account, we meet the alignment problem’s “first-responders,” and learn their ambitious plan to solve it before our hands are completely off the wheel. In a masterful blend of history and on-the ground reporting, Christian traces the explosive growth in the field of machine learning and surveys its current, sprawling frontier. Readers encounter a discipline finding its legs amid exhilarating and sometimes terrifying progress. Whether they—and we—succeed or fail in solving the alignment problem will be a defining human story. The Alignment Problem offers an unflinching reckoning with humanity’s biases and blind spots, our own unstated assumptions and often contradictory goals. A dazzlingly interdisciplinary work, it takes a hard look not only at our technology but at our culture—and finds a story by turns harrowing and hopeful.