A Hybrid Physical And Data Drivapproach To Motion Prediction And Control In Human Robot Collaboration

In recent years, researchers have achieved great success in guaranteeing safety in human-robot interaction, yielding a new generation of robots that can work with humans in close proximity, known as collaborative robots (cobots). However, due to the lack of ability to understand and coordinate with their human partners, the ``co'' in most cobots still refers to ``coexistence'' rather than ``collaboration''. This thesis aims to develop an adaptive learning and control framework with a novel physical and data-driven approach towards a real collaborative robot. The first part focuses on online human motion prediction. A comprehensive study on various motion prediction techniques is presented, including their scope of application, accuracy in different time scales, and implementation complexity. Based on this study, a hybrid approach that combines physically well-understood models with data-driven learning techniques is proposed and validated through a motion data set. The second part addresses interaction control in human-robot collaboration. An adaptive impedance control scheme with human reference estimation is presented. Reinforcement learning is used to find optimal control parameters to minimize a task-orient cost function without fully knowing the system dynamic. The proposed framework is experimentally validated through two benchmark applications for human-robot collaboration: object handover and cooperative object handling. Results show that the robot can provide reliable online human motion prediction, react early to human motion variation, make proactive contributions to physical collaborations, and behave compliantly in response to human forces.

Since the manipulation tasks for robotic systems become more and more complicated, multi-robot cooperation has been attracting much attention recently. Furthermore, under the trend of human-robot co-existence, collision-free motion control is now also desired on multi-robot groups. This dissertation aims to design a novel distributed optimal control framework to deal with multi-robot cooperative manipulation of rigid objects in dynamic environments. Besides object transportation, the control scheme also tackles obstacle avoidance, joint-space performance optimisation and internal force suppression. The proposed control framework has a two-layer structure, with a distributed optimisation algorithm in the kinematic layer for generating proper joint configuration references, followed by a robot motion controller in the dynamic control layer to fulfil the reference. An indirect and a direct distributed optimisation method are developed for the kinematic layer, both of which are computationally and communicationally efficient. In the dynamic control layer, impedance control is employed for safe physical interaction. As another highlight, abundant experiments carried out on a multi-arm test bench have demonstrated the effectiveness of the presented control schemes under various environmental and task settings. The recorded computation time shows the applicability of the control framework in practice.

In the past years there has been considerable effort to move robots from industrial environments to our daily lives where they can collaborate and interact with humans to improve our life quality. One of the key challenges in this direction is to make a suitable robot control system that can adapt to humans and interactively learn from humans to facilitate the efficient and safe co-existence of the two. The applications of such robotic systems include: service robotics and physical human-robot collaboration, assistive and rehabilitation robotics, semi-autonomous cars, etc. To achieve the goal of integrating robotic systems into these applications, several important research directions must be explored. One such direction is the study of skill transfer, where a human operator’s skilled executions are used to obtain an autonomous controller. Another important direction is shared control, where a robotic controller and humans control the same body, tool, mechanism, car, etc. Shared control, in turn invokes very rich research questions such as co-adaptation between the human and the robot, where the two agents can benefit from each other’s skills or must adapt to each other’s behavior to achieve effective cooperative task executions. The aim of this Research Topic is to help bridge the gap between the state-of-the-art and above-mentioned goals through novel multidisciplinary approaches in human-in-the-loop robot control and learning.

This book highlights the latest research in computational intelligence and its applications. It covers both conventional and trending approaches in individual chapters on Fuzzy Systems, Intelligence in Robotics, Deep Learning Approaches, Optimization and Classification, Detection, Inference and Prediction, Hybrid Methods, Emerging Intelligence, Intelligent Health Care, and Engineering Data- and Model-Driven Applications. All chapters are based on peer-reviewed contributions presented at the 19th Annual UK Workshop on Computational Intelligence, held in Portsmouth, UK, on 4–6 September 2019. The book offers a valuable reference guide for readers with expertise in computational intelligence or who are seeking a comprehensive and timely review of the latest trends in computational intelligence. Special emphasis is placed on novel methods and their use in a wide range of application areas, updating both academics and professionals on the state of the art.

With the progress and development of human-robot systems, the coordination among humans, robots, and environments has become increasingly sophisticated. In this Research Topic, we focus on an important field in robotics and automation disciplines, which is commonly defined as behavior-assistant robots. The scope includes but is not limited to: (1) rehabilitation assistive devices, such as rigid/soft exoskeletons, prosthetic systems, orthoses, and intelligent wheelchairs; (2) intelligent medical systems, such as endoscopic robots, surgical robots, and the navigation systems; (3) industrial application devices, such as collaborative manipulators, load-bearing exoskeletons, supernumerary robotic limbs; (4) intelligent domestic devices, such as mobile robots, elderly-care robots, walking-aids robots and so on. The emergence of robot-assisted daily behaviors, based on aforementioned devices, is gradually becoming part of our social lives, which can improve weak motor abilities, enhance physical functionalities, and enable various other benefits.

This book provides an overview of recent research developments in the automation and control of robotic systems that collaborate with humans. A measure of human collaboration being necessary for the optimal operation of any robotic system, the contributors exploit a broad selection of such systems to demonstrate the importance of the subject, particularly where the environment is prone to uncertainty or complexity. They show how such human strengths as high-level decision-making, flexibility, and dexterity can be combined with robotic precision, and ability to perform task repetitively or in a dangerous environment. The book focuses on quantitative methods and control design for guaranteed robot performance and balanced human experience from both physical human-robot interaction and social human-robot interaction. Its contributions develop and expand upon material presented at various international conferences. They are organized into three parts covering: one-human–one-robot collaboration; one-human–multiple-robot collaboration; and human–swarm collaboration. Individual topic areas include resource optimization (human and robotic), safety in collaboration, human trust in robot and decision-making when collaborating with robots, abstraction of swarm systems to make them suitable for human control, modeling and control of internal force interactions for collaborative manipulation, and the sharing of control between human and automated systems, etc. Control and decision-making algorithms feature prominently in the text, importantly within the context of human factors and the constraints they impose. Applications such as assistive technology, driverless vehicles, cooperative mobile robots, manufacturing robots and swarm robots are considered. Illustrative figures and tables are provided throughout the book. Researchers and students working in controls, and the interaction of humans and robots will learn new methods for human–robot collaboration from this book and will find the cutting edge of the subject described in depth.

This book introduces state-of-the-art technologies in the field of human-robot interactions. It details advances made in this field in recent decades, including dynamics, controls, design analysis, uncertainties, and modelling. The text will appeal to graduate students, practitioners and researchers in the fields of robotics, computer and cognitive science, and mechanical engineering.

This book investigates a biologically inspired method of robot arm control, developed with the objective of synthesising human-like motion dynamically, using nonlinear, robust and adaptive control techniques in practical robot systems. The control method caters to a rising interest in humanoid robots and the need for appropriate control schemes to match these systems. Unlike the classic kinematic schemes used in industrial manipulators, the dynamic approaches proposed here promote human-like motion with better exploitation of the robot’s physical structure. This also benefits human-robot interaction. The control schemes proposed in this book are inspired by a wealth of human-motion literature that indicates the drivers of motion to be dynamic, model-based and optimal. Such considerations lend themselves nicely to achievement via nonlinear control techniques without the necessity for extensive and complex biological models. The operational-space method of robot control forms the basis of many of the techniques investigated in this book. The method includes attractive features such as the decoupling of motion into task and posture components. Various developments are made in each of these elements. Simple cost functions inspired by biomechanical “effort” and “discomfort” generate realistic posture motion. Sliding-mode techniques overcome robustness shortcomings for practical implementation. Arm compliance is achieved via a method of model-free adaptive control that also deals with actuator saturation via anti-windup compensation. A neural-network-centered learning-by-observation scheme generates new task motions, based on motion-capture data recorded from human volunteers. In other parts of the book, motion capture is used to test theories of human movement. All developed controllers are applied to the reaching motion of a humanoid robot arm and are demonstrated to be practically realisable. This book is designed to be of interest to those wishing to achieve dynamics-based human-like robot-arm motion in academic research, advanced study or certain industrial environments. The book provides motivations, extensive reviews, research results and detailed explanations. It is not only suited to practising control engineers, but also applicable for general roboticists who wish to develop control systems expertise in this area.