In Hand Object Localization And Control Enabling Dexterous Manipulation With Robotic Hands

This book introduces a novel model-based dexterous manipulation framework, which, thanks to its precision and versatility, significantly advances the capabilities of robotic hands compared to the previous state of the art. This is achieved by combining a novel grasp state estimation algorithm, the first to integrate information from tactile sensing, proprioception and vision, with an impedance-based in-hand object controller, which enables leading manipulation capabilities, including finger gaiting. The developed concept is implemented on one of the most advanced robotic manipulators, the DLR humanoid robot David, and evaluated in a range of challenging real-world manipulation scenarios and tasks. This book greatly benefits researchers in the field of robotics that study robotic hands and dexterous manipulation topics, as well as developers and engineers working on industrial automation applications involving grippers and robotic manipulators.

This is a cornerstone publication in robotic grasping. The authors have developed an internationally recognized expertise in this area. Additionally, they designed and built several prototypes which attracted the attention of the scientific community. The purpose of this book is to summarize years of research and to present, in an attractive format, the expertise developed by the authors on a new technology for grasping which has achieved great success both in theory and in practice.

This book focuses on light invariant bare hand gesture recognition while there is no restriction on the types of gestures. Observations and results have confirmed that this research work can be used to remotely control a robotic hand using hand gestures. The system developed here is also able to recognize hand gestures in different lighting conditions. The pre-processing is performed by developing an image-cropping algorithm that ensures only the area of interest is included in the segmented image. The segmented image is compared with a predefined gesture set which must be installed in the recognition system. These images are stored and feature vectors are extracted from them. These feature vectors are subsequently presented using an orientation histogram, which provides a view of the edges in the form of frequency. Thereby, if the same gesture is shown twice in different lighting intensities, both repetitions will map to the same gesture in the stored data. The mapping of the segmented image's orientation histogram is firstly done using the Euclidian distance method. Secondly, the supervised neural network is trained for the same, producing better recognition results. An approach to controlling electro-mechanical robotic hands using dynamic hand gestures is also presented using a robot simulator. Such robotic hands have applications in commercial, military or emergency operations where human life cannot be risked. For such applications, an artificial robotic hand is required to perform real-time operations. This robotic hand should be able to move its fingers in the same manner as a human hand. For this purpose, hand geometry parameters are obtained using a webcam and also using KINECT. The parameter detection is direction invariant in both methods. Once the hand parameters are obtained, the fingers’ angle information is obtained by performing a geometrical analysis. An artificial neural network is also implemented to calculate the angles. These two methods can be used with only one hand, either right or left. A separate method that is applicable to both hands simultaneously is also developed and fingers angles are calculated. The contents of this book will be useful for researchers and professional engineers working on robotic arm/hand systems.

The human hand and its dexterity in grasping and manipulating objects are some of the hallmarks of the human species. For years, anatomic and biomechanical studies have deepened the understanding of the human hand’s functioning and, in parallel, the robotics community has been working on the design of robotic hands capable of manipulating objects with a performance similar to that of the human hand. However, although many researchers have partially studied various aspects, to date there has been no comprehensive characterization of the human hand’s function for grasping and manipulation of everyday life objects. This monograph explores the hypothesis that the confluence of both scientific fields, the biomechanical study of the human hand and the analysis of robotic manipulation of objects, would greatly benefit and advance both disciplines through simulation. Therefore, in this book, the current knowledge of robotics and biomechanics guides the design and implementation of a simulation framework focused on manipulation interactions that allows the study of the grasp through simulation. As a result, a valuable framework for the study of the grasp, with relevant applications in several fields such as robotics, biomechanics, ergonomics, rehabilitation and medicine, has been made available to these communities.

This book looks at the common problems both human and robotic hands encounter when controlling the large number of joints, actuators and sensors required to efficiently perform motor tasks such as object exploration, manipulation and grasping. The authors adopt an integrated approach to explore the control of the hand based on sensorimotor synergies that can be applied in both neuroscience and robotics. Hand synergies are based on goal-directed, combined muscle and kinematic activation leading to a reduction of the dimensionality of the motor and sensory space, presenting a highly effective solution for the fast and simplified design of artificial systems. Presented in two parts, the first part, Neuroscience, provides the theoretical and experimental foundations to describe the synergistic organization of the human hand. The second part, Robotics, Models and Sensing Tools, exploits the framework of hand synergies to better control and design robotic hands and haptic/sensing systems/tools, using a reduced number of control inputs/sensors, with the goal of pushing their effectiveness close to the natural one. Human and Robot Hands provides a valuable reference for students, researchers and designers who are interested in the study and design of the artificial hand.

“The Human Hand as an Inspiration for Robot Hand Development” presents an edited collection of authoritative contributions in the area of robot hands. The results described in the volume are expected to lead to more robust, dependable, and inexpensive distributed systems such as those endowed with complex and advanced sensing, actuation, computation, and communication capabilities. The twenty-four chapters discuss the field of robotic grasping and manipulation viewed in light of the human hand’s capabilities and push the state-of-the-art in robot hand design and control. Topics discussed include human hand biomechanics, neural control, sensory feedback and perception, and robotic grasp and manipulation. This book will be useful for researchers from diverse areas such as robotics, biomechanics, neuroscience, and anthropologists.

Dexterous and autonomous manipulation is a key technology for the personal and service robots of the future. Advances in Bimanual Manipulation edited by Bruno Siciliano provides the robotics community with the most noticeable results of the four-year European project DEXMART (DEXterous and autonomous dual-arm hand robotic manipulation with sMART sensory-motor skills: A bridge from natural to artificial cognition). The volume covers a host of highly important topics in the field, concerned with modelling and learning of human manipulation skills, algorithms for task planning, human-robot interaction, and grasping, as well as hardware design of dexterous anthropomorphic hands. The results described in this five-chapter collection are believed to pave the way towards the development of robotic systems endowed with dexterous and human-aware dual-arm/hand manipulation skills for objects, operating with a high degree of autonomy in unstructured real-world environments.

Humans are endowed with extraordinary sensory-motor capabilities that enable a successful interaction with and exploration of the environment, as is the case of human manipulation. Understanding and modeling these capabilities represents an important topic not only for neuroscience but also for robotics in a mutual inspiration, both to inform the design and control of artificial systems and, at the same time, to increase knowledge on the biological side. Within this context, synergies -- i.e., goal-directed actions that constrain multi DOFs of the human body and can be defined at the kinematic, muscular, neural level -- have gained increasing attention as a general simplified approach to shape the development of simple and effective artificial devices. The execution of such purposeful sensory-motor primitives on the biological side leverages on the interplay of the sensory-motor control at central and peripheral level, and the interaction of the human body with the external world. This interaction is particularly important considering the new concept of robotic soft manipulation, i.e. soft, adaptable yet robust robotic hands that can deform with the external environment to multiply their grasping and manipulation capabilities. Under this regard, a preeminent role is reserved to touch, being that skin isour primary organ to shape our knowledge of the external world and, hence, to modify it, in interaction with the efferent parts. This Research Topic reports results on the mutual inspiration between neuroscience and robotics, and on how it is possible to translate neuroscientific findings on human manipulation into engineering guidelines for simplified systems able to take full advantage from the interaction and hence exploitation of environmental constraints for task accomplishment and knowledge acquisition.