Visual Servoing Via Advanced Numerical Methods

Robots able to imitate human beings have been at the core of stories of science?ctionaswellasdreamsofinventorsforalongtime.Amongthe various skills that Mother Nature has provided us with and that often go forgotten, the ability of sight is certainly one of the most important. Perhaps inspired by tales of Isaac Asimov, comics and cartoons, and surely helped by the progress of electronics in recent decades, researchers have progressively made the dream of creating robots able to move and operate by exploiting arti?cial vision a concrete reality. Technically speaking, we would say that these robots position themselves and their end-e?ectors by using the view provided by some arti?cial eyes as feedback information. Indeed, the arti?cial eyes are visual sensors such as cameras that have the function to acquire an image of the environment. Such an image describes if and how the robot is moving toward the goal and hence constitutes feedback information. This procedure is known in robotics with the term visual servoing, and it is nothing else than an imitation of the intrinsic mechanism that allows human beings to realize daily tasks such as reaching the door of the house or grasping a cup of co?ee.

The book addresses the latest advances in research and development in the field of informatics in control, robotics and automation. With more than twenty revised and extended articles covering the theoretical aspects as well as applications and their implementation, it offers a factual and well-balanced overview of the state of the art in the field. In addition, it highlights the trends in control of intelligent robots. The book is an up-to-date source of information and inspiration for researchers, engineers and PhD students.

Robotic vision, the combination of robotics and computer vision, involves the application of computer algorithms to data acquired from sensors. The research community has developed a large body of such algorithms but for a newcomer to the field this can be quite daunting. For over 20 years the author has maintained two open-source MATLAB® Toolboxes, one for robotics and one for vision. They provide implementations of many important algorithms and allow users to work with real problems, not just trivial examples. This book makes the fundamental algorithms of robotics, vision and control accessible to all. It weaves together theory, algorithms and examples in a narrative that covers robotics and computer vision separately and together. Using the latest versions of the Toolboxes the author shows how complex problems can be decomposed and solved using just a few simple lines of code. The topics covered are guided by real problems observed by the author over many years as a practitioner of both robotics and computer vision. It is written in an accessible but informative style, easy to read and absorb, and includes over 1000 MATLAB and Simulink® examples and over 400 figures. The book is a real walk through the fundamentals of mobile robots, arm robots. then camera models, image processing, feature extraction and multi-view geometry and finally bringing it all together with an extensive discussion of visual servo systems. This second edition is completely revised, updated and extended with coverage of Lie groups, matrix exponentials and twists; inertial navigation; differential drive robots; lattice planners; pose-graph SLAM and map making; restructured material on arm-robot kinematics and dynamics; series-elastic actuators and operational-space control; Lab color spaces; light field cameras; structured light, bundle adjustment and visual odometry; and photometric visual servoing. “An authoritative book, reaching across fields, thoughtfully conceived and brilliantly accomplished!” OUSSAMA KHATIB, Stanford

This book unites two fast-developing forms of control—vision-based control and fractional-order control—and applies them in mechatronic systems. Image-Based and Fractional-Order Control for Mechatronic Systems is presented in two parts covering the theory and applications of the subject matter. The theoretical material presents the concepts of visual servoing and image-based feature extraction for feedback loops and fractional-order control. It discusses a range of systems from the classic monocular camera to new RGB-D sensors. The applications part of the book first discusses practical issues with the implementation of fractional-order control, comparing them with more traditional integer-order PID systems. The authors then introduce real-life examples such as a manipulator robot and a Stewart platform and results generated from such systems. MATLAB® functions and source codes are included wherever relevant to help readers develop simulations based on the theoretical ideas and practical examples in the text. Suggestions for the use of other pertinent open-source software are also indicated with the places where such may be obtained. With its combination of theoretical ideas and practical examples, Image-Based and Fractional-Order Control for Mechatronic Systems will be of interest to academic researchers looking to develop the fields of vision-based and fractional-order control and to engineers who are looking for developments that will help them provide closer control of their plants than can be achieved with integer-order PID. Advances in Industrial Control reports and encourages the transfer of technology in control engineering. The rapid development of control technology has an impact on all areas of the control discipline. The series offers an opportunity for researchers to present an extended exposition of new work in all aspects of industrial control.

The three volume set LNAI 10462, LNAI 10463, and LNAI 10464 constitutes the refereed proceedings of the 10th International Conference on Intelligent Robotics and Applications, ICIRA 2017, held in Wuhan, China, in August 2017. The 235 papers presented in the three volumes were carefully reviewed and selected from 310 submissions. The papers in this third volume of the set are organized in topical sections on sensors and actuators; mobile robotics and path planning; virtual reality and artificial intelligence; aerial and space robotics; mechatronics and intelligent manufacturing.

This textbook offers a tutorial introduction to robotics and Computer Vision which is light and easy to absorb. The practice of robotic vision involves the application of computational algorithms to data. Over the fairly recent history of the fields of robotics and computer vision a very large body of algorithms has been developed. However this body of knowledge is something of a barrier for anybody entering the field, or even looking to see if they want to enter the field — What is the right algorithm for a particular problem?, and importantly: How can I try it out without spending days coding and debugging it from the original research papers? The author has maintained two open-source MATLAB Toolboxes for more than 10 years: one for robotics and one for vision. The key strength of the Toolboxes provide a set of tools that allow the user to work with real problems, not trivial examples. For the student the book makes the algorithms accessible, the Toolbox code can be read to gain understanding, and the examples illustrate how it can be used —instant gratification in just a couple of lines of MATLAB code. The code can also be the starting point for new work, for researchers or students, by writing programs based on Toolbox functions, or modifying the Toolbox code itself. The purpose of this book is to expand on the tutorial material provided with the toolboxes, add many more examples, and to weave this into a narrative that covers robotics and computer vision separately and together. The author shows how complex problems can be decomposed and solved using just a few simple lines of code, and hopefully to inspire up and coming researchers. The topics covered are guided by the real problems observed over many years as a practitioner of both robotics and computer vision. It is written in a light but informative style, it is easy to read and absorb, and includes a lot of Matlab examples and figures. The book is a real walk through the fundamentals light and color, camera modelling, image processing, feature extraction and multi-view geometry, and bring it all together in a visual servo system. “An authoritative book, reaching across fields, thoughtfully conceived and brilliantly accomplished Oussama Khatib, Stanford

This book describes visual perception and control methods for robotic systems that need to interact with the environment. Multiple view geometry is utilized to extract low-dimensional geometric information from abundant and high-dimensional image information, making it convenient to develop general solutions for robot perception and control tasks. In this book, multiple view geometry is used for geometric modeling and scaled pose estimation. Then Lyapunov methods are applied to design stabilizing control laws in the presence of model uncertainties and multiple constraints.

It is with great pleasure that we present the proceedings of the 6th Inter- tional, Symposium on Visual Computing (ISVC 2010), which was held in Las Vegas, Nevada. ISVC provides a common umbrella for the four main areas of visual computing including vision, graphics, visualization, and virtual reality. The goal is to provide a forum for researchers, scientists, engineers, and pr- titioners throughout the world to present their latest research ?ndings, ideas, developments, and applications in the broader area of visual computing. This year, the program consisted of 14 oral sessions, one poster session, 7 special tracks, and 6 keynote presentations. The response to the call for papers was very good; we received over 300 submissions for the main symposium from which we accepted 93 papers for oral presentation and 73 papers for poster p- sentation. Special track papers were solicited separately through the Organizing and Program Committees of each track. A total of 44 papers were accepted for oral presentation and 6 papers for poster presentation in the special tracks.