Active Vision For Scene Understanding

Visual perception is one of the most important sources of information for both humans and robots. A particular challenge is the acquisition and interpretation of complex unstructured scenes. This work contributes to active vision for humanoid robots. A semantic model of the scene is created, which is extended by successively changing the robot's view in order to explore interaction possibilities of the scene.

Multimodal Scene Understanding: Algorithms, Applications and Deep Learning presents recent advances in multi-modal computing, with a focus on computer vision and photogrammetry. It provides the latest algorithms and applications that involve combining multiple sources of information and describes the role and approaches of multi-sensory data and multi-modal deep learning. The book is ideal for researchers from the fields of computer vision, remote sensing, robotics, and photogrammetry, thus helping foster interdisciplinary interaction and collaboration between these realms. Researchers collecting and analyzing multi-sensory data collections – for example, KITTI benchmark (stereo+laser) - from different platforms, such as autonomous vehicles, surveillance cameras, UAVs, planes and satellites will find this book to be very useful. Contains state-of-the-art developments on multi-modal computing Shines a focus on algorithms and applications Presents novel deep learning topics on multi-sensor fusion and multi-modal deep learning

This book constitutes the refereed proceedings of the Third International Conference on Dynamic Data Driven Application Systems, DDDAS 2020, held in Boston, MA, USA, in October 2020. The 21 full papers and 14 short papers presented in this volume were carefully reviewed and selected from 40 submissions. They cover topics such as: digital twins; environment cognizant adaptive-planning systems; energy systems; materials systems; physics-based systems analysis; imaging methods and systems; and learning systems.

In this paper, an active vision system is developed which is based on image strategy. The image based control structure uses the optical flow algorithm for motion detection of an object in a visual scene. Because the optical flow is very sensitive to changes in illumination or to the quality of the video, it was necessary to use median filtering and erosion and dilatation morphological operations for the decrease of erroneous blobs residing in individual frames. Since the image coordinates of the object are subjected to noise, the Kalman filtering technique is adopted for robust estimation. A fuzzy controller based on the fuzzy condensed algorithm allows real time work for each captured frame. Finally, the proposed active vision system has been simulated in the development/simulation environment Matlab/Simulink.

This book defines the emerging field of Active Perception which calls for studying perception coupled with action. It is devoted to technical problems related to the design and analysis of intelligent systems possessing perception such as the existing biological organisms and the "seeing" machines of the future. Since the appearance of the first technical results on active vision, researchers began to realize that perception -- and intelligence in general -- is not transcendental and disembodied. It is becoming clear that in the effort to build intelligent visual systems, consideration must be given to the fact that perception is intimately related to the physiology of the perceiver and the tasks that it performs. This viewpoint -- known as Purposive, Qualitative, or Animate Vision -- is the natural evolution of the principles of Active Vision. The seven chapters in this volume present various aspects of active perception, ranging from general principles and methodological matters to technical issues related to navigation, manipulation, recognition, learning, planning, reasoning, and topics related to the neurophysiology of intelligent systems.

More than one third of the human brain is devoted to the processes of seeing - vision is after all the main way in which we gather information about the world. But human vision is a dynamic process during which the eyes continually sample the environment. Where most books on vision consider it as a passive activity, this book is unique in focusing on vision as an 'active' process. It goes beyond most accounts of vision where the focus is on seeing, to provide an integrated account of seeing AND looking. The book starts by pointing out the weaknesses in our traditional approaches to vision and the reason we need this new approach. It then gives a thorough description of basic details of the visual and oculomotor systems necessary to understand active vision. The book goes on to show how this approach can give a new perspective on visual attention, and how the approach has progressed in the areas of visual orienting, reading, visual search, scene perception and neuropsychology. Finally, the book summarises progress by showing how this approach sheds new light on the old problem of how we maintain perception of a stable visual world. Written by two leading vision scientists, this book will be valuable for vision researchers and psychology students, from undergraduate level upwards.

Computer Vision has now reached a level of maturity that allows us not only to perform research on individual methods but also to build fully integrated computer vision systems of a signi cant complexity. This opens up a number of new problems related to architectures, systems integration, validation of - stems using benchmarking techniques, and so on. So far, the majority of vision conferences have focused on component technologies, which has motivated the organization of the First International Conference on Computer Vision Systems (ICVS). It is our hope that the conference will allow us not only to see a number of interesting new vision techniques and systems but hopefully also to de ne the research issues that need to be addressed to pave the way for more wide-scale use of computer vision in a diverse set of real-world applications. ICVS is organized as a single-track conference consisting of high-quality, p- viously unpublished, contributed papers on new and original research on c- puter vision systems. All contributions will be presented orally. A total of 65 papers were submitted for consideration by the conference. All papers were - viewed by three reviewers from the program committee. Thirty-two of the papers were selected for presentation. ICVS’99 is being held at the Alfredo Kraus Auditorium and Convention Centre, in Las Palmas, on the lovely Canary Islands, Spain. The setting is spri- like, which seems only appropriate as the basis for a new conference.