Smart Ccd Cmos Based Image Sensors With Programmable Real Time Temporal And Spatial Convolution Capabilities For Applications In Machine Vision And Optical Metrology

In the past decades, the mainstream of microelectronics progression was mainly powered by Moore's law focusing on IC miniaturization down to nano scale. However, there is a fast increasing need for "More than Moore" (MtM) products and technology that are based upon or derived from silicon technologies, but do not simply scale with Moore’s law. This book provides new vision, strategy and guidance for the future technology and business development of micro/nanoelectronics.

The idea of writing a book on CMOS imaging has been brewing for several years. It was placed on a fast track after we agreed to organize a tutorial on CMOS sensors for the 2004 IEEE International Symposium on Circuits and Systems (ISCAS 2004). This tutorial defined the structure of the book, but as first time authors/editors, we had a lot to learn about the logistics of putting together information from multiple sources. Needless to say, it was a long road between the tutorial and the book, and it took more than a few months to complete. We hope that you will find our journey worthwhile and the collated information useful. The laboratories of the authors are located at many universities distributed around the world. Their unifying theme, however, is the advancement of knowledge for the development of systems for CMOS imaging and image processing. We hope that this book will highlight the ideas that have been pioneered by the authors, while providing a roadmap for new practitioners in this field to exploit exciting opportunities to integrate imaging and “smartness” on a single VLSI chip. The potential of these smart imaging systems is still unfulfilled. Hence, there is still plenty of research and development to be done.

Biological systems are a source of inspiration in the development of small autonomous sensor nodes. The two major types of optical vision systems found in nature are the single aperture human eye and the compound eye of insects. The latter are among the most compact and smallest vision sensors. The eye is a compound of individual lenses with their own photoreceptor arrays. The visual system of insects allows them to fly with a limited intelligence and brain processing power. A CMOS image sensor replicating the perception of vision in insects is discussed and designed in this book for industrial (machine vision) and medical applications. The CMOS metal layer is used to create an embedded micro-polarizer able to sense polarization information. This polarization information is shown to be useful in applications like real time material classification and autonomous agent navigation. Further the sensor is equipped with in pixel analog and digital memories which allow variation of the dynamic range and in-pixel binarization in real time. The binary output of the pixel tries to replicate the flickering effect of the insect’s eye to detect smallest possible motion based on the change in state. An inbuilt counter counts the changes in states for each row to estimate the direction of the motion. The chip consists of an array of 128x128 pixels, it occupies an area of 5 x 4 mm2 and it has been designed and fabricated in an 180nm CMOS CIS process from UMC.

This chapter presents a set of introductory material, which in addition to providing a general view on the topic, highlights the importance of research in this area. It also presents a short history of the design of smart vision sensors, and points out some of the fundamental issues in the design of such sensors. 1. 1 A General Overview Machine vision is one of the main branches of artificial intelligence. The richness of information present in images makes them the first choice as an input to an artificial system which tries to interact with its environment. A large proportion of the brain of many advanced species is dedicated to visual information processing, which illustrates the importance of visual information in biological systems. Biological visual systems have evolved over millions of years, and each specie has developed a specialized visual system tailored for the essential tasks of survival, such as catching a prey, or escaping a predator. Implementing electronic hardware for image processing, therefore, may benefit from the underlying fundamental aspects of biological vision, though in no respect should this be regarded as a solid framework for electronic vision systems. Traditionally, computer vision algorithms are performed on images captured by conventional cameras, and processing is accomplished by means of general purpose digital computers. More advanced systems utilize dedicated hardware to speed up the processing stage.

Shrinking pixel sizes along with improvements in image sensors, optics, and electronics have elevated DSCs to levels of performance that match, and have the potential to surpass, that of silver-halide film cameras. Image Sensors and Signal Processing for Digital Still Cameras captures the current state of DSC image acquisition and signal processing technology and takes an all-inclusive look at the field, from the history of DSCs to future possibilities. The first chapter outlines the evolution of DSCs, their basic structure, and their major application classes. The next few chapters discuss high-quality optics that meet the requirements of better image sensors, the basic functions and performance parameters of image sensors, and detailed discussions of both CCD and CMOS image sensors. The book then discusses how color theory affects the uses of DSCs, presents basic image processing and camera control algorithms and examples of advanced image processing algorithms, explores the architecture and required performance of signal processing engines, and explains how to evaluate image quality for each component described. The book closes with a look at future technologies and the challenges that must be overcome to realize them. With contributions from many active DSC experts, Image Sensors and Image Processing for Digital Still Cameras offers unparalleled real-world coverage and opens wide the door for future innovation.

Based on the highly successful 3-volume reference Handbook of Computer Vision and Applications, this concise edition covers in a single volume the entire spectrum of computer vision ranging form the imaging process to high-end algorithms and applications. This book consists of three parts, including an application gallery. Bridges the gap between theory and practical applications Covers modern concepts in computer vision as well as modern developments in imaging sensor technology Presents a unique interdisciplinary approach covering different areas of modern science

An introductory guide for anyone who is interested in designing machines that have vision-enabled, embedded products, this book covers topics encountered in hardware architecture, software algorithms, applications, advancements in processors and sensors. --