Digital Video Processing

Over the years, thousands of engineering students and professionals relied on Digital Video Processing as the definitive, in-depth guide to digital image and video processing technology. Now, Dr. A. Murat Tekalp has completely revamped the first edition to reflect today’s technologies, techniques, algorithms, and trends. Digital Video Processing, Second Edition, reflects important advances in image processing, computer vision, and video compression, including new applications such as digital cinema, ultra-high-resolution video, and 3D video. This edition offers rigorous, comprehensive, balanced, and quantitative coverage of image filtering, motion estimation, tracking, segmentation, video filtering, and compression. Now organized and presented as a true tutorial, it contains updated problem sets and new MATLAB projects in every chapter. Coverage includes Multi-dimensional signals/systems: transforms, sampling, and lattice conversion Digital images and video: human vision, analog/digital video, and video quality Image filtering: gradient estimation, edge detection, scaling, multi-resolution representations, enhancement, de-noising, and restoration Motion estimation: image formation; motion models; differential, matching, optimization, and transform-domain methods; and 3D motion and shape estimation Video segmentation: color and motion segmentation, change detection, shot boundary detection, video matting, video tracking, and performance evaluation Multi-frame filtering: motion-compensated filtering, multi-frame standards conversion, multi-frame noise filtering, restoration, and super-resolution Image compression: lossless compression, JPEG, wavelets, and JPEG2000 Video compression: early standards, ITU-T H.264/MPEG-4 AVC, HEVC, Scalable Video Compression, and stereo/multi-view approaches

Any device or system with imaging functionality requires a digital video processing solution as part of its embedded system design. Engineers need a practical guide to technology basics and design fundamentals that enables them to deliver the video component of complex projects. This book introduces core video processing concepts and standards, and delivers practical how-to guidance for engineers embarking on digital video processing designs using FPGAs. It covers the basic topics of video processing in a pictorial, intuitive manner with minimal use of mathematics. Key outcomes and benefits of this book for users include: understanding the concepts and challenges of modern video systems; architect video systems at a system level; reference design examples to implement your own high definition video processing chain; understand implementation trade-offs in video system designs. Video processing is a must-have skill for engineers working on products and solutions for rapidly growing markets such as video surveillance, video conferencing, medical imaging, military imaging, digital broadcast equipment, displays and countless consumer electronics applications This book is for engineers who need to develop video systems in their designs but who do not have video processing experience. It introduces the fundamental video processing concepts and skills in enough detail to get the job done, supported by reference designs, step-by-step FPGA- examples, core standards and systems architecture maps Written by lead engineers at Altera Corp, a top-three global developer of digital video chip (FPGA) technology

UP-TO-DATE, TECHNICALLY ACCURATE COVERAGE OF ESSENTIAL TOPICS IN IMAGE AND VIDEO PROCESSING This is the first book to combine image and video processing with a practical MATLAB®-oriented approach in order to demonstrate the most important image and video techniques and algorithms. Utilizing minimal math, the contents are presented in a clear, objective manner, emphasizing and encouraging experimentation. The book has been organized into two parts. Part I: Image Processing begins with an overview of the field, then introduces the fundamental concepts, notation, and terminology associated with image representation and basic image processing operations. Next, it discusses MATLAB® and its Image Processing Toolbox with the start of a series of chapters with hands-on activities and step-by-step tutorials. These chapters cover image acquisition and digitization; arithmetic, logic, and geometric operations; point-based, histogram-based, and neighborhood-based image enhancement techniques; the Fourier Transform and relevant frequency-domain image filtering techniques; image restoration; mathematical morphology; edge detection techniques; image segmentation; image compression and coding; and feature extraction and representation. Part II: Video Processing presents the main concepts and terminology associated with analog video signals and systems, as well as digital video formats and standards. It then describes the technically involved problem of standards conversion, discusses motion estimation and compensation techniques, shows how video sequences can be filtered, and concludes with an example of a solution to object detection and tracking in video sequences using MATLAB®. Extra features of this book include: More than 30 MATLAB® tutorials, which consist of step-by-step guides toexploring image and video processing techniques using MATLAB® Chapters supported by figures, examples, illustrative problems, and exercises Useful websites and an extensive list of bibliographical references This accessible text is ideal for upper-level undergraduate and graduate students in digital image and video processing courses, as well as for engineers, researchers, software developers, practitioners, and anyone who wishes to learn about these increasingly popular topics on their own.

This comprehensive and state-of-the art approach to video processing gives engineers and students a comprehensive introduction and includes full coverage of key applications: wireless video, video networks, video indexing and retrieval and use of video in speech processing. Containing all the essential methods in video processing alongside the latest standards, it is a complete resource for the professional engineer, researcher and graduate student. Numerous conceptual and numerical examples All the latest standards are thoroughly covered: MPEG-1, MPEG-2, MPEG-4, H.264 and AVC Coverage of the latest techniques in video security "Like its sister volume "The Essential Guide to Image Processing," Professor Bovik’s Essential Guide to Video Processing provides a timely and comprehensive survey, with contributions from leading researchers in the area. Highly recommended for everyone with an interest in this fascinating and fast-moving field." —Prof. Bernd Girod, Stanford University, USA * Edited by a leading person in the field who created the IEEE International Conference on Image Processing, with contributions from experts in their fields. * Numerous conceptual and numerical examples *All the latest standards are thoroughly covered: MPEG-1, MPEG-2, MPEG-4, H.264 and AVC. * Coverage of the latest techniques in video security

This book gives a concise introduction to both image and video processing, providing a balanced coverage between theory, applications and standards. It gives an introduction to both 2-D and 3-D signal processing theory, supported by an introduction to random processes and some essential results from information theory, providing the necessary foundation for a full understanding of the image and video processing concepts that follow. A significant new feature is the explanation of practical network coding methods for image and video transmission. There is also coverage of new approaches such as: super-resolution methods, non-local processing, and directional transforms. This book also has on-line support that contains many short MATLAB programs that complement examples and exercises on multidimensional signal, image, and video processing. There are numerous short video clips showing applications in video processing and coding, plus a copy of the vidview video player for playing .yuv video files on a Windows PC and an illustration of the effect of packet loss on H.264/AVC coded bitstreams. New to this edition: New appendices on random processes, information theory New coverage of image analysis – edge detection, linking, clustering, and segmentation Expanded coverage on image sensing and perception, including color spaces. Now summarizes the new MPEG coding standards: scalable video coding (SVC) and multiview video coding (MVC), in addition to coverage of H.264/AVC. Updated video processing material including new example on scalable video coding and more material on object- and region-based video coding. More on video coding for networks including practical network coding (PNC), highlighting the significant advantages of PNC for both video downloading and streaming. New coverage of super-resolution methods for image and video. Only R&D level tutorial that gives an integrated treatment of image and video processing - topics that are interconnected. New chapters on introductory random processes, information theory, and image enhancement and analysis Coverage and discussion of the latest standards in video coding: H.264/AVC and the new scalable video standard (SVC)

The hand is quicker than the eye. In many cases, so is digital video. Maintaining image quality in bandwidth- and memory-restricted environments is quickly becoming a reality as thriving research delves ever deeper into perceptual coding techniques, which discard superfluous data that humans cannot process or detect. Surveying the topic from a Human Visual System (HVS)-based approach, Digital Video Image Quality and Perceptual Coding outlines the principles, metrics, and standards associated with perceptual coding, as well as the latest techniques and applications. This book is divided broadly into three parts. First, it introduces the fundamental theory, concepts, principles, and techniques underlying the field, such as the basics of compression, HVS modeling, and coding artifacts associated with current well-known techniques. The next section focuses on picture quality assessment criteria; subjective and objective methods and metrics, including vision model based digital video impairment metrics; testing procedures; and international standards regarding image quality. Finally, practical applications come into focus, including digital image and video coder designs based on the HVS as well as post-filtering, restoration, error correction, and concealment techniques. The permeation of digital images and video throughout the world cannot be understated. Nor can the importance of preserving quality while using minimal storage space, and Digital Video Image Quality and Perceptual Coding provides the tools necessary to accomplish this goal. Instructors and lecturers wishing to make use of this work as a textbook can download a presentation of 786 slides in PDF format organized to augment the text. accompany our book (H.R. Wu and K.R. Rao, Digital Video Image Quality and Perceptual Coding, CRC Press (ISBN: 0-8247-2777-0), Nov. 2005) for lecturers or instructor to use for their classes if they use the book.

This book presents collective works published in the recent Special Issue (SI) entitled " Digital Signal, Image and Video Processing for Emerging Multimedia Technology". These works address the emerging technology in signal processing and its new aspects, as well as the related applications. Recent developments in image/video-based deep learning technology have enabled new services in the field of multimedia and recognition technology. The applications vary and range from digital signal processing to image, video and multimedia signal processing, also including object classification, learning mechanism design and data security. Recent advances in numerical, theoretical and experimental methodologies are presented within the scope of the current book, along with the finding of new learning methods and new methodological developments and their limitations. This book brings together a collection of inter-/multidisciplinary works applied to many classification and data security applications in a coherent manner.

55% new material in the latest edition of this “must-have for students and practitioners of image & video processing! This Handbook is intended to serve as the basic reference point on image and video processing, in the field, in the research laboratory, and in the classroom. Each chapter has been written by carefully selected, distinguished experts specializing in that topic and carefully reviewed by the Editor, Al Bovik, ensuring that the greatest depth of understanding be communicated to the reader. Coverage includes introductory, intermediate and advanced topics and as such, this book serves equally well as classroom textbook as reference resource. • Provides practicing engineers and students with a highly accessible resource for learning and using image/video processing theory and algorithms • Includes a new chapter on image processing education, which should prove invaluable for those developing or modifying their curricula • Covers the various image and video processing standards that exist and are emerging, driving today’s explosive industry • Offers an understanding of what images are, how they are modeled, and gives an introduction to how they are perceived • Introduces the necessary, practical background to allow engineering students to acquire and process their own digital image or video data • Culminates with a diverse set of applications chapters, covered in sufficient depth to serve as extensible models to the reader’s own potential applications About the Editor... Al Bovik is the Cullen Trust for Higher Education Endowed Professor at The University of Texas at Austin, where he is the Director of the Laboratory for Image and Video Engineering (LIVE). He has published over 400 technical articles in the general area of image and video processing and holds two U.S. patents. Dr. Bovik was Distinguished Lecturer of the IEEE Signal Processing Society (2000), received the IEEE Signal Processing Society Meritorious Service Award (1998), the IEEE Third Millennium Medal (2000), and twice was a two-time Honorable Mention winner of the international Pattern Recognition Society Award. He is a Fellow of the IEEE, was Editor-in-Chief, of the IEEE Transactions on Image Processing (1996-2002), has served on and continues to serve on many other professional boards and panels, and was the Founding General Chairman of the IEEE International Conference on Image Processing which was held in Austin, Texas in 1994. * No other resource for image and video processing contains the same breadth of up-to-date coverage * Each chapter written by one or several of the top experts working in that area * Includes all essential mathematics, techniques, and algorithms for every type of image and video processing used by electrical engineers, computer scientists, internet developers, bioengineers, and scientists in various, image-intensive disciplines