Numerical Bayesian Methods Applied To Signal Processing

This book is concerned with the processing of signals that have been sam pled and digitized. The fundamental theory behind Digital Signal Process ing has been in existence for decades and has extensive applications to the fields of speech and data communications, biomedical engineering, acous tics, sonar, radar, seismology, oil exploration, instrumentation and audio signal processing to name but a few [87]. The term "Digital Signal Processing", in its broadest sense, could apply to any operation carried out on a finite set of measurements for whatever purpose. A book on signal processing would usually contain detailed de scriptions of the standard mathematical machinery often used to describe signals. It would also motivate an approach to real world problems based on concepts and results developed in linear systems theory, that make use of some rather interesting properties of the time and frequency domain representations of signals. While this book assumes some familiarity with traditional methods the emphasis is altogether quite different. The aim is to describe general methods for carrying out optimal signal processing.

The focus of this book is on "ill-posed inverse problems". These problems cannot be solved only on the basis of observed data. The building of solutions involves the recognition of other pieces of a priori information. These solutions are then specific to the pieces of information taken into account. Clarifying and taking these pieces of information into account is necessary for grasping the domain of validity and the field of application for the solutions built. For too long, the interest in these problems has remained very limited in the signal-image community. However, the community has since recognized that these matters are more interesting and they have become the subject of much greater enthusiasm. From the application field’s point of view, a significant part of the book is devoted to conventional subjects in the field of inversion: biological and medical imaging, astronomy, non-destructive evaluation, processing of video sequences, target tracking, sensor networks and digital communications. The variety of chapters is also clear, when we examine the acquisition modalities at stake: conventional modalities, such as tomography and NMR, visible or infrared optical imaging, or more recent modalities such as atomic force imaging and polarized light imaging.

New Bayesian approach helps you solve tough problems in signal processing with ease Signal processing is based on this fundamental concept—the extraction of critical information from noisy, uncertain data. Most techniques rely on underlying Gaussian assumptions for a solution, but what happens when these assumptions are erroneous? Bayesian techniques circumvent this limitation by offering a completely different approach that can easily incorporate non-Gaussian and nonlinear processes along with all of the usual methods currently available. This text enables readers to fully exploit the many advantages of the "Bayesian approach" to model-based signal processing. It clearly demonstrates the features of this powerful approach compared to the pure statistical methods found in other texts. Readers will discover how easily and effectively the Bayesian approach, coupled with the hierarchy of physics-based models developed throughout, can be applied to signal processing problems that previously seemed unsolvable. Bayesian Signal Processing features the latest generation of processors (particle filters) that have been enabled by the advent of high-speed/high-throughput computers. The Bayesian approach is uniformly developed in this book's algorithms, examples, applications, and case studies. Throughout this book, the emphasis is on nonlinear/non-Gaussian problems; however, some classical techniques (e.g. Kalman filters, unscented Kalman filters, Gaussian sums, grid-based filters, et al) are included to enable readers familiar with those methods to draw parallels between the two approaches. Special features include: Unified Bayesian treatment starting from the basics (Bayes's rule) to the more advanced (Monte Carlo sampling), evolving to the next-generation techniques (sequential Monte Carlo sampling) Incorporates "classical" Kalman filtering for linear, linearized, and nonlinear systems; "modern" unscented Kalman filters; and the "next-generation" Bayesian particle filters Examples illustrate how theory can be applied directly to a variety of processing problems Case studies demonstrate how the Bayesian approach solves real-world problems in practice MATLAB notes at the end of each chapter help readers solve complex problems using readily available software commands and point out software packages available Problem sets test readers' knowledge and help them put their new skills into practice The basic Bayesian approach is emphasized throughout this text in order to enable the processor to rethink the approach to formulating and solving signal processing problems from the Bayesian perspective. This text brings readers from the classical methods of model-based signal processing to the next generation of processors that will clearly dominate the future of signal processing for years to come. With its many illustrations demonstrating the applicability of the Bayesian approach to real-world problems in signal processing, this text is essential for all students, scientists, and engineers who investigate and apply signal processing to their everyday problems.

This book presents recent advances of Bayesian inference in structured tensor decompositions. It explains how Bayesian modeling and inference lead to tuning-free tensor decomposition algorithms, which achieve state-of-the-art performances in many applications, including blind source separation; social network mining; image and video processing; array signal processing; and, wireless communications. The book begins with an introduction to the general topics of tensors and Bayesian theories. It then discusses probabilistic models of various structured tensor decompositions and their inference algorithms, with applications tailored for each tensor decomposition presented in the corresponding chapters. The book concludes by looking to the future, and areas where this research can be further developed. Bayesian Tensor Decomposition for Signal Processing and Machine Learning is suitable for postgraduates and researchers with interests in tensor data analytics and Bayesian methods.

Presents the Bayesian approach to statistical signal processing for a variety of useful model sets This book aims to give readers a unified Bayesian treatment starting from the basics (Baye’s rule) to the more advanced (Monte Carlo sampling), evolving to the next-generation model-based techniques (sequential Monte Carlo sampling). This next edition incorporates a new chapter on “Sequential Bayesian Detection,” a new section on “Ensemble Kalman Filters” as well as an expansion of Case Studies that detail Bayesian solutions for a variety of applications. These studies illustrate Bayesian approaches to real-world problems incorporating detailed particle filter designs, adaptive particle filters and sequential Bayesian detectors. In addition to these major developments a variety of sections are expanded to “fill-in-the gaps” of the first edition. Here metrics for particle filter (PF) designs with emphasis on classical “sanity testing” lead to ensemble techniques as a basic requirement for performance analysis. The expansion of information theory metrics and their application to PF designs is fully developed and applied. These expansions of the book have been updated to provide a more cohesive discussion of Bayesian processing with examples and applications enabling the comprehension of alternative approaches to solving estimation/detection problems. The second edition of Bayesian Signal Processing features: “Classical” Kalman filtering for linear, linearized, and nonlinear systems; “modern” unscented and ensemble Kalman filters: and the “next-generation” Bayesian particle filters Sequential Bayesian detection techniques incorporating model-based schemes for a variety of real-world problems Practical Bayesian processor designs including comprehensive methods of performance analysis ranging from simple sanity testing and ensemble techniques to sophisticated information metrics New case studies on adaptive particle filtering and sequential Bayesian detection are covered detailing more Bayesian approaches to applied problem solving MATLAB® notes at the end of each chapter help readers solve complex problems using readily available software commands and point out other software packages available Problem sets included to test readers’ knowledge and help them put their new skills into practice Bayesian Signal Processing, Second Edition is written for all students, scientists, and engineers who investigate and apply signal processing to their everyday problems.

Methods of signal analysis represent a broad research topic with applications in many disciplines, including engineering, technology, biomedicine, seismography, eco nometrics, and many others based upon the processing of observed variables. Even though these applications are widely different, the mathematical background be hind them is similar and includes the use of the discrete Fourier transform and z-transform for signal analysis, and both linear and non-linear methods for signal identification, modelling, prediction, segmentation, and classification. These meth ods are in many cases closely related to optimization problems, statistical methods, and artificial neural networks. This book incorporates a collection of research papers based upon selected contri butions presented at the First European Conference on Signal Analysis and Predic tion (ECSAP-97) in Prague, Czech Republic, held June 24-27, 1997 at the Strahov Monastery. Even though the Conference was intended as a European Conference, at first initiated by the European Association for Signal Processing (EURASIP), it was very gratifying that it also drew significant support from other important scientific societies, including the lEE, Signal Processing Society of IEEE, and the Acoustical Society of America. The organizing committee was pleased that the re sponse from the academic community to participate at this Conference was very large; 128 summaries written by 242 authors from 36 countries were received. In addition, the Conference qualified under the Continuing Professional Development Scheme to provide PD units for participants and contributors.

Presents the Bayesian approach to statistical signal processing for a variety of useful model sets This book aims to give readers a unified Bayesian treatment starting from the basics (Baye’s rule) to the more advanced (Monte Carlo sampling), evolving to the next-generation model-based techniques (sequential Monte Carlo sampling). This next edition incorporates a new chapter on “Sequential Bayesian Detection,” a new section on “Ensemble Kalman Filters” as well as an expansion of Case Studies that detail Bayesian solutions for a variety of applications. These studies illustrate Bayesian approaches to real-world problems incorporating detailed particle filter designs, adaptive particle filters and sequential Bayesian detectors. In addition to these major developments a variety of sections are expanded to “fill-in-the gaps” of the first edition. Here metrics for particle filter (PF) designs with emphasis on classical “sanity testing” lead to ensemble techniques as a basic requirement for performance analysis. The expansion of information theory metrics and their application to PF designs is fully developed and applied. These expansions of the book have been updated to provide a more cohesive discussion of Bayesian processing with examples and applications enabling the comprehension of alternative approaches to solving estimation/detection problems. The second edition of Bayesian Signal Processing features: “Classical” Kalman filtering for linear, linearized, and nonlinear systems; “modern” unscented and ensemble Kalman filters: and the “next-generation” Bayesian particle filters Sequential Bayesian detection techniques incorporating model-based schemes for a variety of real-world problems Practical Bayesian processor designs including comprehensive methods of performance analysis ranging from simple sanity testing and ensemble techniques to sophisticated information metrics New case studies on adaptive particle filtering and sequential Bayesian detection are covered detailing more Bayesian approaches to applied problem solving MATLAB® notes at the end of each chapter help readers solve complex problems using readily available software commands and point out other software packages available Problem sets included to test readers’ knowledge and help them put their new skills into practice Bayesian Signal Processing, Second Edition is written for all students, scientists, and engineers who investigate and apply signal processing to their everyday problems.