Stochastic Processes And Filtering Theory

This unified treatment of linear and nonlinear filtering theory presents material previously available only in journals, and in terms accessible to engineering students. Its sole prerequisites are advanced calculus, the theory of ordinary differential equations, and matrix analysis. Although theory is emphasized, the text discusses numerous practical applications as well. Taking the state-space approach to filtering, this text models dynamical systems by finite-dimensional Markov processes, outputs of stochastic difference, and differential equations. Starting with background material on probability theory and stochastic processes, the author introduces and defines the problems of filtering, prediction, and smoothing. He presents the mathematical solutions to nonlinear filtering problems, and he specializes the nonlinear theory to linear problems. The final chapters deal with applications, addressing the development of approximate nonlinear filters, and presenting a critical analysis of their performance.

Stochastic filtering theory is a field that has seen a rapid development in recent years and this book, aimed at graduates and researchers in applied mathematics, provides an accessible introduction covering recent developments.

This book provides a rigorous mathematical treatment of the non-linear stochastic filtering problem using modern methods. Particular emphasis is placed on the theoretical analysis of numerical methods for the solution of the filtering problem via particle methods. The book should provide sufficient background to enable study of the recent literature. While no prior knowledge of stochastic filtering is required, readers are assumed to be familiar with measure theory, probability theory and the basics of stochastic processes. Most of the technical results that are required are stated and proved in the appendices. Exercises and solutions are included.

This book is based on a seminar given at the University of California at Los Angeles in the Spring of 1975. The choice of topics reflects my interests at the time and the needs of the students taking the course. Initially the lectures were written up for publication in the Lecture Notes series. How ever, when I accepted Professor A. V. Balakrishnan's invitation to publish them in the Springer series on Applications of Mathematics it became necessary to alter the informal and often abridged style of the notes and to rewrite or expand much of the original manuscript so as to make the book as self-contained as possible. Even so, no attempt has been made to write a comprehensive treatise on filtering theory, and the book still follows the original plan of the lectures. While this book was in preparation, the two-volume English translation of the work by R. S. Liptser and A. N. Shiryaev has appeared in this series. The first volume and the present book have the same approach to the sub ject, viz. that of martingale theory. Liptser and Shiryaev go into greater detail in the discussion of statistical applications and also consider inter polation and extrapolation as well as filtering.

Unlike traditional books presenting stochastic processes in an academic way, this book includes concrete applications that students will find interesting such as gambling, finance, physics, signal processing, statistics, fractals, and biology. Written with an important illustrated guide in the beginning, it contains many illustrations, photos and pictures, along with several website links. Computational tools such as simulation and Monte Carlo methods are included as well as complete toolboxes for both traditional and new computational techniques.

Intended for a second course in stationary processes, Stationary Stochastic Processes: Theory and Applications presents the theory behind the field’s widely scattered applications in engineering and science. In addition, it reviews sample function properties and spectral representations for stationary processes and fields, including a portion on stationary point processes. Features Presents and illustrates the fundamental correlation and spectral methods for stochastic processes and random fields Explains how the basic theory is used in special applications like detection theory and signal processing, spatial statistics, and reliability Motivates mathematical theory from a statistical model-building viewpoint Introduces a selection of special topics, including extreme value theory, filter theory, long-range dependence, and point processes Provides more than 100 exercises with hints to solutions and selected full solutions This book covers key topics such as ergodicity, crossing problems, and extremes, and opens the doors to a selection of special topics, like extreme value theory, filter theory, long-range dependence, and point processes, and includes many exercises and examples to illustrate the theory. Precise in mathematical details without being pedantic, Stationary Stochastic Processes: Theory and Applications is for the student with some experience with stochastic processes and a desire for deeper understanding without getting bogged down in abstract mathematics.

This monograph, now in a thoroughly revised second edition, develops the theory of stochastic calculus in Hilbert spaces and applies the results to the study of generalized solutions of stochastic parabolic equations. The emphasis lies on second-order stochastic parabolic equations and their connection to random dynamical systems. The authors further explore applications to the theory of optimal non-linear filtering, prediction, and smoothing of partially observed diffusion processes. The new edition now also includes a chapter on chaos expansion for linear stochastic evolution systems. This book will appeal to anyone working in disciplines that require tools from stochastic analysis and PDEs, including pure mathematics, financial mathematics, engineering and physics.

This second edition preserves the original text of 1968, with clarification and added references. From the Preface to the Second Edition: ``Since the First Edition of this book, numerous important results have appeared--in particular stochastic integrals with respect to martingales, random fields, Riccati equation theory and realization of nonlinear filters, to name a few. In Appendix D, an attempt is made to provide some of the references that the authors have found useful and tocomment on the relation of the cited references to the field ... [W]e hope that this new edition will have the effect of hastening the day when the nonlinear filter will enjoy the same popularity in applications as the linear filter does now.''