Numerical Methods And Stochastics

Stochastic Numerical Methods introduces at Master level the numerical methods that use probability or stochastic concepts to analyze random processes. The book aims at being rather general and is addressed at students of natural sciences (Physics, Chemistry, Mathematics, Biology, etc.) and Engineering, but also social sciences (Economy, Sociology, etc.) where some of the techniques have been used recently to numerically simulate different agent-based models. Examples included in the book range from phase-transitions and critical phenomena, including details of data analysis (extraction of critical exponents, finite-size effects, etc.), to population dynamics, interfacial growth, chemical reactions, etc. Program listings are integrated in the discussion of numerical algorithms to facilitate their understanding. From the contents: Review of Probability Concepts Monte Carlo Integration Generation of Uniform and Non-uniform Random Numbers: Non-correlated Values Dynamical Methods Applications to Statistical Mechanics Introduction to Stochastic Processes Numerical Simulation of Ordinary and Partial Stochastic Differential Equations Introduction to Master Equations Numerical Simulations of Master Equations Hybrid Monte Carlo Generation of n-Dimensional Correlated Gaussian Variables Collective Algorithms for Spin Systems Histogram Extrapolation Multicanonical Simulations

This volume represents the proceedings of the Workshop on Numerical Methods and Stochastics held at The Fields Institute in April 1999. The goal of the workshop was to identify emerging ideas in probability theory that influence future work in both probability and numerical computation. The book focuses on up-to-date results and gives novel approaches to computational problems based on cutting-edge techniques from the theory of probability and stochastic processes. Three papers discuss particle system approximations to solutions of the stochastic filtering problem. Two papers treat particle system equations. The paper on rough paths describes how to generate good approximations to stochastic integrals. An expository paper discusses a long-standing conjecture: the stochastic fast dynamo effect. A final paper gives an analysis of the error in binomial and trinomial approximations to solutions of the Black-Scholes stochastic differential equations. The book is intended for graduate students and research mathematicians interested in probability theory.

The numerical analysis of stochastic differential equations (SDEs) differs significantly from that of ordinary differential equations. This book provides an easily accessible introduction to SDEs, their applications and the numerical methods to solve such equations. From the reviews: "The authors draw upon their own research and experiences in obviously many disciplines... considerable time has obviously been spent writing this in the simplest language possible." --ZAMP

This book covers numerical methods for stochastic partial differential equations with white noise using the framework of Wong-Zakai approximation. The book begins with some motivational and background material in the introductory chapters and is divided into three parts. Part I covers numerical stochastic ordinary differential equations. Here the authors start with numerical methods for SDEs with delay using the Wong-Zakai approximation and finite difference in time. Part II covers temporal white noise. Here the authors consider SPDEs as PDEs driven by white noise, where discretization of white noise (Brownian motion) leads to PDEs with smooth noise, which can then be treated by numerical methods for PDEs. In this part, recursive algorithms based on Wiener chaos expansion and stochastic collocation methods are presented for linear stochastic advection-diffusion-reaction equations. In addition, stochastic Euler equations are exploited as an application of stochastic collocation methods, where a numerical comparison with other integration methods in random space is made. Part III covers spatial white noise. Here the authors discuss numerical methods for nonlinear elliptic equations as well as other equations with additive noise. Numerical methods for SPDEs with multiplicative noise are also discussed using the Wiener chaos expansion method. In addition, some SPDEs driven by non-Gaussian white noise are discussed and some model reduction methods (based on Wick-Malliavin calculus) are presented for generalized polynomial chaos expansion methods. Powerful techniques are provided for solving stochastic partial differential equations. This book can be considered as self-contained. Necessary background knowledge is presented in the appendices. Basic knowledge of probability theory and stochastic calculus is presented in Appendix A. In Appendix B some semi-analytical methods for SPDEs are presented. In Appendix C an introduction to Gauss quadrature is provided. In Appendix D, all the conclusions which are needed for proofs are presented, and in Appendix E a method to compute the convergence rate empirically is included. In addition, the authors provide a thorough review of the topics, both theoretical and computational exercises in the book with practical discussion of the effectiveness of the methods. Supporting Matlab files are made available to help illustrate some of the concepts further. Bibliographic notes are included at the end of each chapter. This book serves as a reference for graduate students and researchers in the mathematical sciences who would like to understand state-of-the-art numerical methods for stochastic partial differential equations with white noise.

This volume represents the proceedings of the Workshop on Numerical Methods and Stochastics held at The Fields Institute in April 1999. The goal of the workshop was to identify emerging ideas in probability theory that influence future work in both probability and numerical computation. The book focuses on new results and gives novel approaches to computational problems based on the latest techniques from the theory of probability and stochastic processes. Three papers discuss particle system approximations to solutions of the stochastic filtering problem. Two papers treat particle system equa.

This book deals with numerical analysis of systems of both ordinary and stochastic differential equations. The first chapter is devoted to numerical solution problems of the Cauchy problem for stiff ordinary differential equation (ODE) systems by Rosenbrock-type methods (RTMs). Here, general solutions of consistency equations are obtained, which lead to the construction of RTMs from the first to the fourth order. The second chapter deals with statistical simulation problems of the solution of the Cauchy problem for stochastic differential equation (SDE) systems. The mean-square convergence theorem is considered, as well as Taylor expansions of numerical solutions. Also included are applications of numerical methods of SDE solutions to partial differential equations and to analysis and synthesis problems of automated control of stochastic systems.

This book is a substantially revised and expanded edition reflecting major developments in stochastic numerics since the first edition was published in 2004. The new topics, in particular, include mean-square and weak approximations in the case of nonglobally Lipschitz coefficients of Stochastic Differential Equations (SDEs) including the concept of rejecting trajectories; conditional probabilistic representations and their application to practical variance reduction using regression methods; multi-level Monte Carlo method; computing ergodic limits and additional classes of geometric integrators used in molecular dynamics; numerical methods for FBSDEs; approximation of parabolic SPDEs and nonlinear filtering problem based on the method of characteristics. SDEs have many applications in the natural sciences and in finance. Besides, the employment of probabilistic representations together with the Monte Carlo technique allows us to reduce the solution of multi-dimensional problems for partial differential equations to the integration of stochastic equations. This approach leads to powerful computational mathematics that is presented in the treatise. Many special schemes for SDEs are presented. In the second part of the book numerical methods for solving complicated problems for partial differential equations occurring in practical applications, both linear and nonlinear, are constructed. All the methods are presented with proofs and hence founded on rigorous reasoning, thus giving the book textbook potential. An overwhelming majority of the methods are accompanied by the corresponding numerical algorithms which are ready for implementation in practice. The book addresses researchers and graduate students in numerical analysis, applied probability, physics, chemistry, and engineering as well as mathematical biology and financial mathematics.

The@ first graduate-level textbook to focus on fundamental aspects of numerical methods for stochastic computations, this book describes the class of numerical methods based on generalized polynomial chaos (gPC). These fast, efficient, and accurate methods are an extension of the classical spectral methods of high-dimensional random spaces. Designed to simulate complex systems subject to random inputs, these methods are widely used in many areas of computer science and engineering. The book introduces polynomial approximation theory and probability theory; describes the basic theory of gPC methods through numerical examples and rigorous development; details the procedure for converting stochastic equations into deterministic ones; using both the Galerkin and collocation approaches; and discusses the distinct differences and challenges arising from high-dimensional problems. The last section is devoted to the application of gPC methods to critical areas such as inverse problems and data assimilation. Ideal for use by graduate students and researchers both in the classroom and for self-study, Numerical Methods for Stochastic Computations provides the required tools for in-depth research related to stochastic computations. The first graduate-level textbook to focus on the fundamentals of numerical methods for stochastic computations Ideal introduction for graduate courses or self-study Fast, efficient, and accurate numerical methods Polynomial approximation theory and probability theory included Basic gPC methods illustrated through examples