Adventures In Stochastic Processes

Stochastic processes are necessary ingredients for building models of a wide variety of phenomena exhibiting time varying randomness. This text offers easy access to this fundamental topic for many students of applied sciences at many levels. It includes examples, exercises, applications, and computational procedures. It is uniquely useful for beginners and non-beginners in the field. No knowledge of measure theory is presumed.

Stochastic processes are necessary ingredients for building models of a wide variety of phenomena exhibiting time varying randomness. This text offers easy access to this fundamental topic for many students of applied sciences at many levels. It includes examples, exercises, applications, and computational procedures. It is uniquely useful for beginners and non-beginners in the field. No knowledge of measure theory is presumed.

Building upon the previous editions, this textbook is a first course in stochastic processes taken by undergraduate and graduate students (MS and PhD students from math, statistics, economics, computer science, engineering, and finance departments) who have had a course in probability theory. It covers Markov chains in discrete and continuous time, Poisson processes, renewal processes, martingales, and option pricing. One can only learn a subject by seeing it in action, so there are a large number of examples and more than 300 carefully chosen exercises to deepen the reader’s understanding. Drawing from teaching experience and student feedback, there are many new examples and problems with solutions that use TI-83 to eliminate the tedious details of solving linear equations by hand, and the collection of exercises is much improved, with many more biological examples. Originally included in previous editions, material too advanced for this first course in stochastic processes has been eliminated while treatment of other topics useful for applications has been expanded. In addition, the ordering of topics has been improved; for example, the difficult subject of martingales is delayed until its usefulness can be applied in the treatment of mathematical finance.

Unlike traditional books presenting stochastic processes in an academic way, this book includes concrete applications that students will find interesting such as gambling, finance, physics, signal processing, statistics, fractals, and biology. Written with an important illustrated guide in the beginning, it contains many illustrations, photos and pictures, along with several website links. Computational tools such as simulation and Monte Carlo methods are included as well as complete toolboxes for both traditional and new computational techniques.

An excellent introduction for computer scientists and electrical and electronics engineers who would like to have a good, basic understanding of stochastic processes! This clearly written book responds to the increasing interest in the study of systems that vary in time in a random manner. It presents an introductory account of some of the important topics in the theory of the mathematical models of such systems. The selected topics are conceptually interesting and have fruitful application in various branches of science and technology.

The theory of stochastic processes originally grew out of efforts to describe Brownian motion quantitatively. Today it provides a huge arsenal of methods suitable for analyzing the influence of noise on a wide range of systems. The credit for acquiring all the deep insights and powerful methods is due ma- ly to a handful of physicists and mathematicians: Einstein, Smoluchowski, Langevin, Wiener, Stratonovich, etc. Hence it is no surprise that until - cently the bulk of basic and applied stochastic research was devoted to purely mathematical and physical questions. However, in the last decade we have witnessed an enormous growth of results achieved in other sciences - especially chemistry and biology - based on applying methods of stochastic processes. One reason for this stochastics boom may be that the realization that noise plays a constructive rather than the expected deteriorating role has spread to communities beyond physics. Besides their aesthetic appeal these noise-induced, noise-supported or noise-enhanced effects sometimes offer an explanation for so far open pr- lems (information transmission in the nervous system and information p- cessing in the brain, processes at the cell level, enzymatic reactions, etc.). They may also pave the way to novel technological applications (noise-- hanced reaction rates, noise-induced transport and separation on the na- scale, etc.). Key words to be mentioned in this context are stochastic r- onance, Brownian motors or ratchets, and noise-supported phenomena in excitable systems.

Rosss classic bestseller has been used extensively by professionals and as the primary text for a first undergraduate course in applied probability. With the addition of several new sections relating to actuaries, this text is highly recommended by the Society of Actuaries.

Stochastic processes are mathematical models of random phenomena that evolve according to prescribed dynamics. Processes commonly used in applications are Markov chains in discrete and continuous time, renewal and regenerative processes, Poisson processes, and Brownian motion. This volume gives an in-depth description of the structure and basic properties of these stochastic processes. A main focus is on equilibrium distributions, strong laws of large numbers, and ordinary and functional central limit theorems for cost and performance parameters. Although these results differ for various processes, they have a common trait of being limit theorems for processes with regenerative increments. Extensive examples and exercises show how to formulate stochastic models of systems as functions of a system’s data and dynamics, and how to represent and analyze cost and performance measures. Topics include stochastic networks, spatial and space-time Poisson processes, queueing, reversible processes, simulation, Brownian approximations, and varied Markovian models. The technical level of the volume is between that of introductory texts that focus on highlights of applied stochastic processes, and advanced texts that focus on theoretical aspects of processes.