Stochastic Models

Three coherent parts form the material covered in this text, portions of which have not been widely covered in traditional textbooks. In this coverage the reader is quickly introduced to several different topics enriched with 175 exercises which focus on real-world problems. Exercises range from the classics of probability theory to more exotic research-oriented problems based on numerical simulations. Intended for graduate students in mathematics and applied sciences, the text provides the tools and training needed to write and use programs for research purposes. The first part of the text begins with a brief review of measure theory and revisits the main concepts of probability theory, from random variables to the standard limit theorems. The second part covers traditional material on stochastic processes, including martingales, discrete-time Markov chains, Poisson processes, and continuous-time Markov chains. The theory developed is illustrated by a variety of examples surrounding applications such as the gambler’s ruin chain, branching processes, symmetric random walks, and queueing systems. The third, more research-oriented part of the text, discusses special stochastic processes of interest in physics, biology, and sociology. Additional emphasis is placed on minimal models that have been used historically to develop new mathematical techniques in the field of stochastic processes: the logistic growth process, the Wright –Fisher model, Kingman’s coalescent, percolation models, the contact process, and the voter model. Further treatment of the material explains how these special processes are connected to each other from a modeling perspective as well as their simulation capabilities in C and MatlabTM.

An Introduction to Stochastic Modeling provides information pertinent to the standard concepts and methods of stochastic modeling. This book presents the rich diversity of applications of stochastic processes in the sciences. Organized into nine chapters, this book begins with an overview of diverse types of stochastic models, which predicts a set of possible outcomes weighed by their likelihoods or probabilities. This text then provides exercises in the applications of simple stochastic analysis to appropriate problems. Other chapters consider the study of general functions of independent, identically distributed, nonnegative random variables representing the successive intervals between renewals. This book discusses as well the numerous examples of Markov branching processes that arise naturally in various scientific disciplines. The final chapter deals with queueing models, which aid the design process by predicting system performance. This book is a valuable resource for students of engineering and management science. Engineers will also find this book useful.

In this monograph the authors give a systematic approach to the probabilistic properties of the fixed point equation X=AX+B. A probabilistic study of the stochastic recurrence equation X_t=A_tX_{t-1}+B_t for real- and matrix-valued random variables A_t, where (A_t,B_t) constitute an iid sequence, is provided. The classical theory for these equations, including the existence and uniqueness of a stationary solution, the tail behavior with special emphasis on power law behavior, moments and support, is presented. The authors collect recent asymptotic results on extremes, point processes, partial sums (central limit theory with special emphasis on infinite variance stable limit theory), large deviations, in the univariate and multivariate cases, and they further touch on the related topics of smoothing transforms, regularly varying sequences and random iterative systems. The text gives an introduction to the Kesten-Goldie theory for stochastic recurrence equations of the type X_t=A_tX_{t-1}+B_t. It provides the classical results of Kesten, Goldie, Guivarc'h, and others, and gives an overview of recent results on the topic. It presents the state-of-the-art results in the field of affine stochastic recurrence equations and shows relations with non-affine recursions and multivariate regular variation.

Stochastic models are everywhere. In manufacturing, queuing models are used for modeling production processes, realistic inventory models are stochastic in nature. Stochastic models are considered in transportation and communication. Marketing models use stochastic descriptions of the demands and buyer's behaviors. In finance, market prices and exchange rates are assumed to be certain stochastic processes, and insurance claims appear at random times with random amounts. To each decision problem, a cost function is associated. Costs may be direct or indirect, like loss of time, quality deterioration, loss in production or dissatisfaction of customers. In decision making under uncertainty, the goal is to minimize the expected costs. However, in practically all realistic models, the calculation of the expected costs is impossible due to the model complexity. Simulation is the only practicable way of getting insight into such models. Thus, the problem of optimal decisions can be seen as getting simulation and optimization effectively combined. The field is quite new and yet the number of publications is enormous. This book does not even try to touch all work done in this area. Instead, many concepts are presented and treated with mathematical rigor and necessary conditions for the correctness of various approaches are stated. Optimization of Stochastic Models: The Interface Between Simulation and Optimization is suitable as a text for a graduate level course on Stochastic Models or as a secondary text for a graduate level course in Operations Research.

Newly revised by the author, this undergraduate-level text introduces the mathematical theory of probability and stochastic processes. Using both computer simulations and mathematical models of random events, it comprises numerous applications to the physical and biological sciences, engineering, and computer science. Subjects include sample spaces, probabilities distributions and expectations of random variables, conditional expectations, Markov chains, and the Poisson process. Additional topics encompass continuous-time stochastic processes, birth and death processes, steady-state probabilities, general queuing systems, and renewal processes. Each section features worked examples, and exercises appear at the end of each chapter, with numerical solutions at the back of the book. Suggestions for further reading in stochastic processes, simulation, and various applications also appear at the end.

The Book Presents A Systematic Exposition Of The Basic Theory And Applications Of Stochastic Models.Emphasising The Modelling Rather Than Mathematical Aspects Of Stochastic Processes, The Book Bridges The Gap Between The Theory And Applications Of These Processes.The Basic Building Blocks Of Model Construction Are Explained In A Step By Step Manner, Starting From The Simplest Model Of Random Walk And Proceeding Gradually To More Complicated Models. Several Examples Are Given Throughout The Text To Illustrate Important Analytical Properties As Well As To Provide Applications.The Book Also Includes A Detailed Chapter On Inference For Stochastic Processes. This Chapter Highlights Some Of The Recent Developments In The Subject And Explains Them Through Illustrative Examples.An Important Feature Of The Book Is The Complements And Problems Section At The End Of Each Chapter Which Presents (I) Additional Properties Of The Model, (Ii) Extensions Of The Model, And (Iii) Applications Of The Model To Different Areas.With All These Features, This Is An Invaluable Text For Post-Graduate Students Of Statistics, Mathematics And Operation Research.

In this monograph stochastic models of systems analysis are discussed. It covers many aspects and different stages from the construction of mathematical models of real systems, through mathematical analysis of models based on simplification methods, to the interpretation of real stochastic systems. The stochastic models described here share the property that their evolutionary aspects develop under the influence of random factors. It has been assumed that the evolution takes place in a random medium, i.e. unilateral interaction between the system and the medium. As only Markovian models of random medium are considered in this book, the stochastic models described here are determined by two processes, a switching process describing the evolution of the systems and a switching process describing the changes of the random medium. Audience: This book will be of interest to postgraduate students and researchers whose work involves probability theory, stochastic processes, mathematical systems theory, ordinary differential equations, operator theory, or mathematical modelling and industrial mathematics.

Stochastic Models in Biology describes the usefulness of the theory of stochastic process in studying biological phenomena. The book describes analysis of biological systems and experiments though probabilistic models rather than deterministic methods. The text reviews the mathematical analyses for modeling different biological systems such as the random processes continuous in time and discrete in state space. The book also discusses population growth and extinction through Malthus' law and the work of MacArthur and Wilson. The text then explains the dynamics of a population of interacting species. The book also addresses population genetics under systematic evolutionary pressures known as deterministic equations and genetic changes in a finite population known as stochastic equations. The text then turns to stochastic modeling of biological systems at the molecular level, particularly the kinetics of biochemical reactions. The book also presents various useful equations such as the differential equation for generating functions for birth and death processes. The text can prove valuable for biochemists, cellular biologists, and researchers in the medical and chemical field who are tasked to perform data analysis.