Limit Theorems For Functionals Of Ergodic Markov Chains With General State Space

This book is intended for graduate students and research mathematicians working probability theory and statistics.

The general topic of this book is the ergodic behavior of Markov processes. A detailed introduction to methods for proving ergodicity and upper bounds for ergodic rates is presented in the first part of the book, with the focus put on weak ergodic rates, typical for Markov systems with complicated structure. The second part is devoted to the application of these methods to limit theorems for functionals of Markov processes. The book is aimed at a wide audience with a background in probability and measure theory. Some knowledge of stochastic processes and stochastic differential equations helps in a deeper understanding of specific examples. Contents Part I: Ergodic Rates for Markov Chains and Processes Markov Chains with Discrete State Spaces General Markov Chains: Ergodicity in Total Variation MarkovProcesseswithContinuousTime Weak Ergodic Rates Part II: Limit Theorems The Law of Large Numbers and the Central Limit Theorem Functional Limit Theorems

This book extends the local central limit theorem to Markov chains whose state spaces and transition probabilities are allowed to change in time. Such chains are used to model Markovian systems depending on external time-dependent parameters. The book develops a new general theory of local limit theorems for additive functionals of Markov chains, in the regimes of local, moderate, and large deviations, and provides nearly optimal conditions for the classical expansions, as well as asymptotic corrections when these conditions fail. Applications include local limit theorems for independent but not identically distributed random variables, Markov chains in random environments, and time-dependent perturbations of homogeneous Markov chains. The inclusion of appendices with background material, numerous examples, and an account of the historical background of the subject make this self-contained book accessible to graduate students. It will also be useful for researchers in probability and ergodic theory who are interested in asymptotic behaviors, Markov chains in random environments, random dynamical systems and non-stationary systems.

The present lecture notes aim for an introduction to the ergodic behaviour of Markov Processes and addresses graduate students, post-graduate students and interested readers. Different tools and methods for the study of upper bounds on uniform and weak ergodic rates of Markov Processes are introduced. These techniques are then applied to study limit theorems for functionals of Markov processes. This lecture course originates in two mini courses held at University of Potsdam, Technical University of Berlin and Humboldt University in spring 2013 and Ritsumameikan University in summer 2013. Alexei Kulik, Doctor of Sciences, is a Leading researcher at the Institute of Mathematics of Ukrainian National Academy of Sciences.

The usefulness of from the of techniques perturbation theory operators, to kernel for limit theorems for a applied quasi-compact positive Q, obtaining Markov chains for stochastic of or dynamical by describing properties systems, of Perron- Frobenius has been demonstrated in several All use a operator, papers. these works share the features the features that must be same specific general ; used in each stem from the nature of the functional particular case precise space where the of is and from the number of quasi-compactness Q proved eigenvalues of of modulus 1. We here a functional framework for Q give general analytical this method and we the aforementioned behaviour within it. It asymptotic prove is worth that this framework is to allow the unified noticing sufficiently general treatment of all the cases considered in the literature the previously specific ; characters of model translate into the verification of of simple hypotheses every a functional nature. When to Markov kernels or to Perr- applied Lipschitz Frobenius associated with these statements rise operators expanding give maps, to new results and the of known The main clarify proofs already properties. of the deals with a Markov kernel for which 1 is a part quasi-compact Q paper of modulus 1. An essential but is not the simple eigenvalue unique eigenvalue element of the work is the of the of peripheral Q precise description spectrums and of its To conclude the the results obtained perturbations.

This volume collects selected papers from the 7th High Dimensional Probability meeting held at the Institut d'Études Scientifiques de Cargèse (IESC) in Corsica, France. High Dimensional Probability (HDP) is an area of mathematics that includes the study of probability distributions and limit theorems in infinite-dimensional spaces such as Hilbert spaces and Banach spaces. The most remarkable feature of this area is that it has resulted in the creation of powerful new tools and perspectives, whose range of application has led to interactions with other subfields of mathematics, statistics, and computer science. These include random matrices, nonparametric statistics, empirical processes, statistical learning theory, concentration of measure phenomena, strong and weak approximations, functional estimation, combinatorial optimization, and random graphs. The contributions in this volume show that HDP theory continues to thrive and develop new tools, methods, techniques and perspectives to analyze random phenomena.

Ces notes sont consacrées aux inégalités et aux théorèmes limites classiques pour les suites de variables aléatoires absolument régulières ou fortement mélangeantes au sens de Rosenblatt. Le but poursuivi est de donner des outils techniques pour l'étude des processus faiblement dépendants aux statisticiens ou aux probabilistes travaillant sur ces processus.

This book covers the classical theory of Markov chains on general state-spaces as well as many recent developments. The theoretical results are illustrated by simple examples, many of which are taken from Markov Chain Monte Carlo methods. The book is self-contained, while all the results are carefully and concisely proven. Bibliographical notes are added at the end of each chapter to provide an overview of the literature. Part I lays the foundations of the theory of Markov chain on general states-space. Part II covers the basic theory of irreducible Markov chains on general states-space, relying heavily on regeneration techniques. These two parts can serve as a text on general state-space applied Markov chain theory. Although the choice of topics is quite different from what is usually covered, where most of the emphasis is put on countable state space, a graduate student should be able to read almost all these developments without any mathematical background deeper than that needed to study countable state space (very little measure theory is required). Part III covers advanced topics on the theory of irreducible Markov chains. The emphasis is on geometric and subgeometric convergence rates and also on computable bounds. Some results appeared for a first time in a book and others are original. Part IV are selected topics on Markov chains, covering mostly hot recent developments.