Theory Of Statistics

The aim of this graduate textbook is to provide a comprehensive advanced course in the theory of statistics covering those topics in estimation, testing, and large sample theory which a graduate student might typically need to learn as preparation for work on a Ph.D. An important strength of this book is that it provides a mathematically rigorous and even-handed account of both Classical and Bayesian inference in order to give readers a broad perspective. For example, the "uniformly most powerful" approach to testing is contrasted with available decision-theoretic approaches.

Theory and Methods of Statistics covers essential topics for advanced graduate students and professional research statisticians. This comprehensive resource covers many important areas in one manageable volume, including core subjects such as probability theory, mathematical statistics, and linear models, and various special topics, including nonparametrics, curve estimation, multivariate analysis, time series, and resampling. The book presents subjects such as "maximum likelihood and sufficiency," and is written with an intuitive, heuristic approach to build reader comprehension. It also includes many probability inequalities that are not only useful in the context of this text, but also as a resource for investigating convergence of statistical procedures. Codifies foundational information in many core areas of statistics into a comprehensive and definitive resource Serves as an excellent text for select master’s and PhD programs, as well as a professional reference Integrates numerous examples to illustrate advanced concepts Includes many probability inequalities useful for investigating convergence of statistical procedures

Evaluating statistical procedures through decision and game theory, as first proposed by Neyman and Pearson and extended by Wald, is the goal of this problem-oriented text in mathematical statistics. First-year graduate students in statistics and other students with a background in statistical theory and advanced calculus will find a rigorous, thorough presentation of statistical decision theory treated as a special case of game theory. The work of Borel, von Neumann, and Morgenstern in game theory, of prime importance to decision theory, is covered in its relevant aspects: reduction of games to normal forms, the minimax theorem, and the utility theorem. With this introduction, Blackwell and Professor Girshick look at: Values and Optimal Strategies in Games; General Structure of Statistical Games; Utility and Principles of Choice; Classes of Optimal Strategies; Fixed Sample-Size Games with Finite Ω and with Finite A; Sufficient Statistics and the Invariance Principle; Sequential Games; Bayes and Minimax Sequential Procedures; Estimation; and Comparison of Experiments. A few topics not directly applicable to statistics, such as perfect information theory, are also discussed. Prerequisites for full understanding of the procedures in this book include knowledge of elementary analysis, and some familiarity with matrices, determinants, and linear dependence. For purposes of formal development, only discrete distributions are used, though continuous distributions are employed as illustrations. The number and variety of problems presented will be welcomed by all students, computer experts, and others using statistics and game theory. This comprehensive and sophisticated introduction remains one of the strongest and most useful approaches to a field which today touches areas as diverse as gambling and particle physics.

The theory of U-statistics goes back to the fundamental work of Hoeffding [1], in which he proved the central limit theorem. During last forty years the interest to this class of random variables has been permanently increasing, and thus, the new intensively developing branch of probability theory has been formed. The U-statistics are one of the universal objects of the modem probability theory of summation. On the one hand, they are more complicated "algebraically" than sums of independent random variables and vectors, and on the other hand, they contain essential elements of dependence which display themselves in the martingale properties. In addition, the U -statistics as an object of mathematical statistics occupy one of the central places in statistical problems. The development of the theory of U-statistics is stipulated by the influence of the classical theory of summation of independent random variables: The law of large num bers, central limit theorem, invariance principle, and the law of the iterated logarithm we re proved, the estimates of convergence rate were obtained, etc.

The primary aim of this book is to provide modern statistical techniques and theory for stochastic processes. The stochastic processes mentioned here are not restricted to the usual AR, MA, and ARMA processes. A wide variety of stochastic processes, including non-Gaussian linear processes, long-memory processes, nonlinear processes, non-ergodic processes and diffusion processes are described. The authors discuss estimation and testing theory and many other relevant statistical methods and techniques.

Aimed at a diverse scientific audience, including physicists, astronomers, chemists, geologists, and economists, this book explains the theory underlying the classical statistical methods. Its level is between introductory "how to" texts and intimidating mathematical monographs. A reader without previous exposure to statistics will finish the book with a sound working knowledge of statistical methods, while a reader already familiar with the standard tests will come away with an understanding of their strengths, weaknesses, and domains of applicability. The mathematical level is that of an advanced undergraduate; for example, matrices and Fourier analysis are used where appropriate. Among the topics covered are common probability distributions; sampling and the distribution of sampling statistics; confidence intervals, hypothesis testing, and the theory of tests; estimation (including maximum likelihood); goodness of fit (including c2 and Kolmogorov-Smirnov tests); and non-parametric and rank tests. There are nearly one hundred problems (with answers) designed to bring out points in the text and to cover topics slightly outside the main line of development.

In general terms, the shape of an object, data set, or image can be de fined as the total of all information that is invariant under translations, rotations, and isotropic rescalings. Thus two objects can be said to have the same shape if they are similar in the sense of Euclidean geometry. For example, all equilateral triangles have the same shape, and so do all cubes. In applications, bodies rarely have exactly the same shape within measure ment error. In such cases the variation in shape can often be the subject of statistical analysis. The last decade has seen a considerable growth in interest in the statis tical theory of shape. This has been the result of a synthesis of a number of different areas and a recognition that there is considerable common ground among these areas in their study of shape variation. Despite this synthesis of disciplines, there are several different schools of statistical shape analysis. One of these, the Kendall school of shape analysis, uses a variety of mathe matical tools from differential geometry and probability, and is the subject of this book. The book does not assume a particularly strong background by the reader in these subjects, and so a brief introduction is provided to each of these topics. Anyone who is unfamiliar with this material is advised to consult a more complete reference. As the literature on these subjects is vast, the introductory sections can be used as a brief guide to the literature.

This major revision contains a largely new chapter 7 providing an extensive discussion of the bivariate and multivariate versions of the standard distributions and families. Chapter 16 has been enlarged to cover mulitvariate sampling theory, an updated version of material previously found in the old Volume 3. The previous chapters 7 and 8 have been condensed into a single chapter providing an introduction to statistical inference. Elsewhere, major updates include new material on skewness and kurtosis, hazard rate distributions, the bootstrap, the evaluation of the multivariate normal integral and ratios of quadratic forms. This new edition includes over 200 new references, 40 new exercises and 20 further examples in the main text. In addition, all the text examples have been given titles and these are listed at the front of the book for easier reference.