Statistical Inference Under Mixture Models

This book puts its weight on theoretical issues related to finite mixture models. It shows that a good applicant, is an applicant who understands the issues behind each statistical method. This book is intended for applicants whose interests include some understanding of the procedures they are using, while they do not have to read the technical derivations. At the same time, many researchers find most theories and techniques necessary for the development of various statistical methods, without chasing after one set of research papers, after another. Even though the book emphasizes the theory, it provides accessible numerical tools for data analysis. Readers with strength in developing statistical software, may find it useful.

There have been major developments in the field of statistics over the last quarter century, spurred by the rapid advances in computing and data-measurement technologies. These developments have revolutionized the field and have greatly influenced research directions in theory and methodology. Increased computing power has spawned entirely new areas of research in computationally-intensive methods, allowing us to move away from narrowly applicable parametric techniques based on restrictive assumptions to much more flexible and realistic models and methods. These computational advances have also led to the extensive use of simulation and Monte Carlo techniques in statistical inference. All of these developments have, in turn, stimulated new research in theoretical statistics. This volume provides an up-to-date overview of recent advances in statistical modeling and inference. Written by renowned researchers from across the world, it discusses flexible models, semi-parametric methods and transformation models, nonparametric regression and mixture models, survival and reliability analysis, and re-sampling techniques. With its coverage of methodology and theory as well as applications, the book is an essential reference for researchers, graduate students, and practitioners.

This book focuses on recent advances, approaches, theories and applications related to mixture models. In particular, it presents recent unsupervised and semi-supervised frameworks that consider mixture models as their main tool. The chapters considers mixture models involving several interesting and challenging problems such as parameters estimation, model selection, feature selection, etc. The goal of this book is to summarize the recent advances and modern approaches related to these problems. Each contributor presents novel research, a practical study, or novel applications based on mixture models, or a survey of the literature. Reports advances on classic problems in mixture modeling such as parameter estimation, model selection, and feature selection; Present theoretical and practical developments in mixture-based modeling and their importance in different applications; Discusses perspectives and challenging future works related to mixture modeling.

The important role of finite mixture models in the statistical analysis of data is underscored by the ever-increasing rate at which articles on mixture applications appear in the statistical and general scientific literature. The aim of this article is to provide an up-to-date account of the theory and methodological developments underlying the applications of finite mixture models. Because of their flexibility, mixture models are being increasingly exploited as a convenient, semiparametric way in which to model unknown distributional shapes. This is in addition to their obvious applications where there is group-structure in the data or where the aim is to explore the data for such structure, as in a cluster analysis. It has now been three decades since the publication of the monograph by McLachlan & Basford (1988) with an emphasis on the potential usefulness of mixture models for inference and clustering. Since then, mixture models have attracted the interest of many researchers and have found many new and interesting fields of application. Thus, the literature on mixture models has expanded enormously, and as a consequence, the bibliography here can only provide selected coverage.

In many ways, estimation by an appropriate minimum distance method is one of the most natural ideas in statistics. However, there are many different ways of constructing an appropriate distance between the data and the model: the scope of study referred to by "Minimum Distance Estimation" is literally huge. Filling a statistical resource gap, Statistical Inference: The Minimum Distance Approach comprehensively overviews developments in density-based minimum distance inference for independently and identically distributed data. Extensions to other more complex models are also discussed. Comprehensively covering the basics and applications of minimum distance inference, this book introduces and discusses: The estimation and hypothesis testing problems for both discrete and continuous models The robustness properties and the structural geometry of the minimum distance methods The inlier problem and its possible solutions, and the weighted likelihood estimation problem The extension of the minimum distance methodology in interdisciplinary areas, such as neural networks and fuzzy sets, as well as specialized models and problems, including semi-parametric problems, mixture models, grouped data problems, and survival analysis. Statistical Inference: The Minimum Distance Approach gives a thorough account of density-based minimum distance methods and their use in statistical inference. It covers statistical distances, density-based minimum distance methods, discrete and continuous models, asymptotic distributions, robustness, computational issues, residual adjustment functions, graphical descriptions of robustness, penalized and combined distances, weighted likelihood, and multinomial goodness-of-fit tests. This carefully crafted resource is useful to researchers and scientists within and outside the statistics arena.

Mixture models have been around for over 150 years, and they are found in many branches of statistical modelling, as a versatile and multifaceted tool. They can be applied to a wide range of data: univariate or multivariate, continuous or categorical, cross-sectional, time series, networks, and much more. Mixture analysis is a very active research topic in statistics and machine learning, with new developments in methodology and applications taking place all the time. The Handbook of Mixture Analysis is a very timely publication, presenting a broad overview of the methods and applications of this important field of research. It covers a wide array of topics, including the EM algorithm, Bayesian mixture models, model-based clustering, high-dimensional data, hidden Markov models, and applications in finance, genomics, and astronomy. Features: Provides a comprehensive overview of the methods and applications of mixture modelling and analysis Divided into three parts: Foundations and Methods; Mixture Modelling and Extensions; and Selected Applications Contains many worked examples using real data, together with computational implementation, to illustrate the methods described Includes contributions from the leading researchers in the field The Handbook of Mixture Analysis is targeted at graduate students and young researchers new to the field. It will also be an important reference for anyone working in this field, whether they are developing new methodology, or applying the models to real scientific problems.