Information Theoretic Methods For Estimating Of Complicated Probability Distributions

Mixing up various disciplines frequently produces something that are profound and far-reaching. Cybernetics is such an often-quoted example. Mix of information theory, statistics and computing technology proves to be very useful, which leads to the recent development of information-theory based methods for estimating complicated probability distributions. Estimating probability distribution of a random variable is the fundamental task for quite some fields besides statistics, such as reliability, probabilistic risk analysis (PSA), machine learning, pattern recognization, image processing, neural networks and quality control. Simple distribution forms such as Gaussian, exponential or Weibull distributions are often employed to represent the distributions of the random variables under consideration, as we are taught in universities. In engineering, physical and social science applications, however, the distributions of many random variables or random vectors are so complicated that they do not fit the simple distribution forms at al. Exact estimation of the probability distribution of a random variable is very important. Take stock market prediction for example. Gaussian distribution is often used to model the fluctuations of stock prices. If such fluctuations are not normally distributed, and we use the normal distribution to represent them, how could we expect our prediction of stock market is correct? Another case well exemplifying the necessity of exact estimation of probability distributions is reliability engineering. Failure of exact estimation of the probability distributions under consideration may lead to disastrous designs. There have been constant efforts to find appropriate methods to determine complicated distributions based on random samples, but this topic has never been systematically discussed in detail in a book or monograph. The present book is intended to fill the gap and documents the latest research in this subject. Determining a complicated distribution is not simply a multiple of the workload we use to determine a simple distribution, but it turns out to be a much harder task. Two important mathematical tools, function approximation and information theory, that are beyond traditional mathematical statistics, are often used. Several methods constructed based on the two mathematical tools for distribution estimation are detailed in this book. These methods have been applied by the author for several years to many cases. They are superior in the following senses: (1) No prior information of the distribution form to be determined is necessary. It can be determined automatically from the sample; (2) The sample size may be large or small; (3) They are particularly suitable for computers. It is the rapid development of computing technology that makes it possible for fast estimation of complicated distributions. The methods provided herein well demonstrate the significant cross influences between information theory and statistics, and showcase the fallacies of traditional statistics that, however, can be overcome by information theory. Key Features: - Density functions automatically determined from samples - Free of assuming density forms - Computation-effective methods suitable for PC - density functions automatically determined from samples - Free of assuming density forms - Computation-effective methods suitable for PC

Avoid downturn vulnerability by managing correlation dependency Asymmetric Dependence in Finance examines the risks and benefits of asset correlation, and provides effective strategies for more profitable portfolio management. Beginning with a thorough explanation of the extent and nature of asymmetric dependence in the financial markets, this book delves into the practical measures fund managers and investors can implement to boost fund performance. From managing asymmetric dependence using Copulas, to mitigating asymmetric dependence risk in real estate, credit and CTA markets, the discussion presents a coherent survey of the state-of-the-art tools available for measuring and managing this difficult but critical issue. Many funds suffered significant losses during recent downturns, despite having a seemingly well-diversified portfolio. Empirical evidence shows that the relation between assets is much richer than previously thought, and correlation between returns is dependent on the state of the market; this book explains this asymmetric dependence and provides authoritative guidance on mitigating the risks. Examine an options-based approach to limiting your portfolio's downside risk Manage asymmetric dependence in larger portfolios and alternate asset classes Get up to speed on alternative portfolio performance management methods Improve fund performance by applying appropriate models and quantitative techniques Correlations between assets increase markedly during market downturns, leading to diversification failure at the very moment it is needed most. The 2008 Global Financial Crisis and the 2006 hedge-fund crisis provide vivid examples, and many investors still bear the scars of heavy losses from their well-managed, well-diversified portfolios. Asymmetric Dependence in Finance shows you what went wrong, and how it can be corrected and managed before the next big threat using the latest methods and models from leading research in quantitative finance.

This book constitutes the refereed proceedings of the 7th International Workshop on Probabilistic Graphical Models, PGM 2014, held in Utrecht, The Netherlands, in September 2014. The 38 revised full papers presented in this book were carefully reviewed and selected from 44 submissions. The papers cover all aspects of graphical models for probabilistic reasoning, decision making, and learning.

Dynamical Systems Method for Solving Nonlinear Operator Equations is of interest to graduate students in functional analysis, numerical analysis, and ill-posed and inverse problems especially. The book presents a general method for solving operator equations, especially nonlinear and ill-posed. It requires a fairly modest background and is essentially self-contained. All the results are proved in the book, and some of the background material is also included. The results presented are mostly obtained by the author. Contains a systematic development of a novel general method, the dynamical systems method, DSM for solving operator equations, especially nonlinear and ill-posed Self-contained, suitable for wide audience Can be used for various courses for graduate students and partly for undergraduates (especially for RUE classes)

In this book, we study theoretical and practical aspects of computing methods for mathematical modelling of nonlinear systems. A number of computing techniques are considered, such as methods of operator approximation with any given accuracy; operator interpolation techniques including a non-Lagrange interpolation; methods of system representation subject to constraints associated with concepts of causality, memory and stationarity; methods of system representation with an accuracy that is the best within a given class of models; methods of covariance matrix estimation; methods for low-rank matrix approximations; hybrid methods based on a combination of iterative procedures and best operator approximation; and methods for information compression and filtering under condition that a filter model should satisfy restrictions associated with causality and different types of memory. As a result, the book represents a blend of new methods in general computational analysis, and specific, but also generic, techniques for study of systems theory ant its particular branches, such as optimal filtering and information compression. Best operator approximation Non-Lagrange interpolation Generic Karhunen-Loeve transform Generalised low-rank matrix approximation Optimal data compression Optimal nonlinear filtering

Trains researchers and graduate students in state-of-the-art statistical and machine learning methods to build models with real-world data.

The concept of equilibrium plays a central role in various applied sciences, such as physics (especially, mechanics), economics, engineering, transportation, sociology, chemistry, biology and other fields. If one can formulate the equilibrium problem in the form of a mathematical model, solutions of the corresponding problem can be used for forecasting the future behavior of very complex systems and, also, for correcting the the current state of the system under control. This book presents a unifying look on different equilibrium concepts in economics, including several models from related sciences. - Presents a unifying look on different equilibrium concepts and also the present state of investigations in this field - Describes static and dynamic input-output models, Walras, Cassel-Wald, spatial price, auction market, oligopolistic equilibrium models, transportation and migration equilibrium models - Covers the basics of theory and solution methods both for the complementarity and variational inequality problems - The methods are illustrated by applications and exercises to economic equilibrium models

Modern Tools to Perform Numerical DifferentiationThe original direct differential quadrature (DQ) method has been known to fail for problems with strong nonlinearity and material discontinuity as well as for problems involving singularity, irregularity, and multiple scales. But now researchers in applied mathematics, computational mechanics, and en