The Seven Pillars Of Statistical Wisdom

What gives statistics its unity as a science? Stephen Stigler sets forth the seven foundational ideas of statistics—a scientific discipline related to but distinct from mathematics and computer science and one which often seems counterintuitive. His original account will fascinate the interested layperson and engage the professional statistician.

What gives statistics its unity as a science? Stephen Stigler sets forth the seven foundational ideas of statistics—a scientific discipline related to but distinct from mathematics and computer science. Even the most basic idea—aggregation, exemplified by averaging—is counterintuitive. It allows one to gain information by discarding information, namely, the individuality of the observations. Stigler’s second pillar, information measurement, challenges the importance of “big data” by noting that observations are not all equally important: the amount of information in a data set is often proportional to only the square root of the number of observations, not the absolute number. The third idea is likelihood, the calibration of inferences with the use of probability. Intercomparison is the principle that statistical comparisons do not need to be made with respect to an external standard. The fifth pillar is regression, both a paradox (tall parents on average produce shorter children; tall children on average have shorter parents) and the basis of inference, including Bayesian inference and causal reasoning. The sixth concept captures the importance of experimental design—for example, by recognizing the gains to be had from a combinatorial approach with rigorous randomization. The seventh idea is the residual: the notion that a complicated phenomenon can be simplified by subtracting the effect of known causes, leaving a residual phenomenon that can be explained more easily. The Seven Pillars of Statistical Wisdom presents an original, unified account of statistical science that will fascinate the interested layperson and engage the professional statistician.

This lively collection of essays examines statistical ideas with an ironic eye for their essence and what their history can tell us for current disputes. The topics range from 17th-century medicine and the circulation of blood, to the cause of the Great Depression, to the determinations of the shape of the Earth and the speed of light.

Stigler shows how statistics arose from the interplay of mathematical concepts and the needs of several applied sciences. His emphasis is upon how methods of probability theory were developed for measuring uncertainty, for reducing uncertainty, and as a conceptual framework for quantitative studies in the social sciences.

"[Acheson] introduces the fundamental ideas of calculus through the story of how the subject developed, from approximating π to imaginary numbers, and from Newton's falling apple to the vibrations of an electric guitar."--Back cover

In the face of conflicting claims about some treatments, behaviors, and policies, the question arises: What is the most scientifically rigorous way to draw conclusions about cause and effect in the study of humans? In this introduction to causal inference, Paul Rosenbaum explains key concepts and methods through real-world examples.

Classical statistical theory—hypothesis testing, estimation, and the design of experiments and sample surveys—is mainly the creation of two men: Ronald A. Fisher (1890-1962) and Jerzy Neyman (1894-1981). Their contributions sometimes complemented each other, sometimes occurred in parallel, and, particularly at later stages, often were in strong opposition. The two men would not be pleased to see their names linked in this way, since throughout most of their working lives they detested each other. Nevertheless, they worked on the same problems, and through their combined efforts created a new discipline. This new book by E.L. Lehmann, himself a student of Neyman’s, explores the relationship between Neyman and Fisher, as well as their interactions with other influential statisticians, and the statistical history they helped create together. Lehmann uses direct correspondence and original papers to recreate an historical account of the creation of the Neyman-Pearson Theory as well as Fisher’s dissent, and other important statistical theories.

Now in paperback and fortified with exercises, this brilliant, enjoyable text demystifies data science, statistics and machine learning.