Superforecasting

NEW YORK TIMES BESTSELLER • NAMED ONE OF THE BEST BOOKS OF THE YEAR BY THE ECONOMIST “The most important book on decision making since Daniel Kahneman's Thinking, Fast and Slow.”—Jason Zweig, The Wall Street Journal Everyone would benefit from seeing further into the future, whether buying stocks, crafting policy, launching a new product, or simply planning the week’s meals. Unfortunately, people tend to be terrible forecasters. As Wharton professor Philip Tetlock showed in a landmark 2005 study, even experts’ predictions are only slightly better than chance. However, an important and underreported conclusion of that study was that some experts do have real foresight, and Tetlock has spent the past decade trying to figure out why. What makes some people so good? And can this talent be taught? In Superforecasting, Tetlock and coauthor Dan Gardner offer a masterwork on prediction, drawing on decades of research and the results of a massive, government-funded forecasting tournament. The Good Judgment Project involves tens of thousands of ordinary people—including a Brooklyn filmmaker, a retired pipe installer, and a former ballroom dancer—who set out to forecast global events. Some of the volunteers have turned out to be astonishingly good. They’ve beaten other benchmarks, competitors, and prediction markets. They’ve even beaten the collective judgment of intelligence analysts with access to classified information. They are "superforecasters." In this groundbreaking and accessible book, Tetlock and Gardner show us how we can learn from this elite group. Weaving together stories of forecasting successes (the raid on Osama bin Laden’s compound) and failures (the Bay of Pigs) and interviews with a range of high-level decision makers, from David Petraeus to Robert Rubin, they show that good forecasting doesn’t require powerful computers or arcane methods. It involves gathering evidence from a variety of sources, thinking probabilistically, working in teams, keeping score, and being willing to admit error and change course. Superforecasting offers the first demonstrably effective way to improve our ability to predict the future—whether in business, finance, politics, international affairs, or daily life—and is destined to become a modern classic.

From one of the world's most highly regarded social scientists comes a seminal book on forecasting that shows, for the first time, how we can all get better at making predictions. In Superforecasting, Tetlock and coauthor Dan Gardner offer a masterwork on prediction, drawing on decades of research and the results of a massive, government-funded forecasting tournament. The Good Judgment Project involves tens of thousands of ordinary people--including a Brooklyn filmmaker, a retired pipe installer, and a former ballroom dancer--who set out to forecast global events. Some of the volunteers have turned out to be astonishingly good. They've beaten other benchmarks, competitors, and prediction markets. They've even beaten the collective judgment of intelligence analysts with access to classified information. They are "superforecasters." The authors show us how we can learn from this elite group. Weaving together stories of forecasting successes (the raid on Osama bin Laden's compound) and failures (the Bay of Pigs) and interviews with a range of high-level decision makers, from David Petraeus to Robert Rubin, they show that good forecasting doesn't require powerful computers or arcane methods. It involves gathering evidence from a variety of sources, learning to think probabilistically, working in teams, keeping score, and being willing to admit error and change course. Superforecasting offers the first demonstrably effective way to improve our ability to predict the future--whether in business, finance, politics, international affairs, or daily life--and is destined to become a modern classic.

The international bestseller 'A manual for thinking clearly in an uncertain world. Read it.' Daniel Kahneman, author of Thinking, Fast and Slow _________________________ What if we could improve our ability to predict the future? Everything we do involves forecasts about how the future will unfold. Whether buying a new house or changing job, designing a new product or getting married, our decisions are governed by implicit predictions of how things are likely to turn out. The problem is, we're not very good at it. In a landmark, twenty-year study, Wharton professor Philip Tetlock showed that the average expert was only slightly better at predicting the future than a layperson using random guesswork. Tetlock's latest project – an unprecedented, government-funded forecasting tournament involving over a million individual predictions – has since shown that there are, however, some people with real, demonstrable foresight. These are ordinary people, from former ballroom dancers to retired computer programmers, who have an extraordinary ability to predict the future with a degree of accuracy 60% greater than average. They are superforecasters. In Superforecasting, Tetlock and his co-author Dan Gardner offer a fascinating insight into what we can learn from this elite group. They show the methods used by these superforecasters which enable them to outperform even professional intelligence analysts with access to classified data. And they offer practical advice on how we can all use these methods for our own benefit – whether in business, in international affairs, or in everyday life. _________________________ 'The techniques and habits of mind set out in this book are a gift to anyone who has to think about what the future might bring. In other words, to everyone.' Economist 'A terrific piece of work that deserves to be widely read . . . Highly recommended.' Independent 'The best thing I have read on predictions . . . Superforecasting is an indispensable guide to this indispensable activity.' The Times

In 2008, as the price of oil surged above $140 a barrel, experts said it would soon hit $200; a few months later it plunged to $30. In 1967, they said the USSR would have one of the fastest-growing economies in the year 2000; in 2000, the USSR did not exist. In 1911, it was pronounced that there would be no more wars in Europe; we all know how that turned out. Face it, experts are about as accurate as dart-throwing monkeys. And yet every day we ask them to predict the future — everything from the weather to the likelihood of a catastrophic terrorist attack. Future Babble is the first book to examine this phenomenon, showing why our brains yearn for certainty about the future, why we are attracted to those who predict it confidently, and why it’s so easy for us to ignore the trail of outrageously wrong forecasts. In this fast-paced, example-packed, sometimes darkly hilarious book, journalist Dan Gardner shows how seminal research by UC Berkeley professor Philip Tetlock proved that pundits who are more famous are less accurate — and the average expert is no more accurate than a flipped coin. Gardner also draws on current research in cognitive psychology, political science, and behavioral economics to discover something quite reassuring: The future is always uncertain, but the end is not always near.

Since its original publication, Expert Political Judgment by New York Times bestselling author Philip Tetlock has established itself as a contemporary classic in the literature on evaluating expert opinion. Tetlock first discusses arguments about whether the world is too complex for people to find the tools to understand political phenomena, let alone predict the future. He evaluates predictions from experts in different fields, comparing them to predictions by well-informed laity or those based on simple extrapolation from current trends. He goes on to analyze which styles of thinking are more successful in forecasting. Classifying thinking styles using Isaiah Berlin's prototypes of the fox and the hedgehog, Tetlock contends that the fox--the thinker who knows many little things, draws from an eclectic array of traditions, and is better able to improvise in response to changing events--is more successful in predicting the future than the hedgehog, who knows one big thing, toils devotedly within one tradition, and imposes formulaic solutions on ill-defined problems. He notes a perversely inverse relationship between the best scientific indicators of good judgement and the qualities that the media most prizes in pundits--the single-minded determination required to prevail in ideological combat. Clearly written and impeccably researched, the book fills a huge void in the literature on evaluating expert opinion. It will appeal across many academic disciplines as well as to corporations seeking to develop standards for judging expert decision-making. Now with a new preface in which Tetlock discusses the latest research in the field, the book explores what constitutes good judgment in predicting future events and looks at why experts are often wrong in their forecasts.

In the tradition of Malcolm Gladwell, Gardner explores a new way of thinking about the decisions we make. We are the safest and healthiest human beings who ever lived, and yet irrational fear is growing, with deadly consequences — such as the 1,595 Americans killed when they made the mistake of switching from planes to cars after September 11. In part, this irrationality is caused by those — politicians, activists, and the media — who promote fear for their own gain. Culture also matters. But a more fundamental cause is human psychology. Working with risk science pioneer Paul Slovic, author Dan Gardner sets out to explain in a compulsively readable fashion just what that statement above means as to how we make decisions and run our lives. We learn that the brain has not one but two systems to analyze risk. One is primitive, unconscious, and intuitive. The other is conscious and rational. The two systems often agree, but occasionally they come to very different conclusions. When that happens, we can find ourselves worrying about what the statistics tell us is a trivial threat — terrorism, child abduction, cancer caused by chemical pollution — or shrugging off serious risks like obesity and smoking. Gladwell told us about “the black box” of our brains; Gardner takes us inside, helping us to understand how to deconstruct the information we’re bombarded with and respond more logically and adaptively to our world. Risk is cutting-edge reading.

Political scientists often ask themselves what might have been if history had unfolded differently: if Stalin had been ousted as General Party Secretary or if the United States had not dropped the bomb on Japan. Although scholars sometimes scoff at applying hypothetical reasoning to world politics, the contributors to this volume--including James Fearon, Richard Lebow, Margaret Levi, Bruce Russett, and Barry Weingast--find such counterfactual conjectures not only useful, but necessary for drawing causal inferences from historical data. Given the importance of counterfactuals, it is perhaps surprising that we lack standards for evaluating them. To fill this gap, Philip Tetlock and Aaron Belkin propose a set of criteria for distinguishing plausible from implausible counterfactual conjectures across a wide range of applications. The contributors to this volume make use of these and other criteria to evaluate counterfactuals that emerge in diverse methodological contexts including comparative case studies, game theory, and statistical analysis. Taken together, these essays go a long way toward establishing a more nuanced and rigorous framework for assessing counterfactual arguments about world politics in particular and about the social sciences more broadly.

A Soul of a New Machine for our time, a gripping account of invention, commerce, and duplicity in the age of technology A worldwide race is on to perfect the next engine of economic growth, the advanced lithium-ion battery. It will power the electric car, relieve global warming, and catapult the winner into a new era of economic and political mastery. Can the United States win? Steve LeVine was granted unprecedented access to a secret federal laboratory outside Chicago, where a group of geniuses is trying to solve this next monumental task of physics. But these scientists— almost all foreign born—are not alone. With so much at stake, researchers in Japan, South Korea, and China are in the same pursuit. The drama intensifies when a Silicon Valley start-up licenses the federal laboratory’s signature invention with the aim of a blockbuster sale to the world’s biggest carmakers. The Powerhouse is a real-time, two-year thrilling account of big invention, big commercialization, and big deception. It exposes the layers of competition and ambition, aspiration and disappointment behind this great turning point in the history of technology.