Back
Philip Tetlock - The Decision Lab
webthedecisionlab.com·thedecisionlab.com/thinkers/political-science/philip-tetlock
Tetlock's superforecasting research is relevant to AI safety for its insights on epistemic calibration, prediction accuracy, and institutional decision-making — skills central to evaluating AI risks and policy responses.
Metadata
Importance: 45/100wiki pagereference
Summary
Overview of Philip Tetlock's career and research on human prediction accuracy, demonstrating that most expert forecasts are no better than chance, while identifying a subset of 'superforecasters' who consistently outperform experts through probabilistic thinking, diverse information synthesis, and willingness to update beliefs. His Good Judgment Project quantified the attributes enabling accurate forecasting.
Key Points
- •Most expert predictions are statistically no better than random chance, undermining confidence in conventional expert-based decision-making.
- •Tetlock identified 'superforecasters' — individuals who outperform even intelligence analysts with access to classified data.
- •Key superforecaster traits include probabilistic thinking, drawing from diverse sources, teamwork, and willingness to acknowledge and correct mistakes.
- •The Good Judgment Project (co-founded with Barbara Mellers) empirically studied forecasting attributes at scale.
- •Findings have broad implications for policy, governance, and any domain requiring reliable predictions about future outcomes.
Cited by 2 pages
| Page | Type | Quality |
|---|---|---|
| Good Judgment (Forecasting) | Organization | 50.0 |
| Philip Tetlock | Person | 73.0 |
Cached Content Preview
HTTP 200Fetched Mar 20, 202624 KB
# Philip Tetlock
Thinker
Intro
IntroInnovative IdeasHistorical BiographyReferencesReferences
## _Gaining insight into foresight_
## Intro
We make predictions about the possible outcomes of certain actions in order to inform our decision-making. This seems like an effective process until you realize that most of us are unable to accurately foresee the outcomes of our choices. It was psychologist Philip Tetlock who demonstrated that, generally, the accuracy of our predictions is no better than chance, which means that flipping a coin is just as good as our best guess. Tetlock also realized that certain people are able to make predictions far more accurately than the general population. He dubbed these people “superforecasters”.
Tetlock is a psychology professor and researcher who is fascinated by decision-making processes and the attributes required for good judgment. His career has had a major impact on decision-making processes worldwide, as his discovery of superforecasters has enabled him to uncover the attributes and methodologies necessary for making accurate predictions. Through consultations and workshops, Tetlock and his colleagues have been working to improve decision-making by promoting the qualities necessary to accurately foresee the outcomes of certain decisions.
“
> **_In one of history’s great ironies, scientists today know vastly more than their colleagues a century ago, and possess vastly more data-crunching power, but they are much less confident in the prospects for perfect predictability._**
>
> **– Philip Tetlock _in Superforecasting: The Art and Science of Prediction_**
## Innovative Ideas
##### **Superforecasters – How a select few people can accurately forecast future outcomes**
Tetlock’s career has been based on the assessment of good judgment. This research interest led him to discover that the predictions most people – including experts – make about future outcomes are not usually significantly better than chance. In other words, they may as well have just guessed. We base our decisions on forecasts, so these findings call into question the accuracy of our decision-making. This is especially troubling for people like policymakers, whose decisions affect entire populations. In the same study that yielded these somewhat sobering findings, however, Tetlock noticed that a few experts stood out from the crowd and demonstrated real foresight. After publishing this study in 2005, he spent years attempting to uncover what sets these “superforecasters” apart.1 Research into superforecasters was conducted by The Good Judgment Project, an initiative Tetlock founded with Barbara Mellers, a colleague from the University of Pennsylvania.2 The research Tetlock and his team conducted demonstrated that the key attribut
... (truncated, 24 KB total)Resource ID:
59a68ba983572586 | Stable ID: ZWYwNGQ3Zj