Baum (2017) - Survey of AI researchers
paperAuthors
Credibility Rating
Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.
Rating inherited from publication venue: arXiv
This widely-cited survey (often called the 'Grace et al. 2018' survey) is a key empirical reference for AI timelines debates; useful for grounding discussions about when transformative AI might arrive and how expert opinion varies by geography and subfield.
Paper Details
Metadata
Abstract
Advances in artificial intelligence (AI) will transform modern life by reshaping transportation, health, science, finance, and the military. To adapt public policy, we need to better anticipate these advances. Here we report the results from a large survey of machine learning researchers on their beliefs about progress in AI. Researchers predict AI will outperform humans in many activities in the next ten years, such as translating languages (by 2024), writing high-school essays (by 2026), driving a truck (by 2027), working in retail (by 2031), writing a bestselling book (by 2049), and working as a surgeon (by 2053). Researchers believe there is a 50% chance of AI outperforming humans in all tasks in 45 years and of automating all human jobs in 120 years, with Asian respondents expecting these dates much sooner than North Americans. These results will inform discussion amongst researchers and policymakers about anticipating and managing trends in AI.
Summary
A large-scale survey of machine learning researchers (1634 respondents from NeurIPS and ICML 2016) documenting expert predictions on AI timelines across specific tasks and general capabilities. Key findings include a 50% probability of AI outperforming humans in all tasks within 45 years, with significant geographic variation—Asian researchers predict these milestones roughly a decade sooner than North American counterparts.
Key Points
- •ML researchers predict AI will surpass humans in language translation by 2024, truck driving by 2027, and surgery by 2053, based on median estimates.
- •50% probability assigned to AI outperforming humans in ALL tasks within 45 years and automating all human jobs within 120 years.
- •Asian respondents predicted transformative AI milestones significantly sooner than North American respondents, revealing meaningful geographic divergence in expert beliefs.
- •Survey covers 352 specific cognitive tasks and broader milestones like 'high-level machine intelligence' (HLMI), providing granular forecasting data.
- •Results are intended to inform policymakers and researchers for anticipating and managing societal impacts of advanced AI.
Cited by 1 page
| Page | Type | Quality |
|---|---|---|
| Capabilities-to-Safety Pipeline Model | Analysis | 73.0 |
Cached Content Preview
# When Will AI Exceed Human Performance? Evidence from AI Experts
Katja Grace
Future of Humanity Institute, Oxford University
AI Impacts
John Salvatier
AI Impacts
Allan Dafoe
Future of Humanity Institute, Oxford University
Department of Political Science, Yale University
Baobao Zhang
Department of Political Science, Yale University
Owain Evans
Future of Humanity Institute, Oxford University
###### Abstract
Advances in artificial intelligence (AI) will transform modern life by reshaping transportation, health, science, finance, and the military \[ [1](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib1 ""), [2](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib2 ""), [3](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib3 "")\]. To adapt public policy, we need to better anticipate these advances \[ [4](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib4 ""), [5](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib5 "")\]. Here we report the results from a large survey of machine learning researchers on their beliefs about progress in AI. Researchers predict AI will outperform humans in many activities in the next ten years, such as translating languages (by 2024), writing high-school essays (by 2026), driving a truck (by 2027), working in retail (by 2031), writing a bestselling book (by 2049), and working as a surgeon (by 2053). Researchers believe there is a 50% chance of AI outperforming humans in all tasks in 45 years and of automating all human jobs in 120 years, with Asian respondents expecting these dates much sooner than North Americans. These results will inform discussion amongst researchers and policymakers about anticipating and managing trends in AI.
### Introduction
Advances in artificial intelligence (AI) will have massive social consequences. Self-driving technology might replace millions of driving jobs over the coming decade. In addition to possible unemployment, the transition will bring new challenges, such as rebuilding infrastructure, protecting vehicle cyber-security, and adapting laws and regulations \[ [5](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib5 "")\]. New challenges, both for AI developers and policy-makers, will also arise from applications in law enforcement, military technology, and marketing \[ [6](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib6 "")\]. To prepare for these challenges, accurate forecasting of transformative AI would be invaluable.
Several sources provide objective evidence about future AI advances: trends in computing hardware \[ [7](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib7 "")\], task performance \[ [8](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib8 "")\], and the automation of labor \[ [9](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib9 "")\]. The predictions of AI experts provide crucial additional information \[ [10](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib10 ""), [11](https://ar5iv.labs.arxiv.org/html/1705.08807#bib.bib11 ""
... (truncated, 44 KB total)9567facde74edbca | Stable ID: YmQ1Yzc0OD