Skip to content
Longterm Wiki
Back

Credibility Rating

4/5
High(4)

High quality. Established institution or organization with editorial oversight and accountability.

Rating inherited from publication venue: Centre for the Governance of AI

A historically grounded GovAI paper drawing direct parallels between nuclear governance failures and current AI governance challenges; useful for understanding why international coordination on dangerous technologies is so difficult.

Metadata

Importance: 72/100working paperanalysis

Summary

This GovAI paper analyzes the Baruch Plan (1944-1951), the early attempt at international nuclear control, to extract lessons for governing powerful technologies like AI today. The authors find that existential threats can generate broad but fragile support for radical international control schemes, while secrecy, public manipulation, and political pragmatism undermine cooperation. Policymaking tended to resemble incremental 'muddling through' rather than coherent grand strategy.

Key Points

  • Radical international control schemes can gain broad support when facing existential technological threats, but this support is often tenuous and potentially cynical.
  • Secrecy played an important and likely harmful role in nuclear governance efforts, limiting informed public and expert deliberation.
  • Public opinion can be a meaningful force for cooperation but is also manipulable and poorly informed, creating governance risks.
  • Technical experts are critical to governance efforts but must also develop political savvy to be effective.
  • Cooperation on dangerous technologies faces substantial obstacles and may fail even when stakes are existentially high—a cautionary lesson for AI governance.

Cached Content Preview

HTTP 200Fetched Mar 15, 20264 KB
International Control of Powerful Technology: Lessons from the Baruch Plan for Nuclear Weapons | GovAI 

 

 

 About Research Opportunities Team Analysis Alumni Updates Donate About Research Opportunities Team Analysis Alumni Updates Donate International Control of Powerful Technology: Lessons from the Baruch Plan for Nuclear Weapons

 

 The invention of atomic energy posed a novel global challenge: could the technology be controlled to avoid destructive uses and an existentially dangerous arms race while permitting the broad sharing of its benefits? From 1944 onwards, scientists, policymakers, and other ​technical specialists ​began to confront this challenge and explored policy options for dealing with the impact of nuclear technology. We focus on the years 1944 to 1951 and review this period for lessons for the governance of powerful technologies, and find the following: Radical schemes for international control can get broad support when confronted by existentially dangerous technologies, but this support can be tenuous and cynical. Secrecy is likely to play an important, and perhaps harmful, role. The public sphere may be an important source of influence, both in general and in particular in favor of cooperation, but also one that is manipulable and poorly informed. Technical experts may play a critical role, but need to be politically savvy. Overall, policymaking may look more like “muddling through” than clear-eyed grand strategy. Cooperation may be risky, and there may be many obstacles to success.

 The Financial Times discussed this paper in an op-ed in international control.

 Read paper Read paper Theme

 History Date

 March 16, 2021

 author

 s

 Waqar Zaidi and Allan Dafoe

 Share

 Research Summary

 Footnotes

 Further reading

 Related publications

 History

 Lessons from the Development of the Atomic Bomb

 November 2022

 GovAI Report

 Toby Ord

 This report summarises the most important aspects of the development of atomic weapons and draws out a number of important insights for the development of similarly important technologies. 

 History

 Should Artificial Intelligence Governance be Centralised? Six Design Lessons from History

 February 2020

 AAAI AIES conference 2020

 Peter Cihon, Matthijis Maas, and Luke Kemp

 Can effective international governance for artificial intelligence remain fragmented, or is there a need for a centralised international organisation for AI? We draw on the history of other internat...

 History

 How Will National Security Considerations Affect Antitrust Decisions in AI? An Examination of Historical Precedents

 July 2020

 GovAI Report

 Cullen O’Keefe

 Artificial Intelligence (AI)—like past general purpose technologies such as railways, the internet, and electricity—is likely to have significant effects on both national security and market struct...

 History

 Lessons from the Development of the Atomic Bomb

 November 2022

 GovAI Report

 Toby Ord

 This report summarises the most im

... (truncated, 4 KB total)
Resource ID: 697b30a2dacecc26 | Stable ID: N2I2Y2E1YW