Skip to content
Longterm Wiki
Back

Superintelligence: Paths, Dangers, Strategies

web

Credibility Rating

2/5
Mixed(2)

Mixed quality. Some useful content but inconsistent editorial standards. Claims should be verified.

Rating inherited from publication venue: Amazon

This Amazon product page links to one of the most influential books in AI safety; the book itself is a foundational reference that shaped modern alignment research and introduced widely-used terminology in the field.

Metadata

Importance: 88/100bookprimary source

Summary

Nick Bostrom's seminal 2014 book examines the potential paths to superintelligent AI, the catastrophic risks such systems could pose, and strategies for ensuring safe outcomes. It introduced and popularized key concepts like the control problem, instrumental convergence, and the orthogonality thesis that became foundational to AI safety discourse.

Key Points

  • Introduces the orthogonality thesis: any level of intelligence can be combined with virtually any final goal, making value alignment non-trivial.
  • Argues for instrumental convergence: most sufficiently advanced AI systems will pursue similar sub-goals (self-preservation, resource acquisition) regardless of terminal goals.
  • Analyzes multiple paths to superintelligence including whole brain emulation, biological enhancement, and AI recursive self-improvement.
  • Examines control methods including capability control and motivation selection as strategies for managing superintelligent systems safely.
  • Identified existential risk from misaligned superintelligence as a serious concern, significantly influencing the AI safety research agenda.

Cited by 1 page

PageTypeQuality
Treacherous TurnRisk67.0

Cached Content Preview

HTTP 200Fetched Mar 20, 202698 KB
![](https://fls-na.amazon.com/1/batch/1/OP/ATVPDKIKX0DER:147-3001321-3852119:0P5DMZVNHP5128B1Q9DZ$uedata=s:%2Frd%2Fuedata%3Fstaticb%26id%3D0P5DMZVNHP5128B1Q9DZ:0)![](https://m.media-amazon.com/images/G/01/gno/sprites/nav-sprite-global-1x-reorg-privacy._CB779528203_.png)

[![Shop spring savings on bulk](https://m.media-amazon.com/images/I/21AfDthTr6L.jpg)](https://www.amazon.com/wholesale/?_encoding=UTF8&ref_=b2b_sow_ilm_largepack_ABBSS26_tier2_Eventall&pd_rd_w=T84aW&content-id=amzn1.sym.3cf14cb1-2e4e-484e-b3f0-ee889021385b&pf_rd_p=3cf14cb1-2e4e-484e-b3f0-ee889021385b&pf_rd_r=0P5DMZVNHP5128B1Q9DZ&pd_rd_wg=iVccw&pd_rd_r=39f31fa4-4549-4ec4-8f9e-e0aa514dbc87)

- [Books](https://www.amazon.com/books-used-books-textbooks/b/ref=dp_bc_1?ie=UTF8&node=283155)
- ›
- [Computers & Technology](https://www.amazon.com/Computers-Technology-Books/b/ref=dp_bc_2?ie=UTF8&node=5)
- ›
- [Computer Science](https://www.amazon.com/Computer-Science-Computers-Internet-Books/b/ref=dp_bc_3?ie=UTF8&node=3508)
- ›
- [AI & Machine Learning](https://www.amazon.com/Artificial-Intelligence-Computer-Science-Books/b/ref=dp_bc_4?ie=UTF8&node=3887)
- ›
- [Intelligence & Semantics](https://www.amazon.com/Artificial-Intelligence-Semantics/b/ref=dp_bc_5?ie=UTF8&node=280291)

![Amazon Prime Logo](https://m.media-amazon.com/images/G/01/marketing/prime/2022PrimeBrand/Logos/Prime_Logo_RGB_Prime_Blue_MASTER._CB542735979_.png)

Enjoy fast, free delivery, exclusive deals, and award-winning movies & TV shows.

[Join Prime](https://www.amazon.com/Superintelligence-Dangers-Strategies-Nick-Bostrom/dp/0199678111#)

[Kindle\\
\\
$8.79 \\
\\
Available instantly](https://www.amazon.com/Superintelligence-Dangers-Strategies-Nick-Bostrom-ebook/dp/B00LOOCGB2/ref=tmm_kin_swatch_0)

[![](https://m.media-amazon.com/images/G/01/Audible/Homestead/logo/audiblelogo._CB482869198_.png) Audiobook \\
\\
$0.00 \\
\\
with membership trial](https://www.amazon.com/Superintelligence-Nick-Bostrom-audiobook/dp/B00LPMFE9Y/ref=tmm_aud_swatch_0)

Hardcover

$15.27 - $25.40

[Paperback\\
\\
$5.65 - $16.95](https://www.amazon.com/Superintelligence-Dangers-Strategies-Nick-Bostrom/dp/0198739834/ref=tmm_pap_swatch_0)

Other Used and New from $5.65

[Hardcover from $9.41](https://www.amazon.com/gp/offer-listing/0199678111/ref=aod_pop_hrd_used_olp_sr?ie=UTF8&condition=used_olp)

[Paperback from $5.65](https://www.amazon.com/gp/offer-listing/0198739834/ref=aod_pop_pap_used_olp_4?ie=UTF8&condition=used_olp)

[MP3 CD from $119.54](https://www.amazon.com/gp/offer-listing/1501227742/ref=aod_pop_abk_used_olp_5?ie=UTF8&condition=used_olp)

##### Buy new:                     -27%$25.40$25.40                                                                                    FREE delivery Tuesday, March 24 on orders shipped by Amazon over $35                                         Ships from:  Amazon.com         Sold by:  Amazon.com

$25.40 with 27 percent savings -27%$25.40

List Price: $34.99 List Price: $34.99$34.99[![](https://m.media-amaz

... (truncated, 98 KB total)
Resource ID: 6936fd77e804a8c7 | Stable ID: OGQ1MzlhZT