Skip to content
Longterm Wiki
Back

Human Compatible: Artificial Intelligence and the Problem of Control (Russell, 2019)

web

Note: the page content appears to have loaded incorrectly showing Carlo Rovelli's 'The Order of Time' instead of Russell's book; metadata reflects the intended resource 'Human Compatible' by Stuart Russell, a foundational AI safety text widely cited in the field.

Metadata

Importance: 82/100bookprimary source

Summary

Stuart Russell's 'Human Compatible' argues that the standard model of AI development—building systems that optimize fixed objectives—is fundamentally flawed and poses existential risks. Russell proposes a new framework based on machines that are uncertain about human preferences and defer to humans, making AI inherently beneficial and safe by design.

Key Points

  • Critiques the standard AI model of fixed-objective optimization as dangerous because misspecified objectives can lead to catastrophic outcomes
  • Proposes 'assistance games' (inverse reward design) where AI systems maintain uncertainty about true human preferences
  • Argues that provably beneficial AI requires machines to be deferential and correctable by humans
  • Addresses existential risk from superintelligent AI and why capability without aligned values is dangerous
  • Accessible to general audiences while making substantive technical and philosophical arguments about AI safety

Cited by 1 page

PageTypeQuality
AI Compounding Risks Analysis ModelAnalysis60.0

Cached Content Preview

HTTP 200Fetched Mar 15, 20267 KB
[Skip to Content](https://www.penguin.co.uk/books/301539/the-order-of-time-by-rovelli-carlo/9780141984964#main)

- [Home](https://www.penguin.co.uk/)
- [Carlo Rovelli](https://www.penguin.co.uk/authors/123961/carlo-rovelli)
- The Order of Time

## Format:

[Paperback](https://www.penguin.co.uk/books/301539/the-order-of-time-by-rovelli-carlo/9780141984964) [Ebook](https://www.penguin.co.uk/books/301539/the-order-of-time-by-rovelli-carlo/9780241292532) [Audio Download](https://www.penguin.co.uk/books/301539/the-order-of-time-by-rovelli-carlo/9780141988269)

## Buy the book from:

[AmazonOpens in a new tab](https://www.amazon.co.uk/gp/product/0141984961?tag=prhmarketing2552-21) [BlackwellsOpens in a new tab](https://blackwells.co.uk/bookshop/product/9780141984964?a_aid=prh) [Bookshop.orgOpens in a new tab](https://uk.bookshop.org/a/447/9780141984964?utm=penguinbookpage) [FoylesOpens in a new tab](https://www.foyles.co.uk/book/9780141984964) [HiveOpens in a new tab](https://track.webgains.com/click.html?wgcampaignid=1304995&wgprogramid=10671&clickref=book-page&wgtarget=http://www.hive.co.uk/Search?keyword=9780141984964) [TGJonesOpens in a new tab](https://www.awin1.com/cread.php?awinmid=3017&awinaffid=117976&clickref=penguin-book-page&ued=https://www.tgjonesonline.co.uk/Search/Keyword?keyword=9780141984964) [WaterstonesOpens in a new tab](https://www.awin1.com/cread.php?awinmid=3787&awinaffid=117976&clickref=penguin-book-page&p=http%3A%2F%2Fwww.waterstones.com%2Fbook%2F9780141984964)

**THE #1 _SUNDAY TIMES_ BESTSELLER**

**One of TIME's Ten Best Nonfiction Books of the Decade**

**'Captivating, fascinating, profoundly beautiful. . . Rovelli is a wonderfully humane, gentle and witty guide for he is as much philosopher and poet as he is a scientist' John Banville**

_'We are time. We are this space, this clearing opened by the traces of memory inside the connections between our neurons. We are memory. We are nostalgia. We are longing for a future that will not come'_

Time is a mystery that does not cease to puzzle us. Philosophers, artists and poets have long explored its meaning while scientists have found that its structure is different from the simple intuition we have of it. From Boltzmann to quantum theory, from Einstein to loop quantum gravity, our understanding of time has been undergoing radical transformations. Time flows at a different speed in different places, the past and the future differ far less than we might think, and the very notion of the present evaporates in the vast universe.

With his extraordinary charm and sense of wonder, bringing together science, philosophy and art, Carlo Rovelli unravels this mystery. Enlightening and consoling, _The Order of Time_ shows that to understand ourselves we need to reflect on time -- and to understand time we need to reflect on ourselves.

Translated by Simon Carnell and Erica Segre

> ## Modern physics has found its poet. A captivating, fascinating, profoundly beautiful book. . . Rovelli is 

... (truncated, 7 KB total)
Resource ID: 28240d2bdf0f01d5 | Stable ID: MTlmMGU3ZT