Human Compatible: Artificial Intelligence and the Problem of Control

web

Amazon·amazon.com/Human-Compatible-Artificial-Intelligence-Probl...

Credibility Rating

2/5

Mixed(2)

Mixed quality. Some useful content but inconsistent editorial standards. Claims should be verified.

Rating inherited from publication venue: Amazon

Written by Stuart Russell, co-author of the definitive AI textbook, this book is considered one of the most authoritative and accessible introductions to the AI alignment problem and is frequently recommended as a foundational text in AI safety.

Metadata

Importance: 88/100bookprimary source

Summary

Stuart Russell's landmark book argues that the standard model of AI—machines optimizing fixed objectives—is fundamentally flawed and proposes a new framework based on machines that are uncertain about human preferences and defer to humans. It presents the case that beneficial AI requires solving the value alignment problem and outlines a research agenda centered on cooperative inverse reinforcement learning and provably beneficial AI.

Key Points

•Critiques the standard AI model of fixed-objective optimization as inherently dangerous, as machines will pursue objectives regardless of unintended consequences.
•Proposes three core principles for beneficial AI: machines must be uncertain about human preferences, preferences can be inferred from human behavior, and machines should defer to humans.
•Introduces the concept of 'human compatible' AI as a new paradigm replacing the Turing test goal of human-like intelligence with the goal of beneficial intelligence.
•Argues that the AI control problem is the defining challenge of our time and that solving it requires fundamental changes to how AI systems are designed.
•Accessible to general audiences while grounded in technical AI research, written by a leading AI textbook author and researcher.

Cited by 4 pages

Page	Type	Quality
Self-Improvement and Recursive Enhancement	Capability	69.0
Scheming Likelihood Assessment	Analysis	61.0
Center for Human-Compatible AI	Organization	37.0
Instrumental Convergence	Risk	64.0

Cached Content Preview

HTTP 200Fetched Mar 20, 202698 KB

![](https://fls-na.amazon.com/1/batch/1/OP/ATVPDKIKX0DER:138-5258291-0726529:N7D03CB558GRDTYN6528$uedata=s:%2Frd%2Fuedata%3Fstaticb%26id%3DN7D03CB558GRDTYN6528:0)![](https://m.media-amazon.com/images/G/01/gno/sprites/nav-sprite-global-1x-reorg-privacy._CB779528203_.png)

[![Shop spring savings on bulk](https://m.media-amazon.com/images/I/21AfDthTr6L.jpg)](https://www.amazon.com/wholesale/?_encoding=UTF8&ref_=b2b_sow_ilm_largepack_ABBSS26_tier2_Eventall&pd_rd_w=WwNto&content-id=amzn1.sym.3cf14cb1-2e4e-484e-b3f0-ee889021385b&pf_rd_p=3cf14cb1-2e4e-484e-b3f0-ee889021385b&pf_rd_r=N7D03CB558GRDTYN6528&pd_rd_wg=i28hU&pd_rd_r=12229afc-d5b9-490c-89c5-c710954fb946)

## Customers who viewed this item also viewed

1. [![Life 3.0: Being Human in the Age of Artificial Intelligence](https://m.media-amazon.com/images/I/81f4l5CHA0L._AC_SS115_.jpg)](https://www.amazon.com/Life-3-0-Being-Artificial-Intelligence/dp/1101970316/ref=pd_lpo_d_sccl_1/138-5258291-0726529?pd_rd_w=z7eDV&content-id=amzn1.sym.4c8c52db-06f8-4e42-8e56-912796f2ea6c&pf_rd_p=4c8c52db-06f8-4e42-8e56-912796f2ea6c&pf_rd_r=N7D03CB558GRDTYN6528&pd_rd_wg=i28hU&pd_rd_r=12229afc-d5b9-490c-89c5-c710954fb946&pd_rd_i=1101970316&psc=1)







[Life 3.0: Being Human in the Age of Artificial IntelligenceLife 3.0: Being Human in the Age of Artificial Intelligence](https://www.amazon.com/Life-3-0-Being-Artificial-Intelligence/dp/1101970316/ref=pd_lpo_d_sccl_1/138-5258291-0726529?pd_rd_w=z7eDV&content-id=amzn1.sym.4c8c52db-06f8-4e42-8e56-912796f2ea6c&pf_rd_p=4c8c52db-06f8-4e42-8e56-912796f2ea6c&pf_rd_r=N7D03CB558GRDTYN6528&pd_rd_wg=i28hU&pd_rd_r=12229afc-d5b9-490c-89c5-c710954fb946&pd_rd_i=1101970316&psc=1)



[4.46,146](https://www.amazon.com/product-reviews/1101970316/?_encoding=UTF8&pd_rd_w=z7eDV&content-id=amzn1.sym.4c8c52db-06f8-4e42-8e56-912796f2ea6c&pf_rd_p=4c8c52db-06f8-4e42-8e56-912796f2ea6c&pf_rd_r=N7D03CB558GRDTYN6528&pd_rd_wg=i28hU&pd_rd_r=12229afc-d5b9-490c-89c5-c710954fb946&ref_=pd_lpo "4.4 out of 5 stars")





[$10.92$10.92](https://www.amazon.com/Human-Compatible-Artificial-Intelligence-Problem/dp/0525558616#)

2. [![Superintelligence: Paths, Dangers, Strategies](https://m.media-amazon.com/images/I/71UvMcdcE9L._AC_SS115_.jpg)](https://www.amazon.com/Superintelligence-Dangers-Strategies-Nick-Bostrom/dp/0198739834/ref=pd_lpo_d_sccl_2/138-5258291-0726529?pd_rd_w=z7eDV&content-id=amzn1.sym.4c8c52db-06f8-4e42-8e56-912796f2ea6c&pf_rd_p=4c8c52db-06f8-4e42-8e56-912796f2ea6c&pf_rd_r=N7D03CB558GRDTYN6528&pd_rd_wg=i28hU&pd_rd_r=12229afc-d5b9-490c-89c5-c710954fb946&pd_rd_i=0198739834&psc=1)







[Superintelligence: Paths, Dangers, StrategiesSuperintelligence: Paths, Dangers, Strategies](https://www.amazon.com/Superintelligence-Dangers-Strategies-Nick-Bostrom/dp/0198739834/ref=pd_lpo_d_sccl_2/138-5258291-0726529?pd_rd_w=z7eDV&content-id=amzn1.sym.4c8c52db-06f8-4e42-8e56-912796f2ea6c&pf_rd_p=4c8c52db-06f8-4e42-8e56-912796f2ea6c&pf_rd_r=N7D03CB558GRDTYN6528&pd_rd_wg=i28hU&pd_rd_r=12229afc-d5b9-490c-89c5-c71095

... (truncated, 98 KB total)

Resource ID: 568093e306b18188 | Stable ID: YWQwZDE1ZG