Slatestar Codex: Meditations on Moloch

Summary

Scott Alexander's influential essay uses Allen Ginsberg's poem as a metaphor to explore how multipolar traps, coordination failures, and misaligned incentive structures lead rational actors to collectively produce catastrophic outcomes. The essay argues that humanity's greatest challenge is the emergence of optimization processes—markets, evolution, governments, AI—that pursue goals misaligned with human values, and that building 'Moloch-resistant' coordination mechanisms is essential for survival.

Key Points

• •Multipolar traps (races to the bottom, prisoners' dilemmas) cause groups of rational agents to converge on outcomes that are bad for all participants.
• •Many societal ills—environmental destruction, arms races, overwork—stem from coordination failures where defection is individually rational but collectively catastrophic.
• •Sufficiently powerful optimization processes (including AI) can destroy human values as a side effect of pursuing misaligned goals.
• •The essay frames AI alignment as a special case of the broader problem of creating entities that optimize for human values rather than proxies.
• •Alexander argues that a 'friendly' superintelligence could be the only entity capable of enforcing coordination at sufficient scale to defeat Moloch.